2024-04-25T22:44:37.821 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T22:44:37.821 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --verbose --archive /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072 --name teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/orig.config.yaml 2024-04-25T22:44:37.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T22:44:37.944 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674072' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 9595 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 3/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvlSDyUaRtIRQxw+dSAdJqrXOhY7NuXNBhotsxa9HykDz0VFWlKr3x7oDQyinS8f2E7XWNppCjIUlx/QN63o20= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAgZlTYbBKU9ptbhV3PNWM/uZ8WkBzxn3LO3nnobZGsmjqXQP8Ajo7X57/gHDK6LMpWG8SRJMOcHIKqsBSuFm7s= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOftZmqSqevAn57QfHLlQOU4/a/sh8Vvm80IP27crIkDrzIbitS2ImcslNa+LKHWN6Xr1prYrPE1yMf4lCm+k4k= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsRdW3uL2i6POFG6zahbwfWhdsReDTFBsnTfzrA9+oK9D85NLIuumS0fpoIKW6nazdFsNVzIZ/6eTDJIAGfOrg= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_21:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T22:44:37.945 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa; will attempt to use it 2024-04-25T22:44:37.945 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks 2024-04-25T22:44:37.945 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T22:44:37.947 INFO:teuthology.task.internal:Checking packages... 2024-04-25T22:44:37.974 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T22:44:37.974 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T22:44:37.974 INFO:teuthology.packaging:ref: None 2024-04-25T22:44:37.974 INFO:teuthology.packaging:tag: None 2024-04-25T22:44:37.974 INFO:teuthology.packaging:branch: squid 2024-04-25T22:44:37.974 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:44:37.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-25T22:44:38.279 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2447-gb22e2ebd-1jammy 2024-04-25T22:44:38.281 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T22:44:38.287 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T22:44:38.288 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T22:44:38.297 INFO:teuthology.task.internal:Saving configuration 2024-04-25T22:44:38.310 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T22:44:38.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T22:44:38.343 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:38:47.692702', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMvlIwNTVlRLmHTOy2B5dMim9SowVsWIYXL44osZgPZC'} 2024-04-25T22:44:38.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:38:47.693855', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG+RNiiiSZtNvAtv116miP2VLmP+htwib8txwfDhYufh'} 2024-04-25T22:44:38.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:38:47.691557', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIKFrdY/viXY7rkT0HbNG61vbqZySbT2O8ovD0Fij1TY'} 2024-04-25T22:44:38.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:38:47.690005', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINzhufILCrzkRdUYF1iyMfq50jFpAREp4eFC0UljOTTs'} 2024-04-25T22:44:38.411 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T22:44:38.419 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-25T22:44:38.419 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['osd.0'] 2024-04-25T22:44:38.419 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['osd.1'] 2024-04-25T22:44:38.419 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['osd.2'] 2024-04-25T22:44:38.419 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T22:44:38.558 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f109fc5b280>, signals=[15]) 2024-04-25T22:44:38.558 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T22:44:38.565 INFO:teuthology.task.internal:Opening connections... 2024-04-25T22:44:38.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T22:44:38.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:44:38.652 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-04-25T22:44:38.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:44:38.730 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T22:44:38.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:44:38.809 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T22:44:38.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:44:38.887 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T22:44:38.894 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-04-25T22:44:38.900 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-04-25T22:44:38.900 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="22.04" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=jammy 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:44:38.945 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:44:38.946 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-25T22:44:38.971 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-04-25T22:44:38.977 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-04-25T22:44:38.977 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:44:39.025 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:44:39.026 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:44:39.026 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:44:39.026 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-04-25T22:44:39.054 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-04-25T22:44:39.060 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-04-25T22:44:39.060 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="Ubuntu" 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="22.04" 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_CODENAME=jammy 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:ID=ubuntu 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE=debian 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:44:39.108 INFO:teuthology.orchestra.run.smithi165.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:44:39.109 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:44:39.109 INFO:teuthology.orchestra.run.smithi165.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:44:39.109 INFO:teuthology.orchestra.run.smithi165.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:44:39.109 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-04-25T22:44:39.129 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-25T22:44:39.135 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-25T22:44:39.135 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-25T22:44:39.182 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="22.04" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=jammy 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:44:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:44:39.183 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-25T22:44:39.212 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T22:44:39.222 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T22:44:39.230 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T22:44:39.230 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:44:39.232 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:44:39.234 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:44:39.237 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:44:39.242 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T22:44:39.250 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T22:44:39.250 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:44:39.278 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:44:39.282 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:44:39.285 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:44:39.293 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T22:44:39.422 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T22:44:39.437 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T22:44:39.437 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T22:44:39.437 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:44:39.438 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:44:39.438 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:44:39.439 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:44:39.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:44:39.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:44:39.444 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-04-25T22:44:39.445 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-04-25T22:44:39.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:44:39.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:44:39.446 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-25T22:44:39.447 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-25T22:44:39.492 INFO:teuthology.orchestra.run.smithi165.stdout:5.15.0-56-generic 2024-04-25T22:44:39.492 INFO:teuthology.task.kernel:Running kernel on smithi165: 5.15.0-56-generic 2024-04-25T22:44:39.492 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-get clean 2024-04-25T22:44:39.494 INFO:teuthology.orchestra.run.smithi043.stdout:5.15.0-56-generic 2024-04-25T22:44:39.494 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.15.0-56-generic 2024-04-25T22:44:39.494 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2024-04-25T22:44:39.495 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-56-generic 2024-04-25T22:44:39.495 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.15.0-56-generic 2024-04-25T22:44:39.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-04-25T22:44:39.496 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-56-generic 2024-04-25T22:44:39.496 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.15.0-56-generic 2024-04-25T22:44:39.496 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-04-25T22:44:39.612 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-get update 2024-04-25T22:44:39.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-04-25T22:44:39.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-04-25T22:44:39.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-04-25T22:44:39.745 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:44:39.746 INFO:teuthology.orchestra.run.smithi165.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:44:39.751 INFO:teuthology.orchestra.run.smithi165.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:44:39.768 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:44:39.768 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:44:39.768 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:44:39.770 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:44:39.777 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:44:39.794 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:44:39.805 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:44:39.837 INFO:teuthology.orchestra.run.smithi165.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:44:39.847 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:44:39.873 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:44:39.882 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:44:39.889 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:44:39.991 INFO:teuthology.orchestra.run.smithi165.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:44:40.005 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:44:40.006 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:44:40.018 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:44:40.063 INFO:teuthology.orchestra.run.smithi165.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:44:40.072 INFO:teuthology.orchestra.run.smithi165.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:44:40.083 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:44:40.090 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:44:40.100 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:44:40.117 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:44:40.121 INFO:teuthology.orchestra.run.smithi165.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:44:40.121 INFO:teuthology.orchestra.run.smithi165.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:44:40.121 INFO:teuthology.orchestra.run.smithi165.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:44:40.133 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:44:40.134 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:44:40.141 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:44:40.142 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:44:40.146 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:44:40.151 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:44:40.155 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:44:40.156 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:44:40.157 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:44:40.168 INFO:teuthology.orchestra.run.smithi165.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:44:40.170 INFO:teuthology.orchestra.run.smithi165.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:44:40.175 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:44:40.177 INFO:teuthology.orchestra.run.smithi165.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:40.177 INFO:teuthology.orchestra.run.smithi165.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:44:40.188 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:44:40.189 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:44:40.198 INFO:teuthology.orchestra.run.smithi165.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:44:40.202 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:44:40.202 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:44:40.261 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:40.261 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:44:40.268 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:44:40.279 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:44:40.279 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:44:40.282 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:44:40.282 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:44:40.283 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:44:40.283 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:44:40.283 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:44:40.285 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:40.285 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:44:40.293 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:44:40.294 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:44:40.295 INFO:teuthology.orchestra.run.smithi165.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:44:40.295 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:44:40.295 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:44:40.300 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:44:40.302 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:44:40.303 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:40.303 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:44:40.309 INFO:teuthology.orchestra.run.smithi165.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:44:40.309 INFO:teuthology.orchestra.run.smithi165.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:44:40.310 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:44:40.310 INFO:teuthology.orchestra.run.smithi165.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:44:40.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:44:40.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:44:40.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:44:40.311 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:44:40.316 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:44:40.320 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:44:40.321 INFO:teuthology.orchestra.run.smithi165.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:44:40.329 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:44:40.331 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:44:40.332 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:44:40.333 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:44:40.333 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:44:40.339 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:44:40.340 INFO:teuthology.orchestra.run.smithi165.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:44:40.340 INFO:teuthology.orchestra.run.smithi165.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:44:40.341 INFO:teuthology.orchestra.run.smithi165.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:44:40.342 INFO:teuthology.orchestra.run.smithi165.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:44:40.342 INFO:teuthology.orchestra.run.smithi165.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:44:40.343 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:44:40.343 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:44:40.345 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:44:40.346 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:44:40.347 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:44:40.347 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:44:40.347 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:44:40.347 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:44:40.348 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:44:40.348 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:44:40.358 INFO:teuthology.orchestra.run.smithi165.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:44:40.361 INFO:teuthology.orchestra.run.smithi165.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:40.361 INFO:teuthology.orchestra.run.smithi165.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:44:40.369 INFO:teuthology.orchestra.run.smithi165.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:44:40.370 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:44:40.370 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:44:40.371 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:44:40.372 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:44:40.372 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:44:40.372 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:44:40.373 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:44:40.373 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:44:40.373 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:44:40.374 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:44:40.383 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:40.383 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:44:40.394 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:44:40.401 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:44:40.403 INFO:teuthology.orchestra.run.smithi165.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:44:40.404 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:44:40.404 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:44:40.405 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:44:40.405 INFO:teuthology.orchestra.run.smithi165.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:44:40.405 INFO:teuthology.orchestra.run.smithi165.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:44:40.406 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:44:40.406 INFO:teuthology.orchestra.run.smithi165.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:44:40.406 INFO:teuthology.orchestra.run.smithi165.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:44:40.407 INFO:teuthology.orchestra.run.smithi165.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:44:40.413 INFO:teuthology.orchestra.run.smithi165.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:44:40.414 INFO:teuthology.orchestra.run.smithi165.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:44:40.414 INFO:teuthology.orchestra.run.smithi165.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:44:40.421 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:44:40.422 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:44:40.422 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:44:40.423 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:44:40.430 INFO:teuthology.orchestra.run.smithi165.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:44:40.430 INFO:teuthology.orchestra.run.smithi165.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:44:40.431 INFO:teuthology.orchestra.run.smithi165.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:44:40.431 INFO:teuthology.orchestra.run.smithi165.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:44:40.431 INFO:teuthology.orchestra.run.smithi165.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:44:40.442 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:44:40.442 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:44:40.443 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:44:40.443 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:44:40.443 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:44:40.525 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:44:40.627 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:44:40.797 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:44:40.809 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:44:40.809 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:44:40.810 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:44:40.812 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:44:40.895 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:44:40.903 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:40.903 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:44:40.919 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:44:40.977 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:44:40.990 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:44:40.990 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:44:40.992 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:44:41.073 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:44:41.082 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:44:41.083 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:44:41.097 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:44:41.102 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:44:41.502 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:44:41.508 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:44:41.508 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:44:41.523 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:44:41.525 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:44:41.550 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:44:42.024 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:44:42.031 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:44:42.049 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:44:42.050 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:44:42.052 INFO:teuthology.orchestra.run.smithi043.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:44:45.857 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 13.2 MB in 2s (7,148 kB/s) 2024-04-25T22:44:45.936 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 13.2 MB in 2s (7,096 kB/s) 2024-04-25T22:44:46.021 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 13.2 MB in 2s (6,869 kB/s) 2024-04-25T22:44:46.574 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 13.2 MB in 2s (5,614 kB/s) 2024-04-25T22:44:47.232 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-25T22:44:47.248 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:44:47.249 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-04-25T22:44:47.265 DEBUG:teuthology.orchestra.run.smithi165:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:44:47.300 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-25T22:44:47.321 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-04-25T22:44:47.477 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-25T22:44:47.478 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-25T22:44:47.521 INFO:teuthology.orchestra.run.smithi165.stdout:Building dependency tree... 2024-04-25T22:44:47.522 INFO:teuthology.orchestra.run.smithi165.stdout:Reading state information... 2024-04-25T22:44:47.621 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-04-25T22:44:47.631 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:44:47.631 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:44:47.631 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:44:47.631 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:44:47.631 INFO:teuthology.orchestra.run.smithi172.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:44:47.632 INFO:teuthology.orchestra.run.smithi172.stdout: python2.7-minimal 2024-04-25T22:44:47.632 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:44:47.633 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-04-25T22:44:47.633 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:47.633 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:44:47.633 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:47.634 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-04-25T22:44:47.634 INFO:teuthology.orchestra.run.smithi172.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:44:47.634 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-04-25T22:44:47.634 INFO:teuthology.orchestra.run.smithi172.stdout: thermald 2024-04-25T22:44:47.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:44:47.685 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:44:47.685 INFO:teuthology.orchestra.run.smithi165.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:44:47.685 INFO:teuthology.orchestra.run.smithi165.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:44:47.686 INFO:teuthology.orchestra.run.smithi165.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:44:47.686 INFO:teuthology.orchestra.run.smithi165.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:44:47.686 INFO:teuthology.orchestra.run.smithi165.stdout: python2.7-minimal 2024-04-25T22:44:47.686 INFO:teuthology.orchestra.run.smithi165.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:44:47.687 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-04-25T22:44:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:44:47.687 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:47.687 INFO:teuthology.orchestra.run.smithi165.stdout:The following additional packages will be installed: 2024-04-25T22:44:47.687 INFO:teuthology.orchestra.run.smithi165.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:47.687 INFO:teuthology.orchestra.run.smithi165.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:44:47.688 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-04-25T22:44:47.688 INFO:teuthology.orchestra.run.smithi165.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:47.688 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:44:47.689 INFO:teuthology.orchestra.run.smithi165.stdout:Suggested packages: 2024-04-25T22:44:47.689 INFO:teuthology.orchestra.run.smithi165.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:44:47.689 INFO:teuthology.orchestra.run.smithi165.stdout:Recommended packages: 2024-04-25T22:44:47.689 INFO:teuthology.orchestra.run.smithi165.stdout: thermald 2024-04-25T22:44:47.694 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-04-25T22:44:47.729 INFO:teuthology.orchestra.run.smithi165.stdout:The following NEW packages will be installed: 2024-04-25T22:44:47.729 INFO:teuthology.orchestra.run.smithi165.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:47.729 INFO:teuthology.orchestra.run.smithi165.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:44:47.730 INFO:teuthology.orchestra.run.smithi165.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:47.731 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages will be upgraded: 2024-04-25T22:44:47.731 INFO:teuthology.orchestra.run.smithi165.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:44:47.894 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-04-25T22:44:47.895 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-04-25T22:44:47.986 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-25T22:44:48.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:44:48.068 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-25T22:44:48.069 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:44:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:44:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:44:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:44:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:44:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: python2.7-minimal 2024-04-25T22:44:48.070 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:44:48.071 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-04-25T22:44:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:44:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:48.073 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-04-25T22:44:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:44:48.073 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-04-25T22:44:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2024-04-25T22:44:48.114 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-04-25T22:44:48.114 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:48.114 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:44:48.115 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:48.115 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-04-25T22:44:48.116 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:44:48.173 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:44:48.173 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 113 MB of archives. 2024-04-25T22:44:48.173 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:44:48.173 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:44:48.175 INFO:teuthology.orchestra.run.smithi172.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:44:48.175 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 113 MB of archives. 2024-04-25T22:44:48.175 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:44:48.175 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:44:48.227 INFO:teuthology.orchestra.run.smithi165.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:44:48.227 INFO:teuthology.orchestra.run.smithi165.stdout:Need to get 113 MB of archives. 2024-04-25T22:44:48.227 INFO:teuthology.orchestra.run.smithi165.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:44:48.227 INFO:teuthology.orchestra.run.smithi165.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:44:48.272 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-25T22:44:48.272 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-25T22:44:48.454 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:44:48.454 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:44:48.454 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:44:48.455 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:44:48.455 INFO:teuthology.orchestra.run.smithi043.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:44:48.455 INFO:teuthology.orchestra.run.smithi043.stdout: python2.7-minimal 2024-04-25T22:44:48.455 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:44:48.457 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-04-25T22:44:48.457 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:48.457 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:44:48.457 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:48.458 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-04-25T22:44:48.458 INFO:teuthology.orchestra.run.smithi043.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:44:48.458 INFO:teuthology.orchestra.run.smithi043.stdout:Recommended packages: 2024-04-25T22:44:48.458 INFO:teuthology.orchestra.run.smithi043.stdout: thermald 2024-04-25T22:44:48.507 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-04-25T22:44:48.507 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:44:48.507 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:44:48.507 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:44:48.508 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages will be upgraded: 2024-04-25T22:44:48.509 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:44:48.565 INFO:teuthology.orchestra.run.smithi043.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:44:48.566 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 113 MB of archives. 2024-04-25T22:44:48.566 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:44:48.566 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:44:48.627 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:44:48.747 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:44:49.209 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:44:49.408 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:44:49.670 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:44:50.102 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:44:50.102 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:44:50.103 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:44:50.637 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:44:50.667 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:44:50.667 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:44:50.667 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:44:50.806 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:44:51.077 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:44:51.156 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:44:51.194 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 113 MB in 3s (42.2 MB/s) 2024-04-25T22:44:51.376 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:44:51.578 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 113 MB in 3s (42.9 MB/s) 2024-04-25T22:44:51.739 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:44:53.413 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:44:53.418 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:44:53.489 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:44:53.742 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:44:53.746 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:44:53.878 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:44:55.026 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:44:55.606 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:44:55.627 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:44:55.718 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:44:56.168 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:44:56.188 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:44:56.204 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:44:56.226 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:44:56.228 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:44:56.310 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:44:56.816 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:44:56.836 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:44:56.874 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:03.182 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:03.308 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:03.641 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:03.745 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:03.893 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:04.006 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:45:04.028 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:45:04.034 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:04.073 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:04.343 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:04.489 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:04.808 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:45:04.831 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:45:04.874 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:45:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:45:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:45:08.133 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:45:08.216 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:45:08.637 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 113 MB in 21s (5,521 kB/s) 2024-04-25T22:45:08.838 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:45:09.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:45:09.978 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:10.016 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:10.376 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:45:10.412 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:10.450 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:10.848 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:45:10.853 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:10.918 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:12.669 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:12.792 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:13.134 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:13.255 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:13.302 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:45:13.323 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:13.381 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:45:13.410 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:13.510 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:13.728 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:13.853 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:13.888 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:45:13.909 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:13.946 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:14.220 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:14.341 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:14.451 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:45:14.554 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:14.843 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:14.843 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:14.843 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:14.844 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:15.011 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:15.953 INFO:teuthology.orchestra.run.smithi043.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:15.954 INFO:teuthology.orchestra.run.smithi043.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:15.954 INFO:teuthology.orchestra.run.smithi043.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:15.954 INFO:teuthology.orchestra.run.smithi043.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:16.173 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:16.422 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:17.609 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:17.914 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:45:18.040 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:45:18.166 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:18.223 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:45:18.223 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:19.017 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:45:19.152 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:45:19.270 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:19.333 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:45:19.333 INFO:teuthology.orchestra.run.smithi043.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:19.624 INFO:teuthology.orchestra.run.smithi165.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:45:20.004 INFO:teuthology.orchestra.run.smithi165.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:45:21.087 INFO:teuthology.orchestra.run.smithi165.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:45:21.108 INFO:teuthology.orchestra.run.smithi165.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:45:21.129 INFO:teuthology.orchestra.run.smithi165.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:45:21.155 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:21.302 INFO:teuthology.orchestra.run.smithi165.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:45:21.360 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:45:21.638 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:21.776 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 113 MB in 34s (3,370 kB/s) 2024-04-25T22:45:21.964 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:21.997 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:45:22.068 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:22.379 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:45:22.401 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:45:22.446 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:23.910 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:45:23.914 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:23.978 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:26.147 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:45:26.169 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:26.251 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:26.709 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:45:26.730 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:26.767 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:28.220 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:45:28.257 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:28.295 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:30.878 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:31.014 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:31.346 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:31.468 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:31.594 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:45:31.714 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:32.037 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:45:32.037 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:45:32.049 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:45:32.067 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2024-04-25T22:45:32.358 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:32.376 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:32.690 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:32.696 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:32.768 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:45:32.773 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:45:32.941 INFO:teuthology.orchestra.run.smithi099.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:45:32.941 INFO:teuthology.orchestra.run.smithi099.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:45:32.941 INFO:teuthology.orchestra.run.smithi099.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:45:32.972 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-04-25T22:45:33.029 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:33.029 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:33.029 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:33.029 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:33.199 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:33.421 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.105.102 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:45:33.443 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:45:33.444 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-04-25T22:45:33.444 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-04-25T22:45:33.444 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:45:33.444 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-04-25T22:45:33.444 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:45:33.444 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:45:33.444 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:45:33.444 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-25T22:45:33.444 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:45:33.445 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-04-25T22:45:33.520 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:33.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-04-25T22:45:33.647 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:45:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:45:33.882 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:45:33.882 INFO:teuthology.orchestra.run.smithi043.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:45:33.911 INFO:teuthology.orchestra.run.smithi043.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:45:33.943 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:45:33.967 INFO:teuthology.orchestra.run.smithi043.stdout:Generating grub configuration file ... 2024-04-25T22:45:33.988 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:34.026 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:45:34.109 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:34.295 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:34.316 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:34.379 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:45:34.390 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:45:34.429 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:34.585 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:34.661 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:34.667 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:34.733 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:45:34.739 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:45:34.918 INFO:teuthology.orchestra.run.smithi043.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:45:34.918 INFO:teuthology.orchestra.run.smithi043.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:45:34.918 INFO:teuthology.orchestra.run.smithi043.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:45:34.948 INFO:teuthology.orchestra.run.smithi043.stdout:done 2024-04-25T22:45:35.250 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-04-25T22:45:35.268 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:45:35.329 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-04-25T22:45:35.420 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2024-04-25T22:45:35.448 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 21 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 5.15.0.105.102 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:45:35.449 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2024-04-25T22:45:35.450 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:45:35.450 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:45:35.450 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:45:35.450 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T22:45:35.450 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:45:35.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2024-04-25T22:45:35.534 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-04-25T22:45:35.534 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-04-25T22:45:35.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-04-25T22:45:35.711 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:45:35.711 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:45:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:45:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:45:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:45:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:45:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:45:35.712 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:45:35.753 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:45:35.755 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-04-25T22:45:35.770 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.105.102 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-04-25T22:45:35.771 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-04-25T22:45:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:45:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-04-25T22:45:35.772 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-04-25T22:45:35.816 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.HBNknt6f1z 2024-04-25T22:45:35.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HBNknt6f1z 2024-04-25T22:45:35.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.HBNknt6f1z 2024-04-25T22:45:35.936 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:45:35.960 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:45:35.981 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.HBNknt6f1z is 10KB 2024-04-25T22:45:35.995 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.HBNknt6f1z 2024-04-25T22:45:36.001 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:45:36.056 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:45:36.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:45:36.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:45:36.086 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:45:36.123 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:45:36.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2024-04-25T22:45:36.212 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:45:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:36.791 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:45:36.864 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:45:36.952 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:45:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:45:37.252 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:45:37.255 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-04-25T22:45:37.417 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:37.423 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:37.646 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:37.686 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:45:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:45:37.798 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:45:37.798 INFO:teuthology.orchestra.run.smithi099.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:45:37.798 INFO:teuthology.orchestra.run.smithi099.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:45:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-04-25T22:45:37.826 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-04-25T22:45:38.115 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-25T22:45:38.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:45:38.186 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-25T22:45:38.369 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-25T22:45:38.369 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-25T22:45:38.532 INFO:teuthology.orchestra.run.smithi043.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:45:38.532 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:45:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:45:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:45:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:45:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:45:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:45:38.533 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:45:38.571 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:45:38.573 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 21 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2024-04-25T22:45:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 5.15.0.105.102 2024-04-25T22:45:38.633 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:45:38.633 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:45:38.633 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2024-04-25T22:45:38.633 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2024-04-25T22:45:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:45:38.633 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2024-04-25T22:45:38.633 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-25T22:45:38.685 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.51yThAQgFS 2024-04-25T22:45:38.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub/grub.cfg /tmp/tmp.51yThAQgFS 2024-04-25T22:45:38.743 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.51yThAQgFS 2024-04-25T22:45:38.856 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.51yThAQgFS is 10KB 2024-04-25T22:45:38.869 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.51yThAQgFS 2024-04-25T22:45:38.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:45:38.928 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:45:38.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:45:38.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:45:38.996 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:45:38.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo update-grub 2024-04-25T22:45:39.702 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:45:39.739 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:45:39.776 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:40.287 INFO:teuthology.orchestra.run.smithi043.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:45:40.288 INFO:teuthology.orchestra.run.smithi043.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:45:40.290 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-04-25T22:45:40.465 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:45:40.769 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:45:40.892 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:45:40.892 INFO:teuthology.orchestra.run.smithi043.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:45:40.892 INFO:teuthology.orchestra.run.smithi043.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:45:40.914 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-04-25T22:45:40.922 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-04-25T22:45:42.341 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:45:42.485 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:45:42.810 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:45:42.932 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:43.058 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:45:43.161 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:44.472 INFO:teuthology.orchestra.run.smithi165.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:44.472 INFO:teuthology.orchestra.run.smithi165.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:44.472 INFO:teuthology.orchestra.run.smithi165.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:44.473 INFO:teuthology.orchestra.run.smithi165.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:44.637 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:46.064 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:47.464 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:45:47.590 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:45:47.700 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:45:47.751 INFO:teuthology.orchestra.run.smithi165.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:45:47.751 INFO:teuthology.orchestra.run.smithi165.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:50.351 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:45:50.351 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:45:50.369 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:45:50.389 INFO:teuthology.orchestra.run.smithi172.stdout:Generating grub configuration file ... 2024-04-25T22:45:50.671 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:50.689 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:50.991 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:50.996 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:51.073 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:45:51.078 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:45:51.262 INFO:teuthology.orchestra.run.smithi172.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:45:51.262 INFO:teuthology.orchestra.run.smithi172.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:45:51.262 INFO:teuthology.orchestra.run.smithi172.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:45:51.300 INFO:teuthology.orchestra.run.smithi172.stdout:done 2024-04-25T22:45:51.692 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 21 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.105.102 2024-04-25T22:45:51.716 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:45:51.717 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:45:51.717 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-04-25T22:45:51.717 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-04-25T22:45:51.717 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:45:51.717 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-04-25T22:45:51.717 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:45:51.717 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:45:51.717 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:45:51.717 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-25T22:45:51.717 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:45:51.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-04-25T22:45:51.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-04-25T22:45:52.035 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:45:52.035 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:45:52.046 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:45:52.068 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:45:53.343 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-25T22:45:53.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:45:53.413 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-25T22:45:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-25T22:45:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-25T22:45:53.751 INFO:teuthology.orchestra.run.smithi172.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:45:53.751 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:45:53.751 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:45:53.751 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:45:53.751 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:45:53.752 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:45:53.752 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:45:53.752 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:45:53.790 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:45:53.792 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-04-25T22:45:53.847 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-04-25T22:45:53.847 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-04-25T22:45:53.847 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-04-25T22:45:53.847 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 21 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.105.102 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:45:53.848 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-04-25T22:45:53.849 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-04-25T22:45:53.893 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.SzHtEAHulC 2024-04-25T22:45:53.893 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SzHtEAHulC 2024-04-25T22:45:53.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.SzHtEAHulC 2024-04-25T22:45:54.068 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.SzHtEAHulC is 10KB 2024-04-25T22:45:54.081 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.SzHtEAHulC 2024-04-25T22:45:54.086 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:45:54.145 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:45:54.145 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:45:54.145 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:45:54.213 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:45:54.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo update-grub 2024-04-25T22:45:55.415 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:45:55.417 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:45:55.418 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-04-25T22:45:55.602 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:45:55.608 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:45:55.833 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:45:55.839 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:45:55.883 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:45:55.889 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:45:55.998 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:45:55.998 INFO:teuthology.orchestra.run.smithi172.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:45:55.998 INFO:teuthology.orchestra.run.smithi172.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:45:56.008 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-04-25T22:45:56.024 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-04-25T22:46:01.627 INFO:teuthology.orchestra.run.smithi165.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:46:01.628 INFO:teuthology.orchestra.run.smithi165.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:46:01.646 INFO:teuthology.orchestra.run.smithi165.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:46:01.668 INFO:teuthology.orchestra.run.smithi165.stdout:Generating grub configuration file ... 2024-04-25T22:46:02.005 INFO:teuthology.orchestra.run.smithi165.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:46:02.024 INFO:teuthology.orchestra.run.smithi165.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:46:02.365 INFO:teuthology.orchestra.run.smithi165.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:46:02.371 INFO:teuthology.orchestra.run.smithi165.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:46:02.447 INFO:teuthology.orchestra.run.smithi165.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:46:02.453 INFO:teuthology.orchestra.run.smithi165.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:46:02.625 INFO:teuthology.orchestra.run.smithi165.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:46:02.625 INFO:teuthology.orchestra.run.smithi165.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:46:02.625 INFO:teuthology.orchestra.run.smithi165.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:46:02.656 INFO:teuthology.orchestra.run.smithi165.stdout:done 2024-04-25T22:46:03.106 DEBUG:teuthology.orchestra.run.smithi165:> dpkg -s linux-image-generic 2024-04-25T22:46:03.128 INFO:teuthology.orchestra.run.smithi165.stdout:Package: linux-image-generic 2024-04-25T22:46:03.128 INFO:teuthology.orchestra.run.smithi165.stdout:Status: install ok installed 2024-04-25T22:46:03.128 INFO:teuthology.orchestra.run.smithi165.stdout:Priority: optional 2024-04-25T22:46:03.128 INFO:teuthology.orchestra.run.smithi165.stdout:Section: kernel 2024-04-25T22:46:03.128 INFO:teuthology.orchestra.run.smithi165.stdout:Installed-Size: 21 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: amd64 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Source: linux-meta 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Version: 5.15.0.105.102 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Recommends: thermald 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout:Description: Generic Linux kernel image 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:46:03.129 INFO:teuthology.orchestra.run.smithi165.stdout: available. 2024-04-25T22:46:03.129 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:46:03.130 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:46:03.130 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:46:03.130 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-25T22:46:03.130 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:46:03.130 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-get clean 2024-04-25T22:46:03.263 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-get update 2024-04-25T22:46:03.378 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:46:03.389 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:46:03.408 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:46:04.026 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:46:05.225 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-04-25T22:46:05.243 DEBUG:teuthology.orchestra.run.smithi165:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:46:05.303 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-04-25T22:46:05.507 INFO:teuthology.orchestra.run.smithi165.stdout:Building dependency tree... 2024-04-25T22:46:05.507 INFO:teuthology.orchestra.run.smithi165.stdout:Reading state information... 2024-04-25T22:46:05.665 INFO:teuthology.orchestra.run.smithi165.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:46:05.665 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:46:05.665 INFO:teuthology.orchestra.run.smithi165.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:46:05.665 INFO:teuthology.orchestra.run.smithi165.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:46:05.665 INFO:teuthology.orchestra.run.smithi165.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:46:05.666 INFO:teuthology.orchestra.run.smithi165.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:46:05.666 INFO:teuthology.orchestra.run.smithi165.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:46:05.666 INFO:teuthology.orchestra.run.smithi165.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:46:05.702 INFO:teuthology.orchestra.run.smithi165.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:46:05.704 DEBUG:teuthology.orchestra.run.smithi165:> dpkg -s linux-image-generic 2024-04-25T22:46:05.719 INFO:teuthology.orchestra.run.smithi165.stdout:Package: linux-image-generic 2024-04-25T22:46:05.719 INFO:teuthology.orchestra.run.smithi165.stdout:Status: install ok installed 2024-04-25T22:46:05.719 INFO:teuthology.orchestra.run.smithi165.stdout:Priority: optional 2024-04-25T22:46:05.719 INFO:teuthology.orchestra.run.smithi165.stdout:Section: kernel 2024-04-25T22:46:05.719 INFO:teuthology.orchestra.run.smithi165.stdout:Installed-Size: 21 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: amd64 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Source: linux-meta 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Version: 5.15.0.105.102 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Recommends: thermald 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout:Description: Generic Linux kernel image 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:46:05.720 INFO:teuthology.orchestra.run.smithi165.stdout: available. 2024-04-25T22:46:05.720 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-04-25T22:46:05.770 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.rkep2yav0P 2024-04-25T22:46:05.771 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rkep2yav0P 2024-04-25T22:46:05.826 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.rkep2yav0P 2024-04-25T22:46:05.951 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.rkep2yav0P is 10KB 2024-04-25T22:46:05.964 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.rkep2yav0P 2024-04-25T22:46:05.969 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:46:06.022 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:46:06.022 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:46:06.022 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:46:06.090 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:46:06.090 DEBUG:teuthology.orchestra.run.smithi165:> sudo update-grub 2024-04-25T22:46:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:46:07.264 INFO:teuthology.orchestra.run.smithi165.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:46:07.270 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-04-25T22:46:07.478 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:46:07.484 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:46:07.721 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:46:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:46:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:46:07.772 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:46:07.829 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-25T22:46:07.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-25T22:46:07.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:07.901 INFO:teuthology.orchestra.run.smithi165.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:46:07.901 INFO:teuthology.orchestra.run.smithi165.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:46:07.901 INFO:teuthology.orchestra.run.smithi165.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:46:07.919 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-04-25T22:46:07.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2024-04-25T22:46:10.927 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T22:46:10.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T22:46:10.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:26.042 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-25T22:46:26.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T22:46:26.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:26.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-25T22:46:29.406 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-25T22:46:35.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-25T22:46:35.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:37.932 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-25T22:46:37.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T22:46:37.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:38.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-25T22:46:38.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T22:46:38.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:44.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-25T22:46:50.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-25T22:46:50.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:53.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T22:46:53.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:46:56.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-04-25T22:46:56.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-25T22:47:05.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T22:47:05.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:47:08.350 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-04-25T22:47:08.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T22:47:08.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:47:08.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-04-25T22:47:20.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T22:47:20.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:47:23.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-25T22:47:23.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:47:24.382 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-04-25T22:47:25.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-25T22:47:25.126 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-105-generic"... 2024-04-25T22:47:25.126 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-04-25T22:47:25.175 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-105-generic 2024-04-25T22:47:25.175 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:47:25.176 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:47:25.176 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:47:26.176 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-25T22:47:26.177 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:47:26.285 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-04-25T22:47:26.308 DEBUG:teuthology.parallel:result is None 2024-04-25T22:47:38.410 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T22:47:50.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T22:47:50.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:47:50.680 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-25T22:47:51.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T22:47:51.356 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T22:47:51.357 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-25T22:47:51.404 INFO:teuthology.orchestra.run.smithi043.stdout:5.15.0-105-generic 2024-04-25T22:47:51.404 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:47:51.404 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:47:51.404 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:47:52.406 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T22:47:52.406 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:47:52.489 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-04-25T22:47:52.517 DEBUG:teuthology.parallel:result is None 2024-04-25T22:48:08.578 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T22:48:20.367 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T22:48:23.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T22:48:23.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:48:23.884 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-25T22:48:24.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T22:48:24.471 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-105-generic"... 2024-04-25T22:48:24.471 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-25T22:48:24.518 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-105-generic 2024-04-25T22:48:24.518 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:48:24.518 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:48:24.518 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:48:25.519 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-25T22:48:25.519 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:48:25.603 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-04-25T22:48:25.627 DEBUG:teuthology.parallel:result is None 2024-04-25T22:48:35.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T22:48:35.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:48:35.597 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-04-25T22:48:36.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T22:48:36.222 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-105-generic"... 2024-04-25T22:48:36.223 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-04-25T22:48:36.268 INFO:teuthology.orchestra.run.smithi165.stdout:5.15.0-105-generic 2024-04-25T22:48:36.268 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:48:36.268 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:48:36.268 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:48:37.269 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-25T22:48:37.269 DEBUG:teuthology.orchestra.run.smithi165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:48:37.624 INFO:teuthology.orchestra.run.smithi165.stdout:ttyS1 2024-04-25T22:48:37.658 DEBUG:teuthology.parallel:result is None 2024-04-25T22:48:37.659 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T22:48:37.667 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T22:48:37.667 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:48:37.670 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:48:37.673 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:48:37.676 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:48:37.682 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T22:48:37.689 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T22:48:37.697 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T22:48:37.698 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:48:37.717 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:48:37.723 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:48:37.725 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:48:37.840 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T22:48:37.847 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T22:48:37.847 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:48:37.849 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:48:37.853 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:48:37.856 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:48:37.870 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.871 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.873 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.876 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.879 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.879 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.882 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.884 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:48:37.887 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T22:48:37.894 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T22:48:37.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:48:37.925 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:48:37.935 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:48:37.937 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:48:37.949 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T22:48:37.959 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T22:48:37.959 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:48:37.981 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:48:37.990 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:48:37.993 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:48:37.999 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:48:38.032 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:48:38.080 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:48:38.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:48:38.145 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:48:38.151 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:48:38.198 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:48:38.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:48:38.262 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:48:38.268 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:48:38.316 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:48:38.317 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:48:38.392 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:48:38.397 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:48:38.446 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:48:38.446 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:48:38.516 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-04-25T22:48:38.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-04-25T22:48:38.521 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-04-25T22:48:38.523 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-04-25T22:48:38.608 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T22:48:38.617 INFO:teuthology.task.internal:Starting timer... 2024-04-25T22:48:38.617 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T22:48:38.627 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T22:48:38.636 DEBUG:teuthology.task.selinux:Excluding smithi043: OS 'ubuntu' does not support SELinux 2024-04-25T22:48:38.636 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2024-04-25T22:48:38.636 DEBUG:teuthology.task.selinux:Excluding smithi165: OS 'ubuntu' does not support SELinux 2024-04-25T22:48:38.636 DEBUG:teuthology.task.selinux:Excluding smithi172: OS 'ubuntu' does not support SELinux 2024-04-25T22:48:38.637 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T22:48:38.637 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T22:48:38.637 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T22:48:38.637 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T22:48:38.646 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T22:48:38.651 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T22:48:38.776 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T22:48:38.794 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T22:48:38.795 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi099.front.sepia.ceph.com,smithi165.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T22:55:53.543 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-04-25T22:55:53.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T22:55:53.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:55:53.636 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-25T22:55:53.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T22:55:53.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-25T22:55:53.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:55:53.797 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-04-25T22:55:53.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-04-25T22:55:53.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T22:55:53.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:55:53.956 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-04-25T22:55:54.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T22:55:54.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T22:55:54.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:55:54.110 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-25T22:55:54.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T22:55:54.188 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T22:55:54.198 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T22:55:54.198 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:55:54.199 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:55:54.201 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:55:54.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:55:54.204 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:55:54.204 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:55:54.206 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:55:54.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:55:54.229 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:55:54.229 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Command line: ntpd -gq 2024-04-25T22:55:54.229 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: ---------------------------------------------------- 2024-04-25T22:55:54.229 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:55:54.229 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:55:54.229 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: corporation. Support and training for ntp-4 are 2024-04-25T22:55:54.229 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: available at https://www.nwtime.org/support 2024-04-25T22:55:54.230 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: ---------------------------------------------------- 2024-04-25T22:55:54.230 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: proto: precision = 0.068 usec (-24) 2024-04-25T22:55:54.233 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: basedate set to 2022-02-04 2024-04-25T22:55:54.234 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:55:54.234 INFO:teuthology.orchestra.run.smithi043.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.235 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.235 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.235 INFO:teuthology.orchestra.run.smithi043.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.236 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:55:54.236 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:55:54.236 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:55:54.236 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Listen normally on 3 ens1f0 172.21.15.43:123 2024-04-25T22:55:54.236 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Listen normally on 4 lo [::1]:123 2024-04-25T22:55:54.236 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1358%4]:123 2024-04-25T22:55:54.236 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:55:54 ntpd[17124]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Command line: ntpd -gq 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: ---------------------------------------------------- 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: corporation. Support and training for ntp-4 are 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: available at https://www.nwtime.org/support 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: ---------------------------------------------------- 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: proto: precision = 0.062 usec (-24) 2024-04-25T22:55:54.238 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: basedate set to 2022-02-04 2024-04-25T22:55:54.239 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:55:54.239 INFO:teuthology.orchestra.run.smithi165.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.239 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:55:54.239 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Command line: ntpd -gq 2024-04-25T22:55:54.239 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: ---------------------------------------------------- 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: corporation. Support and training for ntp-4 are 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: available at https://www.nwtime.org/support 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: ---------------------------------------------------- 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: proto: precision = 0.043 usec (-24) 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: basedate set to 2022-02-04 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.240 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.241 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.241 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.241 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.241 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.241 INFO:teuthology.orchestra.run.smithi165.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.243 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:55:54.243 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:55:54.243 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:55:54.243 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Listen normally on 4 lo [::1]:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:55:54 ntpd[17213]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Listen normally on 3 enp3s0f1 172.21.15.165:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Listen normally on 4 lo [::1]:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f63%5]:123 2024-04-25T22:55:54.244 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:55:54 ntpd[17202]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Command line: ntpd -gq 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: ---------------------------------------------------- 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: corporation. Support and training for ntp-4 are 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: available at https://www.nwtime.org/support 2024-04-25T22:55:54.251 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: ---------------------------------------------------- 2024-04-25T22:55:54.252 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: proto: precision = 0.044 usec (-24) 2024-04-25T22:55:54.252 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: basedate set to 2022-02-04 2024-04-25T22:55:54.252 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:55:54.252 INFO:teuthology.orchestra.run.smithi172.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.252 INFO:teuthology.orchestra.run.smithi172.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.253 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:55:54.253 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:55:54.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:55:54.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:55:54.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:55:54.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Listen normally on 3 enp3s0f1 172.21.15.172:123 2024-04-25T22:55:54.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Listen normally on 4 lo [::1]:123 2024-04-25T22:55:54.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f91%5]:123 2024-04-25T22:55:54.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:55:54 ntpd[17206]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:55:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:55.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:55 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:55.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:55.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:55.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:55 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:55.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:55 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:55 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:55 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:55 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:55 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:55.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:55 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:55.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:55 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:56.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:56 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:56.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:56 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:56.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:56 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:56.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:56 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:56.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:56 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:56.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:56 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:56.251 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:56 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:56.251 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:56 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:57 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:57 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:57 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:57 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:57 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:57 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:57 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:57.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:57.238 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:57.238 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.238 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.238 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:57.238 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:57 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:57.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:57 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:58.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:58 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:58 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:58 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:58 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:58 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:58.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:58 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:58.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:58.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:58 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:58.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:58 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:58 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:58 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:58 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:58 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:58.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:58 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:58.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:58 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:58 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:58 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:58.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:58 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:58.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:58 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:58.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:58 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:55:59 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:55:59 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:55:59 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:55:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:55:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:55:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:55:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:55:59 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:00.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:00 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:00 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:00 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:00 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:00 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:00.230 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:00 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:00.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:00 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:00 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:00 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:00 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:00 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:00.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:00 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:00.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:00 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:00 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:00 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:00 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:00 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:00.235 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:00 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:00 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:00 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:00 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:00 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:00 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:00 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:01.232 INFO:teuthology.orchestra.run.smithi043.stdout:25 Apr 22:56:01 ntpd[17124]: ntpd: time slew -0.001265 s 2024-04-25T22:56:01.232 INFO:teuthology.orchestra.run.smithi043.stdout:ntpd: time slew -0.001265s 2024-04-25T22:56:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:56:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:25 Apr 22:56:01 ntpd[17124]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:56:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:01.235 INFO:teuthology.orchestra.run.smithi099.stdout:25 Apr 22:56:01 ntpd[17213]: ntpd: time slew -0.001168 s 2024-04-25T22:56:01.235 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time slew -0.001168s 2024-04-25T22:56:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:56:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:25 Apr 22:56:01 ntpd[17213]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:56:01.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.236 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stdout:25 Apr 22:56:01 ntpd[17202]: ntpd: time slew +0.000588 s 2024-04-25T22:56:01.237 INFO:teuthology.orchestra.run.smithi165.stdout:ntpd: time slew +0.000588s 2024-04-25T22:56:01.238 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:56:01.238 INFO:teuthology.orchestra.run.smithi165.stderr:25 Apr 22:56:01 ntpd[17202]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:56:01.252 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:56:01.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:56:01.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:56:01.253 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:56:01.254 INFO:teuthology.orchestra.run.smithi172.stdout:25 Apr 22:56:01 ntpd[17206]: ntpd: time slew -0.000243 s 2024-04-25T22:56:01.254 INFO:teuthology.orchestra.run.smithi172.stdout:ntpd: time slew -0.000243s 2024-04-25T22:56:01.254 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:56:01.254 INFO:teuthology.orchestra.run.smithi172.stderr:25 Apr 22:56:01 ntpd[17206]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:56:01.284 INFO:teuthology.orchestra.run.smithi043.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:56:01.284 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================== 2024-04-25T22:56:01.284 INFO:teuthology.orchestra.run.smithi043.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.284 INFO:teuthology.orchestra.run.smithi043.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.285 INFO:teuthology.orchestra.run.smithi043.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.285 INFO:teuthology.orchestra.run.smithi043.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.295 INFO:teuthology.orchestra.run.smithi165.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:56:01.295 INFO:teuthology.orchestra.run.smithi165.stdout:============================================================================== 2024-04-25T22:56:01.295 INFO:teuthology.orchestra.run.smithi165.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.295 INFO:teuthology.orchestra.run.smithi165.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.295 INFO:teuthology.orchestra.run.smithi165.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.295 INFO:teuthology.orchestra.run.smithi165.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.305 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:56:01.305 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-04-25T22:56:01.305 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.305 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.305 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.305 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:56:01.368 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-04-25T22:56:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.369 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.369 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.369 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:56:01.370 INFO:teuthology.run_tasks:Running task install... 2024-04-25T22:56:01.381 DEBUG:teuthology.task.install:project ceph 2024-04-25T22:56:01.381 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T22:56:01.381 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T22:56:01.381 INFO:teuthology.task.install:Using flavor: default 2024-04-25T22:56:01.388 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T22:56:01.389 INFO:teuthology.task.install:extra packages: [] 2024-04-25T22:56:01.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-key list | grep Ceph 2024-04-25T22:56:01.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2024-04-25T22:56:01.391 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-key list | grep Ceph 2024-04-25T22:56:01.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-key list | grep Ceph 2024-04-25T22:56:01.450 INFO:teuthology.orchestra.run.smithi165.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:56:01.455 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:56:01.459 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:56:01.476 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:56:01.484 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:56:01.484 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:56:01.485 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:56:01.485 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:56:01.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:56:01.490 INFO:teuthology.orchestra.run.smithi165.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:56:01.490 INFO:teuthology.orchestra.run.smithi165.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:56:01.491 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:56:01.491 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:56:01.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:56:01.495 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:56:01.495 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:56:01.495 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:56:01.495 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:56:01.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:56:01.506 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:56:01.507 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:56:01.508 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:56:01.508 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:56:01.508 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:56:01.640 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:56:01.640 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:01.646 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:56:01.646 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:01.718 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:56:01.719 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:01.735 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:56:01.735 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:01.834 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:56:01.834 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:56:01.840 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:56:01.841 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:56:01.848 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-04-25T22:56:01.855 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-get update 2024-04-25T22:56:01.871 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:56:01.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:56:01.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-04-25T22:56:01.905 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:56:01.905 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:56:01.920 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-04-25T22:56:02.023 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:56:02.023 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:56:02.035 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:56:02.055 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:56:02.060 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:56:02.090 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:56:02.091 INFO:teuthology.orchestra.run.smithi165.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:56:02.116 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:56:02.117 INFO:teuthology.orchestra.run.smithi165.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:56:02.145 INFO:teuthology.orchestra.run.smithi165.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:56:02.146 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:56:02.172 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:56:02.173 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:56:02.181 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:56:02.188 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:56:02.207 INFO:teuthology.orchestra.run.smithi165.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:56:02.210 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:56:02.219 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:56:02.229 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:56:02.230 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:56:02.264 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:56:02.272 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:56:02.273 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:56:02.292 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:56:02.316 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:56:02.317 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:56:02.351 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:56:02.490 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:56:02.491 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 28.9 kB in 0s (84.0 kB/s) 2024-04-25T22:56:02.491 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:56:02.491 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 28.9 kB in 0s (69.0 kB/s) 2024-04-25T22:56:02.592 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:56:02.607 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:56:02.658 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:56:02.728 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:56:02.783 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 28.9 kB in 1s (42.9 kB/s) 2024-04-25T22:56:03.006 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:56:03.087 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:56:03.169 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:56:03.310 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-04-25T22:56:03.327 DEBUG:teuthology.orchestra.run.smithi165:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:03.331 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 28.9 kB in 1s (22.4 kB/s) 2024-04-25T22:56:03.379 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-04-25T22:56:03.443 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-04-25T22:56:03.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:03.522 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-04-25T22:56:03.556 INFO:teuthology.orchestra.run.smithi165.stdout:Building dependency tree... 2024-04-25T22:56:03.556 INFO:teuthology.orchestra.run.smithi165.stdout:Reading state information... 2024-04-25T22:56:03.717 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-04-25T22:56:03.717 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-04-25T22:56:03.732 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:56:03.733 INFO:teuthology.orchestra.run.smithi165.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:56:03.733 INFO:teuthology.orchestra.run.smithi165.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:56:03.733 INFO:teuthology.orchestra.run.smithi165.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:56:03.733 INFO:teuthology.orchestra.run.smithi165.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:56:03.733 INFO:teuthology.orchestra.run.smithi165.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:56:03.733 INFO:teuthology.orchestra.run.smithi165.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:56:03.734 INFO:teuthology.orchestra.run.smithi165.stdout:The following additional packages will be installed: 2024-04-25T22:56:03.734 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:56:03.734 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:56:03.734 INFO:teuthology.orchestra.run.smithi165.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:56:03.734 INFO:teuthology.orchestra.run.smithi165.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:56:03.734 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:03.735 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet zip 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout:Suggested packages: 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:56:03.736 INFO:teuthology.orchestra.run.smithi165.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:56:03.737 INFO:teuthology.orchestra.run.smithi165.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:56:03.737 INFO:teuthology.orchestra.run.smithi165.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:56:03.737 INFO:teuthology.orchestra.run.smithi165.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:56:03.737 INFO:teuthology.orchestra.run.smithi165.stdout:Recommended packages: 2024-04-25T22:56:03.737 INFO:teuthology.orchestra.run.smithi165.stdout: btrfs-tools 2024-04-25T22:56:03.780 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-25T22:56:03.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:03.831 INFO:teuthology.orchestra.run.smithi165.stdout:The following NEW packages will be installed: 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:56:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:56:03.860 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-25T22:56:03.915 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:56:03.916 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:56:03.916 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:56:03.916 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:56:03.916 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:56:03.917 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:56:03.917 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:56:03.918 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-04-25T22:56:03.918 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:56:03.918 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:56:03.918 INFO:teuthology.orchestra.run.smithi099.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:56:03.918 INFO:teuthology.orchestra.run.smithi099.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:56:03.918 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:56:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:56:03.920 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:56:03.920 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:56:03.920 INFO:teuthology.orchestra.run.smithi099.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:56:03.920 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:56:03.920 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:56:03.920 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet zip 2024-04-25T22:56:03.920 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-04-25T22:56:03.921 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2024-04-25T22:56:04.019 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-04-25T22:56:04.019 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:56:04.019 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:56:04.019 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:56:04.020 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:56:04.020 INFO:teuthology.orchestra.run.smithi099.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:56:04.020 INFO:teuthology.orchestra.run.smithi099.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:04.021 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:56:04.022 INFO:teuthology.orchestra.run.smithi099.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:56:04.046 INFO:teuthology.orchestra.run.smithi165.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:56:04.046 INFO:teuthology.orchestra.run.smithi165.stdout:Need to get 179 MB of archives. 2024-04-25T22:56:04.046 INFO:teuthology.orchestra.run.smithi165.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:56:04.046 INFO:teuthology.orchestra.run.smithi165.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:56:04.064 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-25T22:56:04.065 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-25T22:56:04.101 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:56:04.101 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 179 MB of archives. 2024-04-25T22:56:04.101 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:56:04.101 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:56:04.108 INFO:teuthology.orchestra.run.smithi165.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:56:04.203 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:56:04.205 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:56:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:56:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:56:04.268 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:56:04.268 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:56:04.268 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:56:04.268 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:56:04.270 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:56:04.270 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:56:04.270 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:56:04.270 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-04-25T22:56:04.271 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:56:04.271 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:56:04.271 INFO:teuthology.orchestra.run.smithi043.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:56:04.271 INFO:teuthology.orchestra.run.smithi043.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:56:04.272 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:56:04.272 INFO:teuthology.orchestra.run.smithi043.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:56:04.272 INFO:teuthology.orchestra.run.smithi043.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:56:04.272 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:56:04.272 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:56:04.272 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:56:04.273 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet zip 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:56:04.274 INFO:teuthology.orchestra.run.smithi043.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:56:04.275 INFO:teuthology.orchestra.run.smithi043.stdout:Recommended packages: 2024-04-25T22:56:04.275 INFO:teuthology.orchestra.run.smithi043.stdout: btrfs-tools 2024-04-25T22:56:04.296 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-25T22:56:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:56:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:56:04.313 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:56:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:56:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:56:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:56:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:56:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:56:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:56:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:56:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:56:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:56:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:56:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:56:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:56:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:56:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:56:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:56:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:56:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:56:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:56:04.374 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-25T22:56:04.378 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-04-25T22:56:04.378 INFO:teuthology.orchestra.run.smithi043.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:56:04.379 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:56:04.379 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:56:04.379 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:56:04.379 INFO:teuthology.orchestra.run.smithi043.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:56:04.379 INFO:teuthology.orchestra.run.smithi043.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:56:04.380 INFO:teuthology.orchestra.run.smithi043.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:56:04.380 INFO:teuthology.orchestra.run.smithi043.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:56:04.380 INFO:teuthology.orchestra.run.smithi043.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:56:04.380 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:56:04.380 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:56:04.380 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:56:04.381 INFO:teuthology.orchestra.run.smithi043.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:56:04.382 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:56:04.382 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:56:04.382 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:56:04.400 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:56:04.400 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:56:04.401 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:56:04.402 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:56:04.402 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:56:04.403 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:56:04.403 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:56:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:56:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:56:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:56:04.440 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:56:04.440 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:56:04.440 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:56:04.441 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:56:04.442 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:56:04.444 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:56:04.445 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:56:04.447 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:56:04.447 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 179 MB of archives. 2024-04-25T22:56:04.447 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:56:04.447 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:56:04.459 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:56:04.460 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:56:04.462 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:56:04.479 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:56:04.479 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:56:04.482 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:56:04.488 INFO:teuthology.orchestra.run.smithi165.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:56:04.501 INFO:teuthology.orchestra.run.smithi165.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:56:04.541 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:56:04.542 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:56:04.544 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:56:04.544 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:56:04.545 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:56:04.561 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:56:04.571 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:56:04.574 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:56:04.574 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:56:04.577 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-25T22:56:04.578 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-25T22:56:04.587 INFO:teuthology.orchestra.run.smithi165.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:56:04.595 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:56:04.595 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:56:04.596 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:56:04.597 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:56:04.597 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:56:04.598 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:56:04.606 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:56:04.608 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:56:04.608 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:56:04.612 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:56:04.612 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:56:04.628 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:56:04.630 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:56:04.631 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:56:04.634 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:56:04.636 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:56:04.637 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:56:04.638 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:56:04.647 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:56:04.649 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:56:04.650 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:56:04.653 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:56:04.670 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:56:04.671 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:56:04.671 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:56:04.672 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:56:04.672 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:56:04.680 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:56:04.681 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:56:04.690 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:56:04.692 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:56:04.693 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:56:04.737 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:56:04.744 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:56:04.758 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:56:04.763 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:56:04.764 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:56:04.764 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:56:04.764 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:56:04.764 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:56:04.764 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:56:04.765 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:56:04.765 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:56:04.767 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:04.768 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:04.768 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:04.768 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:04.768 INFO:teuthology.orchestra.run.smithi172.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:04.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:04.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:04.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:56:04.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:56:04.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:56:04.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:56:04.770 INFO:teuthology.orchestra.run.smithi172.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:56:04.770 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:56:04.770 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:56:04.770 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet zip 2024-04-25T22:56:04.770 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-04-25T22:56:04.770 INFO:teuthology.orchestra.run.smithi172.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:56:04.770 INFO:teuthology.orchestra.run.smithi172.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:56:04.771 INFO:teuthology.orchestra.run.smithi172.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:56:04.771 INFO:teuthology.orchestra.run.smithi172.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:56:04.771 INFO:teuthology.orchestra.run.smithi172.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:56:04.771 INFO:teuthology.orchestra.run.smithi172.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:56:04.771 INFO:teuthology.orchestra.run.smithi172.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:56:04.771 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-04-25T22:56:04.771 INFO:teuthology.orchestra.run.smithi172.stdout: btrfs-tools 2024-04-25T22:56:04.774 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:56:04.776 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:56:04.779 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:56:04.780 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:56:04.783 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:56:04.785 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:56:04.802 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:56:04.804 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:56:04.804 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:56:04.805 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:56:04.806 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:56:04.806 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:56:04.807 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:56:04.807 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:56:04.823 INFO:teuthology.orchestra.run.smithi165.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:56:04.825 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:56:04.828 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:56:04.833 INFO:teuthology.orchestra.run.smithi165.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:56:04.846 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:56:04.851 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:56:04.852 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:56:04.853 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:56:04.854 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:56:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:56:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:56:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:56:04.864 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:56:04.866 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:56:04.868 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:56:04.869 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-04-25T22:56:04.869 INFO:teuthology.orchestra.run.smithi172.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:56:04.869 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:56:04.869 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:56:04.869 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:56:04.870 INFO:teuthology.orchestra.run.smithi172.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:56:04.870 INFO:teuthology.orchestra.run.smithi172.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:56:04.871 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:56:04.872 INFO:teuthology.orchestra.run.smithi172.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:56:04.873 INFO:teuthology.orchestra.run.smithi165.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:56:04.874 INFO:teuthology.orchestra.run.smithi165.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:56:04.878 INFO:teuthology.orchestra.run.smithi165.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:56:04.887 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:56:04.894 INFO:teuthology.orchestra.run.smithi165.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:56:04.897 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:56:04.898 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:56:04.899 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:56:04.900 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:56:04.903 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:56:04.906 INFO:teuthology.orchestra.run.smithi043.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:56:04.908 INFO:teuthology.orchestra.run.smithi043.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:56:04.911 INFO:teuthology.orchestra.run.smithi043.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:56:04.912 INFO:teuthology.orchestra.run.smithi043.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:56:04.928 INFO:teuthology.orchestra.run.smithi043.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:56:04.929 INFO:teuthology.orchestra.run.smithi043.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:56:04.930 INFO:teuthology.orchestra.run.smithi043.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:56:04.935 INFO:teuthology.orchestra.run.smithi043.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:56:04.952 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:56:04.952 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 179 MB of archives. 2024-04-25T22:56:04.952 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:56:04.952 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:56:05.008 INFO:teuthology.orchestra.run.smithi043.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:56:05.009 INFO:teuthology.orchestra.run.smithi043.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:56:05.010 INFO:teuthology.orchestra.run.smithi043.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:56:05.010 INFO:teuthology.orchestra.run.smithi043.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:56:05.012 INFO:teuthology.orchestra.run.smithi043.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:56:05.030 INFO:teuthology.orchestra.run.smithi043.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:56:05.032 INFO:teuthology.orchestra.run.smithi043.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:56:05.033 INFO:teuthology.orchestra.run.smithi043.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:56:05.048 INFO:teuthology.orchestra.run.smithi043.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:56:05.049 INFO:teuthology.orchestra.run.smithi043.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:56:05.057 INFO:teuthology.orchestra.run.smithi043.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:56:05.058 INFO:teuthology.orchestra.run.smithi043.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:56:05.058 INFO:teuthology.orchestra.run.smithi043.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:56:05.058 INFO:teuthology.orchestra.run.smithi043.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:56:05.059 INFO:teuthology.orchestra.run.smithi043.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:56:05.059 INFO:teuthology.orchestra.run.smithi043.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:56:05.062 INFO:teuthology.orchestra.run.smithi165.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:56:05.063 INFO:teuthology.orchestra.run.smithi043.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:56:05.078 INFO:teuthology.orchestra.run.smithi043.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:56:05.079 INFO:teuthology.orchestra.run.smithi043.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:56:05.080 INFO:teuthology.orchestra.run.smithi043.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:56:05.086 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:56:05.089 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:56:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:56:05.102 INFO:teuthology.orchestra.run.smithi043.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:56:05.102 INFO:teuthology.orchestra.run.smithi043.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:56:05.103 INFO:teuthology.orchestra.run.smithi043.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:56:05.109 INFO:teuthology.orchestra.run.smithi043.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:56:05.109 INFO:teuthology.orchestra.run.smithi043.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:56:05.112 INFO:teuthology.orchestra.run.smithi043.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:56:05.114 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:56:05.115 INFO:teuthology.orchestra.run.smithi043.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:56:05.118 INFO:teuthology.orchestra.run.smithi043.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:56:05.119 INFO:teuthology.orchestra.run.smithi043.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:56:05.120 INFO:teuthology.orchestra.run.smithi043.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:56:05.140 INFO:teuthology.orchestra.run.smithi043.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:56:05.141 INFO:teuthology.orchestra.run.smithi043.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:56:05.150 INFO:teuthology.orchestra.run.smithi043.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:56:05.150 INFO:teuthology.orchestra.run.smithi043.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:56:05.150 INFO:teuthology.orchestra.run.smithi043.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:56:05.152 INFO:teuthology.orchestra.run.smithi043.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:56:05.153 INFO:teuthology.orchestra.run.smithi043.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:56:05.205 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:56:05.210 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:56:05.216 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:56:05.224 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:56:05.229 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:56:05.230 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:56:05.230 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:56:05.240 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:56:05.243 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:56:05.245 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:56:05.246 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:56:05.254 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:56:05.256 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:56:05.258 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:56:05.274 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:56:05.275 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:56:05.275 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:56:05.276 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:56:05.277 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:56:05.277 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:56:05.278 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:56:05.294 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:56:05.295 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:56:05.295 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:56:05.315 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:56:05.316 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:56:05.316 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:56:05.317 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:56:05.317 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:56:05.318 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:56:05.318 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:56:05.336 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:56:05.337 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:56:05.337 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:56:05.347 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:56:05.356 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:56:05.356 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:56:05.357 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:56:05.357 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:56:05.359 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:56:05.361 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:56:05.361 INFO:teuthology.orchestra.run.smithi172.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:56:05.376 INFO:teuthology.orchestra.run.smithi172.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:56:05.377 INFO:teuthology.orchestra.run.smithi172.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:56:05.379 INFO:teuthology.orchestra.run.smithi172.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:56:05.397 INFO:teuthology.orchestra.run.smithi172.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:56:05.397 INFO:teuthology.orchestra.run.smithi172.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:56:05.400 INFO:teuthology.orchestra.run.smithi172.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:56:05.458 INFO:teuthology.orchestra.run.smithi172.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:56:05.459 INFO:teuthology.orchestra.run.smithi172.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:56:05.461 INFO:teuthology.orchestra.run.smithi172.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:56:05.461 INFO:teuthology.orchestra.run.smithi172.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:56:05.462 INFO:teuthology.orchestra.run.smithi172.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:56:05.465 INFO:teuthology.orchestra.run.smithi165.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:56:05.487 INFO:teuthology.orchestra.run.smithi172.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:56:05.489 INFO:teuthology.orchestra.run.smithi172.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:56:05.489 INFO:teuthology.orchestra.run.smithi172.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:56:05.495 INFO:teuthology.orchestra.run.smithi043.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:56:05.513 INFO:teuthology.orchestra.run.smithi172.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:56:05.513 INFO:teuthology.orchestra.run.smithi172.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:56:05.514 INFO:teuthology.orchestra.run.smithi172.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:56:05.514 INFO:teuthology.orchestra.run.smithi172.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:56:05.515 INFO:teuthology.orchestra.run.smithi165.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:56:05.515 INFO:teuthology.orchestra.run.smithi172.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:56:05.516 INFO:teuthology.orchestra.run.smithi165.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:56:05.524 INFO:teuthology.orchestra.run.smithi172.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:56:05.525 INFO:teuthology.orchestra.run.smithi172.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:56:05.525 INFO:teuthology.orchestra.run.smithi172.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:56:05.530 INFO:teuthology.orchestra.run.smithi172.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:56:05.545 INFO:teuthology.orchestra.run.smithi172.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:56:05.546 INFO:teuthology.orchestra.run.smithi172.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:56:05.547 INFO:teuthology.orchestra.run.smithi172.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:56:05.551 INFO:teuthology.orchestra.run.smithi172.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:56:05.553 INFO:teuthology.orchestra.run.smithi172.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:56:05.554 INFO:teuthology.orchestra.run.smithi172.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:56:05.566 INFO:teuthology.orchestra.run.smithi172.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:56:05.571 INFO:teuthology.orchestra.run.smithi172.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:56:05.571 INFO:teuthology.orchestra.run.smithi172.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:56:05.572 INFO:teuthology.orchestra.run.smithi043.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:56:05.574 INFO:teuthology.orchestra.run.smithi172.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:56:05.586 INFO:teuthology.orchestra.run.smithi172.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:56:05.587 INFO:teuthology.orchestra.run.smithi172.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:56:05.587 INFO:teuthology.orchestra.run.smithi172.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:56:05.588 INFO:teuthology.orchestra.run.smithi172.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:56:05.589 INFO:teuthology.orchestra.run.smithi172.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:56:05.597 INFO:teuthology.orchestra.run.smithi172.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:56:05.606 INFO:teuthology.orchestra.run.smithi172.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:56:05.607 INFO:teuthology.orchestra.run.smithi172.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:56:05.609 INFO:teuthology.orchestra.run.smithi172.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:56:05.609 INFO:teuthology.orchestra.run.smithi172.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:56:05.622 INFO:teuthology.orchestra.run.smithi043.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:56:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:56:05.645 INFO:teuthology.orchestra.run.smithi043.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:56:05.659 INFO:teuthology.orchestra.run.smithi043.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:56:05.686 INFO:teuthology.orchestra.run.smithi043.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:56:05.754 INFO:teuthology.orchestra.run.smithi165.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:56:05.884 INFO:teuthology.orchestra.run.smithi165.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:56:05.901 INFO:teuthology.orchestra.run.smithi165.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:56:06.097 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:56:06.125 INFO:teuthology.orchestra.run.smithi165.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:56:06.147 INFO:teuthology.orchestra.run.smithi165.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:56:06.153 INFO:teuthology.orchestra.run.smithi165.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:56:06.201 INFO:teuthology.orchestra.run.smithi165.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:56:06.206 INFO:teuthology.orchestra.run.smithi165.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:56:06.256 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:56:06.357 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:56:06.360 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:56:06.378 INFO:teuthology.orchestra.run.smithi165.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:56:06.410 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:56:06.415 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:56:06.439 INFO:teuthology.orchestra.run.smithi043.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:56:06.445 INFO:teuthology.orchestra.run.smithi043.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:56:06.461 INFO:teuthology.orchestra.run.smithi165.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:56:06.488 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:56:06.490 INFO:teuthology.orchestra.run.smithi165.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:56:06.497 INFO:teuthology.orchestra.run.smithi043.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:56:06.508 INFO:teuthology.orchestra.run.smithi165.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:56:06.551 INFO:teuthology.orchestra.run.smithi165.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:56:06.555 INFO:teuthology.orchestra.run.smithi165.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:56:06.646 INFO:teuthology.orchestra.run.smithi165.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:56:06.717 INFO:teuthology.orchestra.run.smithi165.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:56:06.718 INFO:teuthology.orchestra.run.smithi165.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:56:06.778 INFO:teuthology.orchestra.run.smithi165.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:56:06.781 INFO:teuthology.orchestra.run.smithi165.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:56:06.784 INFO:teuthology.orchestra.run.smithi165.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:56:06.801 INFO:teuthology.orchestra.run.smithi165.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:56:06.801 INFO:teuthology.orchestra.run.smithi165.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:56:06.814 INFO:teuthology.orchestra.run.smithi165.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:56:06.820 INFO:teuthology.orchestra.run.smithi165.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:56:06.852 INFO:teuthology.orchestra.run.smithi165.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:56:06.859 INFO:teuthology.orchestra.run.smithi165.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:56:07.026 INFO:teuthology.orchestra.run.smithi165.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:56:07.059 INFO:teuthology.orchestra.run.smithi172.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:56:07.373 INFO:teuthology.orchestra.run.smithi165.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:56:07.410 INFO:teuthology.orchestra.run.smithi165.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:56:07.423 INFO:teuthology.orchestra.run.smithi165.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:56:07.833 INFO:teuthology.orchestra.run.smithi165.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:56:07.836 INFO:teuthology.orchestra.run.smithi165.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:56:07.846 INFO:teuthology.orchestra.run.smithi165.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:56:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:56:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:56:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:56:08.090 INFO:teuthology.orchestra.run.smithi172.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:56:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:56:08.103 INFO:teuthology.orchestra.run.smithi172.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:56:08.176 INFO:teuthology.orchestra.run.smithi172.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:56:08.176 INFO:teuthology.orchestra.run.smithi165.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:56:08.190 INFO:teuthology.orchestra.run.smithi165.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:56:08.243 INFO:teuthology.orchestra.run.smithi165.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:56:08.285 INFO:teuthology.orchestra.run.smithi165.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:56:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:56:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:56:08.435 INFO:teuthology.orchestra.run.smithi099.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:56:08.477 INFO:teuthology.orchestra.run.smithi165.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:56:08.825 INFO:teuthology.orchestra.run.smithi165.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:56:08.907 INFO:teuthology.orchestra.run.smithi165.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:56:09.182 INFO:teuthology.orchestra.run.smithi172.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:56:09.210 INFO:teuthology.orchestra.run.smithi172.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:56:09.219 INFO:teuthology.orchestra.run.smithi172.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:56:09.223 INFO:teuthology.orchestra.run.smithi165.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:56:09.478 INFO:teuthology.orchestra.run.smithi165.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:56:09.656 INFO:teuthology.orchestra.run.smithi165.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:56:09.670 INFO:teuthology.orchestra.run.smithi165.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:56:09.691 INFO:teuthology.orchestra.run.smithi165.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:56:09.755 INFO:teuthology.orchestra.run.smithi165.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:56:10.057 INFO:teuthology.orchestra.run.smithi165.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:56:10.060 INFO:teuthology.orchestra.run.smithi165.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:56:10.063 INFO:teuthology.orchestra.run.smithi165.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:56:10.064 INFO:teuthology.orchestra.run.smithi165.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:56:10.066 INFO:teuthology.orchestra.run.smithi165.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:56:10.291 INFO:teuthology.orchestra.run.smithi165.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:56:10.630 INFO:teuthology.orchestra.run.smithi043.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:56:10.722 INFO:teuthology.orchestra.run.smithi165.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:56:10.728 INFO:teuthology.orchestra.run.smithi165.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:56:11.017 INFO:teuthology.orchestra.run.smithi165.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:56:11.018 INFO:teuthology.orchestra.run.smithi165.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:56:11.020 INFO:teuthology.orchestra.run.smithi165.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:56:11.021 INFO:teuthology.orchestra.run.smithi165.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:56:11.023 INFO:teuthology.orchestra.run.smithi165.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:56:11.025 INFO:teuthology.orchestra.run.smithi165.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:56:11.026 INFO:teuthology.orchestra.run.smithi165.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:56:11.028 INFO:teuthology.orchestra.run.smithi165.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:56:11.158 INFO:teuthology.orchestra.run.smithi165.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:56:11.256 INFO:teuthology.orchestra.run.smithi165.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:56:11.567 INFO:teuthology.orchestra.run.smithi165.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:56:11.598 INFO:teuthology.orchestra.run.smithi165.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:56:11.604 INFO:teuthology.orchestra.run.smithi165.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:56:11.666 INFO:teuthology.orchestra.run.smithi165.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:56:11.715 INFO:teuthology.orchestra.run.smithi165.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:56:11.737 INFO:teuthology.orchestra.run.smithi165.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:56:11.745 INFO:teuthology.orchestra.run.smithi043.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:56:11.768 INFO:teuthology.orchestra.run.smithi165.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:56:11.800 INFO:teuthology.orchestra.run.smithi043.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:56:11.838 INFO:teuthology.orchestra.run.smithi043.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:56:11.847 INFO:teuthology.orchestra.run.smithi165.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:56:11.889 INFO:teuthology.orchestra.run.smithi165.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:56:11.903 INFO:teuthology.orchestra.run.smithi165.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:56:11.908 INFO:teuthology.orchestra.run.smithi165.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:56:11.955 INFO:teuthology.orchestra.run.smithi165.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:56:11.958 INFO:teuthology.orchestra.run.smithi165.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:56:11.980 INFO:teuthology.orchestra.run.smithi165.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:56:12.144 INFO:teuthology.orchestra.run.smithi165.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:56:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:56:12.409 INFO:teuthology.orchestra.run.smithi165.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:56:12.418 INFO:teuthology.orchestra.run.smithi165.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:56:12.436 INFO:teuthology.orchestra.run.smithi165.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:56:12.590 INFO:teuthology.orchestra.run.smithi165.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:56:12.619 INFO:teuthology.orchestra.run.smithi165.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:56:12.777 INFO:teuthology.orchestra.run.smithi165.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:56:12.779 INFO:teuthology.orchestra.run.smithi165.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:56:12.782 INFO:teuthology.orchestra.run.smithi165.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:56:12.804 INFO:teuthology.orchestra.run.smithi165.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:56:12.808 INFO:teuthology.orchestra.run.smithi165.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:56:13.040 INFO:teuthology.orchestra.run.smithi172.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:56:13.551 INFO:teuthology.orchestra.run.smithi172.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:56:13.593 INFO:teuthology.orchestra.run.smithi172.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:56:13.600 INFO:teuthology.orchestra.run.smithi172.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:56:13.645 INFO:teuthology.orchestra.run.smithi043.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:56:13.818 INFO:teuthology.orchestra.run.smithi172.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:56:14.740 INFO:teuthology.orchestra.run.smithi172.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:56:14.912 INFO:teuthology.orchestra.run.smithi165.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:56:14.912 INFO:teuthology.orchestra.run.smithi165.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:56:14.930 INFO:teuthology.orchestra.run.smithi165.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:56:15.017 INFO:teuthology.orchestra.run.smithi099.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:56:15.174 INFO:teuthology.orchestra.run.smithi165.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:56:15.261 INFO:teuthology.orchestra.run.smithi165.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:56:15.276 INFO:teuthology.orchestra.run.smithi165.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:56:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:56:16.026 INFO:teuthology.orchestra.run.smithi099.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:56:16.090 INFO:teuthology.orchestra.run.smithi099.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:56:16.103 INFO:teuthology.orchestra.run.smithi099.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:56:16.420 INFO:teuthology.orchestra.run.smithi099.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:56:16.468 INFO:teuthology.orchestra.run.smithi165.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:56:16.528 INFO:teuthology.orchestra.run.smithi165.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:56:17.544 INFO:teuthology.orchestra.run.smithi099.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:56:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:56:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:56:18.167 INFO:teuthology.orchestra.run.smithi172.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:56:18.578 INFO:teuthology.orchestra.run.smithi172.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:56:18.697 INFO:teuthology.orchestra.run.smithi172.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:56:18.738 INFO:teuthology.orchestra.run.smithi172.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:56:19.142 INFO:teuthology.orchestra.run.smithi172.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:56:19.381 INFO:teuthology.orchestra.run.smithi043.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:56:19.382 INFO:teuthology.orchestra.run.smithi043.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:56:19.500 INFO:teuthology.orchestra.run.smithi043.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:56:20.010 INFO:teuthology.orchestra.run.smithi043.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:56:20.201 INFO:teuthology.orchestra.run.smithi043.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:56:20.215 INFO:teuthology.orchestra.run.smithi043.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:56:20.749 INFO:teuthology.orchestra.run.smithi043.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:56:20.749 INFO:teuthology.orchestra.run.smithi172.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:56:20.750 INFO:teuthology.orchestra.run.smithi172.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:56:21.513 INFO:teuthology.orchestra.run.smithi099.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:56:21.514 INFO:teuthology.orchestra.run.smithi099.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:56:21.540 INFO:teuthology.orchestra.run.smithi099.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:56:22.040 INFO:teuthology.orchestra.run.smithi099.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:56:22.182 INFO:teuthology.orchestra.run.smithi099.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:56:22.191 INFO:teuthology.orchestra.run.smithi099.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:56:22.570 INFO:teuthology.orchestra.run.smithi043.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:56:22.571 INFO:teuthology.orchestra.run.smithi043.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:56:22.637 INFO:teuthology.orchestra.run.smithi099.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:56:24.291 INFO:teuthology.orchestra.run.smithi099.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:56:24.292 INFO:teuthology.orchestra.run.smithi099.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:56:25.690 INFO:teuthology.orchestra.run.smithi165.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:56:25.692 INFO:teuthology.orchestra.run.smithi165.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:56:25.693 INFO:teuthology.orchestra.run.smithi165.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:56:28.593 INFO:teuthology.orchestra.run.smithi165.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:56:29.150 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 179 MB in 25s (7,251 kB/s) 2024-04-25T22:56:29.307 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:56:29.401 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:56:29.407 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:56:29.489 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:56:29.826 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:56:29.852 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:56:29.892 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:56:30.129 INFO:teuthology.orchestra.run.smithi172.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:56:30.132 INFO:teuthology.orchestra.run.smithi172.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:56:30.133 INFO:teuthology.orchestra.run.smithi172.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:56:30.178 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:56:30.204 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:56:30.236 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:56:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:56:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:31.143 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:56:31.169 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:31.209 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:31.554 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:56:31.580 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:31.621 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:31.835 INFO:teuthology.orchestra.run.smithi172.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:56:31.998 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:56:32.024 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:56:32.056 INFO:teuthology.orchestra.run.smithi099.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:56:32.058 INFO:teuthology.orchestra.run.smithi099.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:56:32.073 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:56:32.117 INFO:teuthology.orchestra.run.smithi099.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:56:32.342 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librados2. 2024-04-25T22:56:32.356 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 179 MB in 27s (6,658 kB/s) 2024-04-25T22:56:32.358 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:32.392 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:32.488 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:56:32.544 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:56:32.549 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:56:32.662 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:56:32.828 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:56:32.837 INFO:teuthology.orchestra.run.smithi043.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:56:32.840 INFO:teuthology.orchestra.run.smithi043.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:56:32.841 INFO:teuthology.orchestra.run.smithi043.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:56:32.854 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:32.873 INFO:teuthology.orchestra.run.smithi099.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:56:32.895 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:32.999 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:56:33.025 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:56:33.066 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:56:33.306 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:56:33.332 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:33.380 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:33.433 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 179 MB in 29s (6,222 kB/s) 2024-04-25T22:56:33.453 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:56:33.478 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:56:33.519 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:56:33.581 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:56:33.612 INFO:teuthology.orchestra.run.smithi043.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:56:33.667 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:56:33.681 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:56:33.682 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:33.687 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:56:33.725 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:33.782 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:56:33.897 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:56:33.924 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:33.971 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:34.133 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:56:34.159 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:56:34.195 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:56:34.199 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:56:34.206 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 179 MB in 29s (6,142 kB/s) 2024-04-25T22:56:34.221 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:34.277 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:34.320 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:56:34.350 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:56:34.376 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:34.378 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:56:34.383 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:56:34.417 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:34.453 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:56:34.496 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:56:34.512 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:34.546 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:34.552 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:56:34.579 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:56:34.619 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:56:34.745 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:56:34.771 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:34.790 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:56:34.803 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:34.817 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:56:34.849 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:56:34.875 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:34.890 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:56:34.916 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:34.981 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:56:35.008 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:35.056 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:35.140 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:56:35.166 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:56:35.206 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:56:35.235 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:56:35.236 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:56:35.261 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:56:35.262 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:56:35.302 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:56:35.302 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:56:35.526 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:56:35.551 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librados2. 2024-04-25T22:56:35.553 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:35.578 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:35.593 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:35.618 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:35.654 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:56:35.680 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:56:35.721 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:56:35.730 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:56:35.757 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:35.813 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:35.938 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:56:35.965 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:35.973 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:56:35.996 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:35.999 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:36.040 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:36.062 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:56:36.088 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:36.128 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:36.183 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:56:36.210 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:36.242 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:36.341 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:56:36.359 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:56:36.367 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:56:36.386 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:56:36.408 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:56:36.426 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:56:36.515 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:56:36.541 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:36.570 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:56:36.573 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:36.596 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:56:36.636 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:56:36.662 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:56:36.677 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:56:36.720 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:56:36.744 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librados2. 2024-04-25T22:56:36.771 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:36.811 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:36.998 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:56:37.014 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:56:37.025 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:56:37.041 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:56:37.062 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:56:37.064 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:56:37.080 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:56:37.086 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:37.126 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:38.068 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librados2. 2024-04-25T22:56:38.095 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:38.126 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:38.142 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:56:38.169 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:56:38.170 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:56:38.197 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:38.209 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:56:38.237 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:38.239 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:56:38.266 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:38.297 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:38.448 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:56:38.463 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:38.496 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:56:38.498 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:38.510 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:56:38.545 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:56:38.554 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:56:38.581 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:38.620 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:38.725 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:56:38.752 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:38.772 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package zip. 2024-04-25T22:56:38.792 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:38.799 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:56:38.817 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:56:38.838 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:56:38.844 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:38.884 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:39.078 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:56:39.093 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:39.136 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:39.167 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package unzip. 2024-04-25T22:56:39.193 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:56:39.204 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:56:39.230 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:56:39.233 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:56:39.248 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:56:39.270 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:56:39.275 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:39.315 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:39.464 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:56:39.491 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:39.531 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:39.581 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:56:39.592 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:56:39.608 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:56:39.609 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:39.628 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:56:39.648 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:56:39.651 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:39.655 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:56:39.695 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:56:39.733 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:56:39.749 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:39.800 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:39.867 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:56:39.883 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:39.917 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:39.928 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:56:39.955 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:39.987 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:40.044 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:56:40.071 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:40.102 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:40.120 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:56:40.147 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:40.186 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:40.214 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:56:40.230 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:40.273 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:40.278 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:56:40.304 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:56:40.345 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:56:40.531 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:56:40.558 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:56:40.584 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:56:40.598 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:56:40.610 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:40.614 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:56:40.630 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:56:40.646 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:56:40.650 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:40.662 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:40.672 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:56:40.704 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:40.892 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:56:40.919 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:56:40.950 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:56:40.967 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:56:40.970 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:56:40.983 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:56:40.997 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:56:41.017 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:56:41.037 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:56:41.040 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:56:41.067 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:56:41.107 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:56:41.204 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:56:41.230 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:41.270 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:41.312 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:56:41.331 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:56:41.339 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:56:41.358 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:56:41.379 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:56:41.389 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:56:41.418 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:56:41.444 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:41.484 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:41.615 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:56:41.634 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:56:41.641 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:56:41.661 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:41.681 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:56:41.690 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:56:41.700 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:41.717 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:56:41.757 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:56:41.813 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:56:41.839 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:41.871 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:41.967 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:56:41.993 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:56:42.001 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package zip. 2024-04-25T22:56:42.028 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:56:42.034 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:56:42.045 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:56:42.072 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:56:42.111 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:56:42.205 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:56:42.312 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:56:42.327 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:56:42.362 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:56:42.381 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:56:42.408 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:56:42.447 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:56:42.521 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package unzip. 2024-04-25T22:56:42.548 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:56:42.579 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:56:42.700 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:56:42.707 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:56:42.717 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:56:42.734 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:56:42.750 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:56:42.773 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:56:42.975 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:56:43.001 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:56:43.041 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:56:43.045 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:56:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:56:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:56:43.233 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:56:43.260 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:56:43.302 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:56:43.351 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:56:43.377 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:43.424 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:56:43.426 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:43.431 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:56:43.448 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:56:43.451 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:43.490 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:56:43.499 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:43.504 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package zip. 2024-04-25T22:56:43.520 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:56:43.555 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:56:43.743 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package zip. 2024-04-25T22:56:43.767 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:56:43.794 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:56:43.909 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package unzip. 2024-04-25T22:56:43.935 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:56:43.975 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:56:44.005 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:56:44.032 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:56:44.046 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package unzip. 2024-04-25T22:56:44.071 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:56:44.073 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:56:44.077 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:56:44.103 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:44.104 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:56:44.143 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:44.379 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:56:44.406 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:56:44.445 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:56:44.454 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:56:44.480 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:56:44.491 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:56:44.519 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:56:44.520 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:56:44.557 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:56:44.557 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:56:44.584 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:56:44.623 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:56:44.787 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:56:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:44.832 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:56:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:44.859 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:44.898 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:44.926 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:56:44.949 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:56:44.953 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:56:44.976 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:44.984 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:56:45.015 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:45.263 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:56:45.279 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:56:45.288 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:56:45.306 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:45.329 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:56:45.337 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:45.397 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:56:45.412 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:45.456 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:45.543 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:56:45.559 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:45.593 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:45.631 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:56:45.658 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:56:45.698 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:56:45.801 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:56:45.827 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:56:45.867 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:56:45.896 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:56:45.924 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:56:45.963 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:56:46.009 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:56:46.035 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:56:46.076 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:56:46.179 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:56:46.205 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:46.237 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:46.282 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:56:46.309 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:46.336 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:56:46.348 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:46.363 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:56:46.403 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:56:46.601 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:56:46.627 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:46.657 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:56:46.676 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:46.680 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:56:46.686 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:46.707 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:56:46.718 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:56:46.723 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:46.745 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:46.747 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:56:46.785 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:47.058 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:56:47.085 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:56:47.125 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:56:47.263 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:56:47.290 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:56:47.331 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:56:47.428 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:56:47.455 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:56:47.486 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:56:47.649 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:56:47.676 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:56:47.716 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:56:47.789 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:56:47.816 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:56:47.856 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:56:47.985 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:56:48.012 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:56:48.044 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:56:48.149 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:56:48.158 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:56:48.176 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:48.185 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:56:48.196 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:56:48.222 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:48.224 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:48.225 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:56:48.280 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:48.305 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:56:48.332 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:56:48.371 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:56:48.527 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:56:48.554 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:56:48.594 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:56:48.683 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:56:48.709 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:56:48.749 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:56:48.786 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:56:48.814 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:56:48.853 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:56:48.914 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:56:48.929 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:56:48.963 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:56:49.052 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:56:49.067 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:56:49.079 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:56:49.093 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:56:49.119 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:56:49.133 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:56:49.156 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:56:49.183 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:56:49.222 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:56:49.224 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:56:49.251 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:56:49.291 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:56:49.371 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:56:49.395 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:56:49.430 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:56:49.453 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:56:49.480 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:56:49.520 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:56:49.586 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:56:49.612 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:56:49.652 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:56:49.676 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:56:49.703 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:56:49.733 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:56:49.742 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:56:49.760 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:56:49.799 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:56:49.840 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:56:49.866 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:56:49.915 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:56:50.038 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:56:50.045 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:56:50.061 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:56:50.065 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:56:50.103 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:56:50.107 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:56:50.111 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:56:50.138 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:56:50.177 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:56:50.284 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:56:50.311 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:56:50.359 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:56:50.414 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:56:50.416 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:56:50.442 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:56:50.442 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:56:50.481 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:56:50.482 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:56:50.514 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:56:50.541 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:56:50.581 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:56:50.679 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:56:50.706 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:56:50.726 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:56:50.742 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:56:50.743 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:56:50.746 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:56:50.759 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:56:50.776 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:56:50.793 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:56:50.892 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:56:50.918 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:56:50.959 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:56:51.032 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:56:51.058 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:56:51.061 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:56:51.089 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:56:51.098 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:56:51.121 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:56:51.128 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:56:51.136 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:56:51.179 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:56:51.245 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:56:51.272 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:56:51.303 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:56:51.440 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:56:51.456 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:56:51.466 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:56:51.468 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:56:51.473 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:56:51.495 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:56:51.498 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:56:51.514 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:56:51.543 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:56:51.581 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:56:51.607 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:56:51.648 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:56:51.768 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:56:51.794 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:56:51.801 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:56:51.828 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:56:51.834 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:56:51.867 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:56:51.872 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:56:51.898 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:56:51.938 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:56:51.942 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:56:51.969 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:56:52.001 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:56:52.146 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:56:52.172 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:56:52.212 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:56:52.212 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:56:52.240 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:56:52.266 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:56:52.293 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:56:52.296 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:56:52.312 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:56:52.332 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:56:52.339 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:56:52.379 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:56:52.583 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:56:52.599 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:56:52.610 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:56:52.626 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:56:52.650 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:56:52.666 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:56:52.679 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:56:52.705 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:56:52.745 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:56:52.865 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:56:52.892 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:56:52.932 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:56:52.935 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:56:52.951 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:56:52.978 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:56:52.985 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:56:53.004 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:56:53.044 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:56:53.056 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:56:53.083 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:56:53.123 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:56:53.226 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:56:53.242 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:56:53.272 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:56:53.296 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:56:53.299 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:56:53.338 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:56:53.364 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:56:53.391 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:56:53.426 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:56:53.430 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:56:53.453 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:56:53.492 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:56:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:56:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:56:53.666 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:56:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:56:53.694 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:56:53.733 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:56:53.783 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:56:53.789 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:56:53.810 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:56:53.816 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:56:53.858 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:56:53.864 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:56:53.957 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:56:53.973 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:56:53.994 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:56:54.011 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:56:54.015 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:56:54.052 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:56:54.169 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:56:54.196 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:56:54.201 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:56:54.227 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:56:54.235 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:56:54.267 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:56:54.319 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:56:54.321 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:56:54.346 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:56:54.348 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:56:54.385 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:56:54.388 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:56:54.530 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:56:54.557 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:54.570 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:56:54.596 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:54.597 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:56:54.645 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:56:54.705 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:56:54.731 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:56:54.733 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:56:54.760 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:56:54.771 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:56:54.802 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:56:54.915 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:56:54.941 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:56:54.973 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:56:55.049 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:56:55.065 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:56:55.099 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:56:55.111 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:56:55.138 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:56:55.159 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:56:55.177 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:56:55.186 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:55.226 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:55.285 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:56:55.311 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:56:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:56:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:56:55.379 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:56:55.410 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:56:55.480 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:56:55.503 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:56:55.507 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:56:55.519 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:56:55.547 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:56:55.553 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:56:55.663 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:56:55.689 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:56:55.730 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:56:55.773 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:56:55.801 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:56:55.814 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:56:55.840 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:56:55.841 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:56:55.881 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:56:55.900 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:56:55.916 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:56:55.958 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:56:56.016 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:56:56.042 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:56:56.082 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:56:56.143 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:56:56.170 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:56:56.209 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:56:56.242 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:56:56.244 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:56:56.269 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:56.271 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:56:56.309 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:56.311 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:56:56.410 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:56:56.426 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:56:56.469 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:56:56.496 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:56:56.522 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:56:56.562 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:56:56.608 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:56:56.635 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:56:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:56:56.720 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:56:56.747 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:56.755 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:56:56.782 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:56:56.786 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:56.822 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:56:56.865 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:56:56.881 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:56:56.915 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:56:56.975 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:56:57.002 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:56:57.042 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:56:57.083 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:56:57.110 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:56:57.150 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:56:57.186 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:56:57.212 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:56:57.252 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:56:57.332 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:56:57.358 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:57.389 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:57.403 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:56:57.406 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:56:57.429 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:56:57.432 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:56:57.461 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:56:57.471 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:56:57.538 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:56:57.565 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:57.604 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:57.766 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:56:57.774 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:56:57.793 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:56:57.801 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:56:57.832 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:56:57.841 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:56:57.934 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:56:57.961 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:57.992 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:58.094 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:56:58.121 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:56:58.152 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:56:58.177 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:56:58.204 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:56:58.312 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:56:58.327 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:56:58.339 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:56:58.379 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:56:58.551 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph. 2024-04-25T22:56:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:58.578 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:56:58.605 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:56:58.617 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:58.647 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:56:58.647 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:56:58.714 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:56:58.748 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:56:58.777 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:56:58.815 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:56:58.935 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:56:58.936 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:56:58.962 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:56:58.963 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:59.001 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:56:59.003 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:59.118 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:56:59.140 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:59.176 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:59.225 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:56:59.252 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:56:59.292 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:56:59.305 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:56:59.332 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:56:59.356 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:56:59.371 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:59.383 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:59.422 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:59.513 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:56:59.539 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:59.571 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:59.578 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:56:59.605 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:56:59.644 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:56:59.718 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:56:59.734 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:59.768 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:59.809 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:56:59.836 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:56:59.875 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:56:59.948 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:56:59.975 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:00.015 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:00.203 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:57:00.230 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:57:00.237 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:57:00.241 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:57:00.265 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:57:00.268 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:00.269 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:00.307 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:00.320 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:57:00.411 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:57:00.427 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:00.470 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:00.605 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:57:00.623 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:57:00.632 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:00.651 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:57:00.672 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:00.690 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:57:00.781 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:57:00.808 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:57:00.848 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:57:01.001 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:57:01.029 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:01.059 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:01.151 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:57:01.177 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:57:01.217 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:57:01.352 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph. 2024-04-25T22:57:01.368 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:01.411 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:01.438 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:57:01.465 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:01.504 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:01.537 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:57:01.564 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:01.603 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:01.726 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:57:01.738 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:57:01.753 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:01.765 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:01.793 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:01.821 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:02.007 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:57:02.034 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:02.073 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:02.091 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:57:02.118 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:02.121 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:57:02.147 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:57:02.157 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:02.187 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:02.191 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:57:02.218 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:02.258 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:02.548 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:57:02.575 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:02.611 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:57:02.611 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:57:02.614 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:02.627 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:02.637 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:02.661 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:02.677 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:02.968 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:57:02.995 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:57:03.034 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:03.113 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:57:03.141 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:57:03.180 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:03.194 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph. 2024-04-25T22:57:03.207 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:03.236 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:03.312 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:57:03.338 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:57:03.378 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:03.457 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:57:03.473 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:03.507 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:03.538 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:57:03.566 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:03.605 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:03.739 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2024-04-25T22:57:03.739 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:57:03.754 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:03.766 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:03.797 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:03.806 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:03.958 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:57:03.985 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:04.024 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:04.083 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:57:04.110 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:04.141 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:04.369 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:57:04.397 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:04.429 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:57:04.436 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:04.457 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:04.488 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:04.536 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:57:04.563 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:04.603 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:04.747 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:57:04.774 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:57:04.782 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:57:04.809 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:57:04.813 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:04.848 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:05.006 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:57:05.033 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:05.036 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:57:05.052 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:57:05.072 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:05.094 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:05.099 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:57:05.126 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:05.152 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:57:05.166 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:05.179 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:05.218 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:05.350 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:57:05.373 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:57:05.408 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:05.622 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:57:05.649 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:57:05.688 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:05.745 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:57:05.771 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:05.811 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:05.814 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:57:05.840 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:57:05.880 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:05.991 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:57:06.018 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:57:06.057 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:06.217 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:57:06.222 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:57:06.244 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:57:06.250 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:06.283 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:06.287 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:06.394 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:57:06.421 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:06.460 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:06.536 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:57:06.551 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:57:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:57:06.594 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:06.618 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:57:06.657 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:06.800 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:57:06.815 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:57:06.850 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:07.002 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:57:07.029 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:07.068 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:07.128 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:57:07.144 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:57:07.177 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:07.304 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:57:07.332 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:07.422 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:57:07.449 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:57:07.464 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:07.488 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:07.539 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:57:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:07.606 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:07.675 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:57:07.690 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:57:07.732 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:07.749 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:57:07.765 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:57:07.799 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:07.951 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:57:07.978 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:57:08.018 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:08.094 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:57:08.121 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:08.160 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:08.228 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:57:08.255 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:57:08.302 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:57:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:57:08.378 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:08.459 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:57:08.486 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:57:08.525 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:08.664 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:57:08.691 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:57:08.730 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:08.740 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:57:08.767 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:08.807 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:08.828 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:57:08.855 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:57:08.895 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:09.050 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:57:09.077 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:57:09.116 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:09.198 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:57:09.225 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:57:09.264 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:09.374 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:57:09.390 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:57:09.424 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:09.559 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:57:09.586 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:57:09.617 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:57:09.809 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:57:09.836 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:09.911 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:57:09.920 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:57:09.938 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:57:09.948 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:57:09.952 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:09.977 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:09.987 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:10.229 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:57:10.245 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:57:10.289 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:57:10.295 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:10.298 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:57:10.306 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:57:10.325 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:57:10.339 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:10.365 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:10.625 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:57:10.653 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:57:10.676 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:57:10.687 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:10.703 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:57:10.742 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:57:10.807 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:57:10.835 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:57:10.839 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:57:10.855 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:57:10.874 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:10.889 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:11.054 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:57:11.081 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:57:11.120 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:11.167 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:57:11.194 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:57:11.227 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:57:11.233 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:11.254 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:57:11.294 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:11.417 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:57:11.445 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:11.562 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:57:11.569 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:11.589 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:57:11.589 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:57:11.616 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:57:11.628 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:11.647 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:11.784 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:57:11.811 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:11.850 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:11.940 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:57:11.967 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:57:12.006 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:57:12.178 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:57:12.205 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:57:12.244 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:12.318 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:57:12.345 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:57:12.356 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:57:12.384 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:12.384 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:12.489 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:57:12.506 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:57:12.508 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:12.531 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:57:12.547 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:12.558 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:12.589 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:12.680 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:57:12.695 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:57:12.729 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:12.817 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:57:12.834 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:57:12.850 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package jq. 2024-04-25T22:57:12.875 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:12.877 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:12.916 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:12.966 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:57:12.993 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:57:13.032 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:57:13.169 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package socat. 2024-04-25T22:57:13.170 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:57:13.196 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:57:13.198 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:57:13.237 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:13.243 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:13.462 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:57:13.481 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:57:13.489 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:57:13.498 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:57:13.529 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:13.538 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:57:13.539 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:57:13.544 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:57:13.555 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:57:13.572 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:57:13.596 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:13.610 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:13.790 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:57:13.817 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:57:13.844 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:57:13.857 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:13.871 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:57:13.910 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:13.942 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:57:13.970 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:14.008 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:14.185 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:57:14.212 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:57:14.251 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:14.258 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:57:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:57:14.286 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:57:14.324 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:14.346 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:14.555 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:57:14.582 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:57:14.619 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:57:14.621 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:57:14.633 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:57:14.646 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:57:14.661 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:57:14.685 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:14.699 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:57:14.942 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:57:14.969 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:57:14.995 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:57:15.008 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:15.022 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:57:15.022 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:57:15.050 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:15.053 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:15.088 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:15.320 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:57:15.347 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:57:15.349 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package jq. 2024-04-25T22:57:15.365 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:15.378 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:15.407 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:15.643 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package socat. 2024-04-25T22:57:15.659 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:57:15.682 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:57:15.693 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:15.709 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:57:15.748 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:57:15.892 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:57:15.920 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:15.958 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:15.963 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:57:15.979 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:57:16.021 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:16.068 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:57:16.095 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:57:16.134 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:16.286 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:57:16.314 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:57:16.337 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:57:16.352 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:16.365 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:16.392 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:57:16.405 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:16.408 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:16.450 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:16.665 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:57:16.682 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:16.689 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:57:16.715 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:16.717 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:16.755 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:16.757 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:57:16.773 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:16.815 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:16.949 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package jq. 2024-04-25T22:57:16.966 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:16.999 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:17.035 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:57:17.062 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:57:17.110 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:17.135 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:57:17.162 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:57:17.201 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:17.245 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package socat. 2024-04-25T22:57:17.260 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:57:17.302 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:17.431 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:57:17.458 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:57:17.497 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:57:17.497 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:17.524 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:17.555 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:17.614 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:57:17.630 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:57:17.672 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:17.824 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2024-04-25T22:57:17.840 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:57:17.851 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:57:17.879 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:57:17.882 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:17.909 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:18.017 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:57:18.043 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:18.084 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:18.135 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2024-04-25T22:57:18.151 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:57:18.193 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:18.297 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:57:18.324 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:57:18.363 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:18.538 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:57:18.554 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:57:18.597 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:18.649 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:57:18.665 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:57:18.688 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:57:18.708 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:18.717 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:18.763 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:18.985 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:57:19.012 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:19.059 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:19.067 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:57:19.086 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:19.125 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:19.136 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:57:19.163 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:57:19.202 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:19.403 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:57:19.430 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:57:19.461 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:19.505 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:57:19.532 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:57:19.571 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:19.800 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:57:19.827 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:57:19.865 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:19.891 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:57:19.919 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:57:19.957 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:20.235 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:57:20.236 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:57:20.263 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:57:20.264 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:57:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:57:20.302 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:20.303 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:20.313 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:20.355 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:20.617 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:57:20.634 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:20.646 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:57:20.667 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:20.674 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:57:20.721 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:57:20.726 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:57:20.753 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:57:20.791 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:21.016 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:57:21.036 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:57:21.043 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:57:21.052 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:57:21.082 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:21.086 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:21.187 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:57:21.215 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:57:21.253 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:21.439 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:57:21.455 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:57:21.472 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:57:21.488 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:21.500 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:57:21.528 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:57:21.539 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:21.556 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:57:21.574 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:57:21.594 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:21.602 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:57:21.641 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:21.791 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:57:21.818 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:57:21.819 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:57:21.846 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:21.858 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:21.884 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:21.889 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:57:21.916 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:57:21.955 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:57:21.995 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:57:22.023 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:57:22.061 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:22.154 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:57:22.182 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:57:22.187 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:57:22.214 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:57:22.229 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:22.253 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:22.282 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:57:22.310 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:57:22.349 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:22.450 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:57:22.478 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:57:22.516 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:22.559 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:57:22.564 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:57:22.586 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:57:22.592 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:57:22.625 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:22.631 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:22.669 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:57:22.696 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:57:22.735 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:22.803 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:57:22.819 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:57:22.861 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:22.967 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:57:22.988 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:57:22.994 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:57:23.004 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:57:23.016 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:57:23.032 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:57:23.033 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:57:23.054 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:23.071 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:23.273 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:57:23.301 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:57:23.339 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:23.364 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:57:23.391 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:57:23.430 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:23.443 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:57:23.471 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:57:23.501 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:23.642 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:57:23.670 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:57:23.708 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:23.737 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:57:23.754 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:57:23.812 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:23.833 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:57:23.860 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:57:23.860 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:23.888 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:57:23.899 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:23.926 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:24.062 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:57:24.090 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:57:24.128 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:24.229 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:57:24.232 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:57:24.257 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:57:24.260 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:57:24.295 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:57:24.299 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:24.423 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:57:24.451 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:57:24.489 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:24.606 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:57:24.634 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:57:24.669 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:57:24.672 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:24.677 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:57:24.693 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:24.696 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:57:24.727 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:24.743 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:24.809 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:57:24.837 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:57:24.875 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:57:25.010 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:57:25.038 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:57:25.039 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:25.076 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:25.156 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:57:25.179 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:57:25.183 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:57:25.207 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:57:25.230 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:25.245 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:25.315 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:57:25.345 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:57:25.361 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:57:25.403 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:25.457 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:25.542 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:57:25.570 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:57:25.608 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:25.691 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:57:25.716 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:57:25.719 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:57:25.757 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:25.937 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:57:25.964 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:57:26.003 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:57:26.010 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:57:26.028 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:57:26.038 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:57:26.076 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:57:26.116 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:57:26.144 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:26.182 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:26.324 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:57:26.351 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:57:26.379 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:57:26.389 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:26.408 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:57:26.417 INFO:teuthology.orchestra.run.smithi165.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:57:26.446 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:26.593 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:26.749 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:57:26.766 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:57:26.799 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:26.836 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:57:26.864 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:57:26.902 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:26.993 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:57:27.022 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:27.035 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:57:27.060 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:27.063 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:57:27.102 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:27.134 INFO:teuthology.orchestra.run.smithi165.stdout:Adding system user cephadm....done 2024-04-25T22:57:27.222 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:57:27.250 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:57:27.282 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:57:27.288 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:57:27.348 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:27.575 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:57:27.575 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:57:27.602 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:57:27.615 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:57:27.641 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:27.716 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:27.781 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:57:27.809 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:27.834 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:27.839 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:27.935 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:57:27.977 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:57:27.986 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:57:28.014 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:57:28.053 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:28.194 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:28.300 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:57:28.331 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:57:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:57:28.389 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:28.454 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:57:28.605 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:57:28.650 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:57:28.667 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:28.708 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:28.718 INFO:teuthology.orchestra.run.smithi172.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:57:28.792 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:28.940 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:29.005 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:29.126 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:57:29.154 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:29.184 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:29.263 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:57:29.300 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:29.389 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:29.509 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user cephadm....done 2024-04-25T22:57:29.576 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:57:29.640 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:57:29.648 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:57:29.844 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:57:29.917 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:57:29.971 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:57:29.999 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:57:30.003 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:57:30.037 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:30.095 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:57:30.168 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:30.294 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:57:30.350 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:57:30.363 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:30.412 INFO:teuthology.orchestra.run.smithi043.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:57:30.466 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:30.562 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:30.593 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:57:30.631 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:30.719 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:57:30.838 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:57:30.929 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user cephadm....done 2024-04-25T22:57:30.945 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:30.948 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:57:30.997 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:57:31.156 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:57:31.233 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:31.249 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:31.320 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:57:31.378 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:31.432 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:57:31.510 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:57:31.593 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:31.636 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:57:31.692 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:31.724 INFO:teuthology.orchestra.run.smithi099.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:57:31.788 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:31.826 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:57:31.852 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:57:31.912 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:57:32.086 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:32.128 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:57:32.304 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2024-04-25T22:57:32.327 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:57:32.345 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:57:32.359 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:57:32.380 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:57:32.427 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:57:32.431 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:57:32.471 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:57:32.566 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:32.631 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:32.748 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:57:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:32.874 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:32.925 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:33.019 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:57:33.060 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:57:33.125 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:33.125 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:33.141 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:57:33.327 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:33.376 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:57:33.384 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:33.385 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:57:33.510 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:33.587 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:33.619 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:57:33.636 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:57:33.661 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:57:33.745 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:57:33.753 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:57:33.904 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:57:33.913 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:57:34.005 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:57:34.064 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:34.071 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:57:34.164 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:34.414 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:57:34.431 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:34.443 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:57:34.444 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:57:34.508 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:57:34.634 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:34.682 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:34.683 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:57:34.732 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:57:34.925 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:34.951 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:57:34.983 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:57:34.993 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:35.034 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:35.109 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:35.119 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:57:35.169 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:57:35.203 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:57:35.235 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:57:35.303 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:57:35.404 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:35.462 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:57:35.528 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:35.563 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:57:35.680 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:35.863 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:57:35.897 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:57:35.921 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:57:35.943 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:57:35.973 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:57:36.008 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:57:36.082 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:36.131 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:36.133 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:36.188 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:57:36.382 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:57:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:57:36.581 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:57:36.601 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:57:36.602 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:36.727 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:57:36.727 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:57:36.742 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:57:36.874 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:57:36.986 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:57:36.993 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:57:37.004 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:37.120 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:37.217 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:57:37.245 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:57:37.280 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:37.373 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:57:37.418 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:57:37.468 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:37.481 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:57:37.538 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:37.564 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:57:37.594 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:37.607 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:57:37.674 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:37.904 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:57:37.940 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:57:37.975 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:38.084 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:57:38.165 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:57:38.263 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:38.334 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:57:38.344 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:57:38.550 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:57:38.594 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:57:38.603 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:57:38.719 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:38.843 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:57:38.845 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:57:38.913 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:57:39.047 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:57:39.138 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:39.178 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:57:39.429 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:39.477 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:39.506 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:57:39.555 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:39.691 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:57:39.728 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:39.740 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:57:39.840 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:57:39.862 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:57:39.925 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:57:40.026 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:57:40.144 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:57:40.149 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:40.150 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:57:40.155 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:57:40.306 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:40.432 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:57:40.437 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:57:40.454 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:57:40.725 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:40.805 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:57:40.830 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:57:40.968 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:57:41.056 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:41.089 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:57:41.157 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:41.227 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:41.330 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:41.353 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:41.450 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:57:41.457 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:57:41.581 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:41.680 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:57:41.716 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:57:41.725 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:57:41.760 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:41.947 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:57:41.983 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:57:42.052 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:57:42.126 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:42.206 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:57:42.252 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:57:42.303 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:57:42.429 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:42.457 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:57:42.537 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:42.708 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:57:42.730 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:57:42.788 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:57:42.976 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:57:43.031 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:43.032 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:43.048 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:57:43.102 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:57:43.140 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:43.258 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:43.384 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:57:43.395 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:43.442 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:57:43.546 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:57:43.652 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:57:43.709 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:57:43.778 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:43.847 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:57:43.904 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:57:43.968 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:57:44.148 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:57:44.219 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:57:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:44.254 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:57:44.399 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:57:44.481 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:57:44.514 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:44.525 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:44.648 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:57:44.659 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:44.687 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:57:44.716 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:44.748 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:57:44.817 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:44.916 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:57:44.963 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:57:44.994 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:45.042 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:57:45.064 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:57:45.126 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:57:45.145 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:45.168 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:57:45.332 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:45.386 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:57:45.458 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:57:45.486 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:57:45.538 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:57:45.654 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:57:45.745 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:57:45.751 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:57:45.781 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:57:45.896 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:57:45.907 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:57:46.005 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:46.060 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:57:46.131 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:57:46.139 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:57:46.166 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:46.292 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:46.319 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:57:46.382 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:57:46.424 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:57:46.446 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:46.508 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:57:46.555 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:46.627 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:46.628 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:57:46.675 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:57:46.801 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:46.848 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:46.909 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:57:46.927 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:57:46.936 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:57:46.974 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:47.161 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:57:47.196 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:47.219 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:57:47.363 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:57:47.368 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:57:47.412 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:57:47.538 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:57:47.618 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:57:47.656 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:57:47.671 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:57:47.736 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:57:47.797 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:57:47.797 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:57:47.898 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:47.932 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:47.987 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:47.998 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:48.079 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:57:48.082 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:57:48.097 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:48.191 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:57:48.277 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:57:48.325 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:48.423 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:48.451 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:48.476 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:57:48.653 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:48.724 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:57:48.777 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:57:48.870 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:57:48.946 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:57:48.992 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:49.028 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:57:49.118 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:57:49.146 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:57:49.154 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:57:49.255 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:57:49.288 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:57:49.307 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:57:49.370 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:57:49.377 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:57:49.433 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:49.506 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:49.559 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:49.607 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:49.640 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:57:49.653 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:49.685 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:57:49.749 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:57:49.908 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:49.988 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:49.998 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:57:50.088 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:50.142 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:57:50.214 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:50.259 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:57:50.366 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:50.402 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:57:50.491 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:50.528 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:57:50.535 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:50.617 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:50.651 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:57:50.661 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:57:50.743 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:50.779 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:57:50.914 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:57:50.946 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:57:50.963 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:50.963 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:50.987 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:57:51.097 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:51.198 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:51.213 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:51.223 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:57:51.307 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:57:51.478 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:51.533 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:57:51.541 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:57:51.604 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:51.643 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:51.738 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:51.769 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:51.817 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:57:51.895 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:51.906 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:51.918 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:51.934 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:57:52.197 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:52.202 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:57:52.211 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:57:52.323 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:52.450 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:52.470 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:57:52.564 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:57:52.661 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:52.661 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:52.665 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:52.766 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:52.824 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:57:52.875 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:57:53.109 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.134 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.192 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:57:53.226 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.228 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.260 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.344 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.362 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.386 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.453 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:53.489 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:53.505 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:57:53.512 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.638 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.757 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.846 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:57:53.883 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:53.972 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.009 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.090 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.191 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:57:54.230 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:54.230 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:54.240 INFO:teuthology.orchestra.run.smithi165.stdout:Adding group ceph....done 2024-04-25T22:57:54.503 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.576 INFO:teuthology.orchestra.run.smithi165.stdout:Adding system user ceph....done 2024-04-25T22:57:54.629 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.735 INFO:teuthology.orchestra.run.smithi165.stdout:Setting system user ceph properties....done 2024-04-25T22:57:54.752 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.754 INFO:teuthology.orchestra.run.smithi165.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:57:54.763 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:57:54.766 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.878 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:54.890 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:57:54.909 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.004 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.035 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.040 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.130 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:55.157 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.161 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.204 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:57:55.284 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.496 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:55.496 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:57:55.654 INFO:teuthology.orchestra.run.smithi172.stdout:Adding group ceph....done 2024-04-25T22:57:55.732 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.883 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:55.964 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user ceph....done 2024-04-25T22:57:55.968 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:56.132 INFO:teuthology.orchestra.run.smithi172.stdout:Setting system user ceph properties....done 2024-04-25T22:57:56.145 INFO:teuthology.orchestra.run.smithi172.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:57:56.279 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:57:56.334 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:57:56.334 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:57:56.369 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:56.442 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:56.495 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:56.567 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:56.582 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:57:56.629 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:57:56.693 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:56.886 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:57.021 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:57.029 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:57.111 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:57.122 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:57.471 INFO:teuthology.orchestra.run.smithi043.stdout:Adding group ceph....done 2024-04-25T22:57:57.549 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:57:57.549 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:57:57.812 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:57:57.848 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user ceph....done 2024-04-25T22:57:57.875 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:57.999 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.001 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.025 INFO:teuthology.orchestra.run.smithi043.stdout:Setting system user ceph properties....done 2024-04-25T22:57:58.043 INFO:teuthology.orchestra.run.smithi043.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:57:58.127 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.190 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:57:58.253 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.296 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.353 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:57:58.404 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.494 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:57:58.523 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:57:58.524 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:57:58.808 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.898 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2024-04-25T22:57:58.963 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:58.965 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:59.042 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:57:59.042 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:57:59.081 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:59.177 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:57:59.177 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:57:59.298 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2024-04-25T22:57:59.467 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2024-04-25T22:57:59.481 INFO:teuthology.orchestra.run.smithi099.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:57:59.518 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:59.615 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:57:59.641 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:57:59.742 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:57:59.743 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:57:59.892 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:57:59.892 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:57:59.907 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:57:59.929 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:57:59.929 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:58:00.253 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:00.372 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:00.384 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:00.401 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:00.473 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:00.523 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:58:00.523 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:58:00.536 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:00.687 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:00.740 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:58:00.915 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:00.915 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:00.924 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:58:00.924 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:58:00.980 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.081 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.224 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.227 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.350 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.413 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.434 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:01.434 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:01.467 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:58:01.467 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:58:01.665 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.699 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:58:01.791 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.900 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.929 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:01.942 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:02.034 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:02.143 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:02.158 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:58:02.159 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:58:02.160 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:02.287 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:58:02.303 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:02.363 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:58:02.363 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:58:02.404 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:02.557 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:02.664 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:58:02.779 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:02.790 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:02.837 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:02.942 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:03.057 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:58:03.057 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:58:03.175 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:58:03.175 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:58:03.358 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:03.513 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:03.702 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:03.753 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:58:03.754 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:58:03.836 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:03.962 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:04.006 INFO:teuthology.orchestra.run.smithi165.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:04.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:58:04.051 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:04.104 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-04-25T22:58:04.165 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:04.165 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:04.302 INFO:teuthology.orchestra.run.smithi165.stdout:Building dependency tree... 2024-04-25T22:58:04.303 INFO:teuthology.orchestra.run.smithi165.stdout:Reading state information... 2024-04-25T22:58:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:04.476 INFO:teuthology.orchestra.run.smithi165.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:58:04.476 INFO:teuthology.orchestra.run.smithi165.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:58:04.476 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:58:04.476 INFO:teuthology.orchestra.run.smithi165.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:58:04.476 INFO:teuthology.orchestra.run.smithi165.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:58:04.476 INFO:teuthology.orchestra.run.smithi165.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:58:04.477 INFO:teuthology.orchestra.run.smithi165.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:58:04.477 INFO:teuthology.orchestra.run.smithi165.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:58:04.477 INFO:teuthology.orchestra.run.smithi165.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:58:04.478 INFO:teuthology.orchestra.run.smithi165.stdout:The following additional packages will be installed: 2024-04-25T22:58:04.478 INFO:teuthology.orchestra.run.smithi165.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:58:04.480 INFO:teuthology.orchestra.run.smithi165.stdout:Suggested packages: 2024-04-25T22:58:04.480 INFO:teuthology.orchestra.run.smithi165.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:58:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:04.511 INFO:teuthology.orchestra.run.smithi165.stdout:The following NEW packages will be installed: 2024-04-25T22:58:04.512 INFO:teuthology.orchestra.run.smithi165.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:58:04.513 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages will be upgraded: 2024-04-25T22:58:04.514 INFO:teuthology.orchestra.run.smithi165.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:58:04.598 INFO:teuthology.orchestra.run.smithi165.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:58:04.598 INFO:teuthology.orchestra.run.smithi165.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:58:04.598 INFO:teuthology.orchestra.run.smithi165.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:58:04.598 INFO:teuthology.orchestra.run.smithi165.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:58:04.655 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:04.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:58:04.704 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:04.704 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:58:04.752 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-04-25T22:58:04.806 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:04.826 INFO:teuthology.orchestra.run.smithi165.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:58:04.907 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:04.949 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-04-25T22:58:04.950 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-04-25T22:58:05.033 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:05.039 INFO:teuthology.orchestra.run.smithi165.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:58:05.040 INFO:teuthology.orchestra.run.smithi165.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:58:05.041 INFO:teuthology.orchestra.run.smithi165.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:58:05.089 INFO:teuthology.orchestra.run.smithi165.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:58:05.090 INFO:teuthology.orchestra.run.smithi165.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:58:05.094 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:58:05.095 INFO:teuthology.orchestra.run.smithi165.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:58:05.095 INFO:teuthology.orchestra.run.smithi165.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:58:05.117 INFO:teuthology.orchestra.run.smithi172.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:58:05.117 INFO:teuthology.orchestra.run.smithi172.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:58:05.117 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:58:05.117 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:58:05.117 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:58:05.117 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:58:05.117 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:58:05.118 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:58:05.118 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:58:05.118 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-04-25T22:58:05.119 INFO:teuthology.orchestra.run.smithi172.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:58:05.120 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-04-25T22:58:05.120 INFO:teuthology.orchestra.run.smithi172.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:58:05.150 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-04-25T22:58:05.151 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:05.151 INFO:teuthology.orchestra.run.smithi172.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:58:05.152 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-04-25T22:58:05.153 INFO:teuthology.orchestra.run.smithi172.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:58:05.262 INFO:teuthology.orchestra.run.smithi172.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:58:05.262 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:58:05.262 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:58:05.262 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:58:05.302 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:05.378 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:58:05.430 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:58:05.437 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:05.512 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:05.513 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:58:05.516 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:58:05.519 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:58:05.540 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:58:05.545 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:58:05.551 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:58:05.551 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:58:05.551 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:58:05.588 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:58:05.603 INFO:teuthology.orchestra.run.smithi165.stdout:Preconfiguring packages ... 2024-04-25T22:58:05.648 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:05.703 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 5,495 kB in 1s (7,396 kB/s) 2024-04-25T22:58:05.839 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package flex. 2024-04-25T22:58:05.932 INFO:teuthology.orchestra.run.smithi172.stdout:Preconfiguring packages ... 2024-04-25T22:58:05.932 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:58:05.939 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:58:05.944 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:05.987 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:58:06.039 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 5,495 kB in 0s (12.7 MB/s) 2024-04-25T22:58:06.041 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:06.174 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package flex. 2024-04-25T22:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:06.266 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:58:06.271 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:06.339 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:58:06.562 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:06.798 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:06.818 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:58:06.905 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:07.079 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:58:07.246 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:07.337 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:07.460 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:07.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:58:07.464 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:07.517 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-25T22:58:07.706 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-25T22:58:07.707 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-25T22:58:07.800 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:07.806 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:07.882 INFO:teuthology.orchestra.run.smithi043.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:58:07.882 INFO:teuthology.orchestra.run.smithi043.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:58:07.882 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:58:07.882 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:58:07.882 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:58:07.882 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:58:07.882 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:58:07.883 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:58:07.883 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:58:07.883 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-04-25T22:58:07.884 INFO:teuthology.orchestra.run.smithi043.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:58:07.885 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-04-25T22:58:07.885 INFO:teuthology.orchestra.run.smithi043.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:58:07.913 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-04-25T22:58:07.915 INFO:teuthology.orchestra.run.smithi043.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:58:07.916 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages will be upgraded: 2024-04-25T22:58:07.916 INFO:teuthology.orchestra.run.smithi043.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:58:07.952 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:07.975 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:07.996 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:07.999 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:58:08.055 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-04-25T22:58:08.111 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-04-25T22:58:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-04-25T22:58:08.378 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:08.441 INFO:teuthology.orchestra.run.smithi099.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:58:08.441 INFO:teuthology.orchestra.run.smithi099.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:58:08.441 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:58:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:58:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:58:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:58:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:58:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:58:08.442 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:58:08.442 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-04-25T22:58:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:58:08.444 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-04-25T22:58:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:58:08.473 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-04-25T22:58:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:58:08.475 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-04-25T22:58:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:58:08.503 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:08.509 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:08.642 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:08.654 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:58:08.655 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:58:08.655 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:58:08.655 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:58:08.817 INFO:teuthology.orchestra.run.smithi043.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:58:08.817 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:58:08.817 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:58:08.817 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:58:08.870 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:08.987 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:09.177 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:58:09.244 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package bison. 2024-04-25T22:58:09.295 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:58:09.318 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package bison. 2024-04-25T22:58:09.347 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:09.353 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:58:09.396 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:09.422 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:09.427 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:58:09.470 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:09.647 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:58:09.674 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:58:09.675 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:58:09.713 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:58:09.729 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:58:09.763 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:09.795 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:58:09.804 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:58:09.805 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:58:09.808 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:58:09.809 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:58:09.810 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:58:09.811 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:58:09.862 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:10.000 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:58:10.028 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:58:10.067 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:10.137 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:58:10.165 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:58:10.241 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:10.404 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:58:10.431 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:10.467 INFO:teuthology.orchestra.run.smithi043.stdout:Preconfiguring packages ... 2024-04-25T22:58:10.470 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:10.569 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:58:10.570 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 5,495 kB in 2s (2,511 kB/s) 2024-04-25T22:58:10.589 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:58:10.597 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:58:10.602 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:58:10.623 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:10.661 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:10.706 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:58:10.713 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package flex. 2024-04-25T22:58:10.734 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:10.772 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:10.813 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:58:10.819 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:10.870 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:58:10.908 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:58:10.924 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:10.957 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:11.000 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:58:11.016 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:11.058 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:11.131 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:58:11.141 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:58:11.160 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:58:11.175 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:58:11.176 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:11.180 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:58:11.193 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:58:11.218 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:11.403 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:58:11.551 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:58:11.672 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:11.679 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:58:11.798 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:11.814 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:11.916 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:11.929 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:11.940 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:12.016 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:12.066 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:12.117 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:12.192 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:12.235 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:12.318 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:12.324 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:58:12.404 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:12.444 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:12.456 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:12.462 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:12.531 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:12.532 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:58:12.583 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:12.595 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:12.697 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:12.715 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:12.832 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:12.976 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:13.090 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:13.163 INFO:teuthology.orchestra.run.smithi099.stdout:Preconfiguring packages ... 2024-04-25T22:58:13.266 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 5,495 kB in 4s (1,266 kB/s) 2024-04-25T22:58:13.368 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package flex. 2024-04-25T22:58:13.392 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:13.428 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:58:13.433 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:13.467 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:58:13.898 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package bison. 2024-04-25T22:58:13.935 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:14.005 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:14.011 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:58:14.059 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:14.066 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:14.067 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:14.232 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:58:14.367 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:58:14.384 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:58:14.422 INFO:teuthology.orchestra.run.smithi165.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:14.428 DEBUG:teuthology.parallel:result is None 2024-04-25T22:58:14.428 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:14.549 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:14.554 DEBUG:teuthology.parallel:result is None 2024-04-25T22:58:14.668 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:14.688 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:58:14.716 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:58:14.754 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:15.058 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:58:15.086 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:15.116 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:15.190 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:15.195 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:15.323 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:15.352 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:58:15.380 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:15.418 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:15.671 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:58:15.687 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:15.690 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:58:15.729 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:15.796 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:58:16.174 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:16.224 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:58:16.325 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:16.451 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:16.514 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package bison. 2024-04-25T22:58:16.577 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:16.611 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:58:16.616 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:58:16.666 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:16.712 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:16.838 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:16.964 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:17.053 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:58:17.115 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:17.117 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:58:17.145 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:58:17.184 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:17.217 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:17.360 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:17.422 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:58:17.437 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:58:17.471 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:17.800 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:58:17.827 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:17.866 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:18.135 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:58:18.151 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:58:18.193 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:18.446 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:58:18.462 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:58:18.505 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:18.619 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:18.966 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:58:19.093 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:58:19.109 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:19.115 DEBUG:teuthology.parallel:result is None 2024-04-25T22:58:19.210 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:58:19.320 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:58:19.421 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:58:19.547 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:58:19.762 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:58:19.825 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:58:19.951 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:58:20.086 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:58:21.471 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:58:21.942 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:58:21.946 DEBUG:teuthology.parallel:result is None 2024-04-25T22:58:21.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:58:22.173 DEBUG:teuthology.orchestra.run.smithi043:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:58:22.193 INFO:teuthology.orchestra.run.smithi043.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.194 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.194 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:58:22.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:58:22.434 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:58:22.453 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.453 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.453 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:58:22.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:58:22.743 DEBUG:teuthology.orchestra.run.smithi165:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:58:22.762 INFO:teuthology.orchestra.run.smithi165.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.762 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.762 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:58:22.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:58:22.902 DEBUG:teuthology.orchestra.run.smithi172:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:58:22.921 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.921 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:58:22.921 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:58:22.923 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T22:58:22.923 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:22.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:58:22.938 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:22.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:58:22.953 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:22.953 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:58:22.967 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:22.967 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:58:22.982 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T22:58:22.982 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:22.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:58:22.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:58:23.055 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:23.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:58:23.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:58:23.123 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:23.124 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:58:23.138 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:58:23.195 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:23.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:58:23.210 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:58:23.266 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T22:58:23.266 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:23.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:58:23.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:58:23.332 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:23.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:58:23.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:58:23.401 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:23.401 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:58:23.415 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:58:23.470 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:23.470 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:58:23.484 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:58:23.538 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T22:58:23.538 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:23.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:58:23.552 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:58:23.608 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:23.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:58:23.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:58:23.676 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:23.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:58:23.689 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:58:23.746 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:23.746 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:58:23.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:58:23.813 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T22:58:23.902 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T22:58:23.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-04-25T22:58:23.905 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-04-25T22:58:23.907 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2024-04-25T22:58:23.910 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-04-25T22:58:23.922 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T22:58:23.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:58:23.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:58:23.965 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:58:23.967 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:58:23.979 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T22:58:23.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:58:24.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:58:24.020 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:58:24.023 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:58:24.046 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T22:58:24.046 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T22:58:24.046 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674072', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 9595, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a', 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvlSDyUaRtIRQxw+dSAdJqrXOhY7NuXNBhotsxa9HykDz0VFWlKr3x7oDQyinS8f2E7XWNppCjIUlx/QN63o20=', 'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAgZlTYbBKU9ptbhV3PNWM/uZ8WkBzxn3LO3nnobZGsmjqXQP8Ajo7X57/gHDK6LMpWG8SRJMOcHIKqsBSuFm7s=', 'smithi165.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOftZmqSqevAn57QfHLlQOU4/a/sh8Vvm80IP27crIkDrzIbitS2ImcslNa+LKHWN6Xr1prYrPE1yMf4lCm+k4k=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsRdW3uL2i6POFG6zahbwfWhdsReDTFBsnTfzrA9+oK9D85NLIuumS0fpoIKW6nazdFsNVzIZ/6eTDJIAGfOrg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_21:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T22:58:24.046 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:58:24.074 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:58:24.076 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:58:24.079 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:58:24.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:58:24.122 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:58:24.126 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:58:24.128 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:58:24.142 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:24.142 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:58:24.186 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:58:24.186 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-04-25T22:58:24.234 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:58:24.234 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:24.234 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-04-25T22:58:24.235 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:24.235 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-04-25 22:52:33.844426999 +0000 2024-04-25T22:58:24.236 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-04-25 22:52:33.564429499 +0000 2024-04-25T22:58:24.236 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-04-25 22:52:33.564429499 +0000 2024-04-25T22:58:24.236 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-04-25T22:58:24.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:58:24.288 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-04-25T22:58:24.288 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-04-25T22:58:24.288 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000445904 s, 1.1 MB/s 2024-04-25T22:58:24.290 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:58:24.339 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-04-25 22:52:34.332422640 +0000 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-04-25 22:52:34.088424819 +0000 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-04-25 22:52:34.088424819 +0000 2024-04-25T22:58:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-04-25T22:58:24.385 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:58:24.439 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-04-25T22:58:24.439 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-04-25T22:58:24.439 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000424944 s, 1.2 MB/s 2024-04-25T22:58:24.441 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:58:24.490 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-04-25T22:58:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:58:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:24.537 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-25T22:58:24.537 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:24.537 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-04-25 22:52:34.832418173 +0000 2024-04-25T22:58:24.537 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-04-25 22:52:34.556420638 +0000 2024-04-25T22:58:24.538 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-04-25 22:52:34.556420638 +0000 2024-04-25T22:58:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-04-25T22:58:24.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:58:24.594 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-04-25T22:58:24.595 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-04-25T22:58:24.595 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000394526 s, 1.3 MB/s 2024-04-25T22:58:24.595 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:58:24.642 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-04-25T22:58:24.689 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:58:24.689 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:24.689 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-04-25T22:58:24.689 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:24.689 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-04-25 22:52:35.308413922 +0000 2024-04-25T22:58:24.689 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-04-25 22:52:35.044416281 +0000 2024-04-25T22:58:24.689 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-04-25 22:52:35.044416281 +0000 2024-04-25T22:58:24.690 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-04-25T22:58:24.690 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:58:24.743 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-04-25T22:58:24.744 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-04-25T22:58:24.744 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000385894 s, 1.3 MB/s 2024-04-25T22:58:24.745 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:58:24.795 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:58:24.795 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:24.795 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:58:24.801 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:58:24.801 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 22:52:29.298903025 +0000 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 22:52:29.294903060 +0000 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 22:52:29.294903060 +0000 2024-04-25T22:58:24.847 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2024-04-25T22:58:24.848 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:58:24.901 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T22:58:24.901 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T22:58:24.901 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000442116 s, 1.2 MB/s 2024-04-25T22:58:24.902 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:58:24.952 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-04-25T22:58:24.998 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:58:25.002 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:25.002 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-04-25T22:58:25.002 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:25.002 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 22:52:30.070896129 +0000 2024-04-25T22:58:25.002 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 22:52:29.798898558 +0000 2024-04-25T22:58:25.002 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 22:52:29.798898558 +0000 2024-04-25T22:58:25.002 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2024-04-25T22:58:25.002 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:58:25.053 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T22:58:25.053 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T22:58:25.053 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.0004284 s, 1.2 MB/s 2024-04-25T22:58:25.054 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:58:25.104 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-04-25T22:58:25.150 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:58:25.150 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:25.150 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-04-25T22:58:25.150 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:25.150 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 22:52:30.594891448 +0000 2024-04-25T22:58:25.151 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 22:52:30.330893807 +0000 2024-04-25T22:58:25.151 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 22:52:30.330893807 +0000 2024-04-25T22:58:25.151 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2024-04-25T22:58:25.151 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:58:25.207 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T22:58:25.207 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T22:58:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000412953 s, 1.2 MB/s 2024-04-25T22:58:25.208 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:58:25.255 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-04-25T22:58:25.302 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:58:25.302 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:25.303 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-04-25T22:58:25.303 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:25.303 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 22:52:31.098886947 +0000 2024-04-25T22:58:25.303 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 22:52:30.818889448 +0000 2024-04-25T22:58:25.303 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 22:52:30.818889448 +0000 2024-04-25T22:58:25.303 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2024-04-25T22:58:25.303 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:58:25.358 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T22:58:25.358 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T22:58:25.358 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000415147 s, 1.2 MB/s 2024-04-25T22:58:25.359 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:58:25.411 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:58:25.411 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:25.411 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:58:25.417 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:58:25.417 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-04-25T22:58:25.466 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:58:25.466 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:25.466 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 865 Links: 1 2024-04-25T22:58:25.467 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:25.467 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 22:52:39.622025218 +0000 2024-04-25T22:58:25.467 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 22:52:39.366027504 +0000 2024-04-25T22:58:25.467 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 22:52:39.366027504 +0000 2024-04-25T22:58:25.467 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-25T22:58:25.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:58:25.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T22:58:25.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T22:58:25.526 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000423531 s, 1.2 MB/s 2024-04-25T22:58:25.527 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:58:25.580 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-04-25T22:58:25.630 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:58:25.631 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:25.631 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-04-25T22:58:25.631 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:25.631 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 22:52:40.082021108 +0000 2024-04-25T22:58:25.631 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 22:52:39.830023360 +0000 2024-04-25T22:58:25.631 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 22:52:39.830023360 +0000 2024-04-25T22:58:25.631 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-25T22:58:25.631 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:58:25.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T22:58:25.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T22:58:25.685 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000416457 s, 1.2 MB/s 2024-04-25T22:58:25.686 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:58:25.735 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 22:52:40.562016821 +0000 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 22:52:40.322018965 +0000 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 22:52:40.322018965 +0000 2024-04-25T22:58:25.783 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-25T22:58:25.783 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:58:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T22:58:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T22:58:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000411196 s, 1.2 MB/s 2024-04-25T22:58:25.837 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:58:25.887 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-04-25T22:58:25.934 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:58:25.935 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:58:25.935 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-04-25T22:58:25.935 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:58:25.935 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 22:52:41.026012677 +0000 2024-04-25T22:58:25.936 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 22:52:40.790014785 +0000 2024-04-25T22:58:25.936 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 22:52:40.790014785 +0000 2024-04-25T22:58:25.936 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-04-25T22:58:25.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:58:25.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T22:58:25.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T22:58:25.989 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000389964 s, 1.3 MB/s 2024-04-25T22:58:25.990 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:58:26.040 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:58:26.040 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:58:26.040 INFO:tasks.ceph:Generating config... 2024-04-25T22:58:26.041 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T22:58:26.042 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T22:58:26.042 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T22:58:26.042 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T22:58:26.042 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T22:58:26.042 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-04-25T22:58:26.042 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-04-25T22:58:26.042 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T22:58:26.042 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T22:58:26.042 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T22:58:26.042 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T22:58:26.043 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T22:58:26.044 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T22:58:26.044 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T22:58:26.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T22:58:26.080 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T22:58:26.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T22:58:26.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:58:26.220 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]'), ('mon.c', '[v2:172.21.15.43:3302,v1:172.21.15.43:6791]')] 2024-04-25T22:58:26.221 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-25T22:58:26.222 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:26.222 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:58:26.269 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --addv b '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]' --addv c '[v2:172.21.15.43:3302,v1:172.21.15.43:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:26.357 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:26.357 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid 8d6ec37a-06d7-4d24-9516-19a660848874 2024-04-25T22:58:26.357 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-04-25T22:58:26.357 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-04-25T22:58:26.357 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 8d6ec37a-06d7-4d24-9516-19a660848874 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-04-25T22:58:26.356944+0000 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-25T22:58:26.356944+0000 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 17 (quincy) 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.b 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.43:3302/0,v1:172.21.15.43:6791/0] mon.c 2024-04-25T22:58:26.358 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T22:58:26.359 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:58:26.364 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8d6ec37a-06d7-4d24-9516-19a660848874... 2024-04-25T22:58:26.365 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:58:26.410 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:58:26.413 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:58:26.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-04-25T22:58:26.437 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.438 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-04-25T22:58:26.439 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 8d6ec37a-06d7-4d24-9516-19a660848874 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-04-25T22:58:26.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-04-25T22:58:26.441 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: bluefs allocator = hybrid 2024-04-25T22:58:26.442 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = hybrid 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: osd max markdown count = 1000 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-04-25T22:58:26.443 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-04-25T22:58:26.444 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:58:26.445 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:58:26.446 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-04-25T22:58:26.447 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-04-25T22:58:26.447 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-04-25T22:58:26.447 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-25T22:58:26.448 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-25T22:58:26.449 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-25T22:58:26.450 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 8d6ec37a-06d7-4d24-9516-19a660848874 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:58:26.451 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-25T22:58:26.452 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: bluefs allocator = hybrid 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = hybrid 2024-04-25T22:58:26.453 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: osd max markdown count = 1000 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.454 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-25T22:58:26.455 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:58:26.456 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-25T22:58:26.457 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-04-25T22:58:26.458 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-04-25T22:58:26.459 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.460 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = 8d6ec37a-06d7-4d24-9516-19a660848874 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-04-25T22:58:26.461 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.462 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: bluefs allocator = hybrid 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore allocator = hybrid 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 1/20 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 1/20 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 4/10 2024-04-25T22:58:26.463 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: osd max markdown count = 1000 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.464 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:58:26.465 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-04-25T22:58:26.466 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.b] 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.c] 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-04-25T22:58:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:58:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:58:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 8d6ec37a-06d7-4d24-9516-19a660848874 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:58:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: bluefs allocator = hybrid 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = hybrid 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-04-25T22:58:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: osd max markdown count = 1000 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-04-25T22:58:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-04-25T22:58:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:58:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-04-25T22:58:26.476 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-04-25T22:58:26.479 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T22:58:26.479 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T22:58:26.565 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T22:58:26.565 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:26.565 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T22:58:26.571 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:26.571 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T22:58:26.621 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T22:58:26.621 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:26.621 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:58:26.621 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:58:26.687 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:26.687 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:26.733 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-04-25T22:58:26.733 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:26.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:58:26.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:58:26.756 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:26.756 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:26.805 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T22:58:26.805 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:26.805 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:58:26.805 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:58:26.829 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:26.829 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:26.875 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T22:58:26.875 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:26.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:58:26.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:58:26.897 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:26.897 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:26.946 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T22:58:26.946 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T22:58:26.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:58:26.991 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:58:26.994 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:58:27.077 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:58:27.080 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T22:58:27.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:58:27.165 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:58:27.168 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T22:58:27.223 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T22:58:27.223 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T22:58:27.297 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T22:58:27.307 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T22:58:27.307 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:58:27.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T22:58:27.321 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:58:27.321 INFO:tasks.ceph:role: osd.0 2024-04-25T22:58:27.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-04-25T22:58:27.321 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:58:27.385 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:58:27.849 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-04-25T22:58:27.851 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-04-25T22:58:27.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T22:58:27.945 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T22:58:27.954 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:58:27.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:58:27.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:28.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-04-25T22:58:28.066+0000 7f2f0fa517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T22:58:28.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-04-25T22:58:28.066+0000 7f2f0fa517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T22:58:28.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-04-25T22:58:28.066+0000 7f2f0fa517c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:58:28.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-04-25T22:58:28.066+0000 7f2f0fa517c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:58:28.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-04-25T22:58:28.066+0000 7f2f0fa517c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:58:28.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-04-25T22:58:28.070+0000 7f2f0fa517c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T22:58:31.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T22:58:31.070 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T22:58:31.084 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:58:31.084 INFO:tasks.ceph:role: osd.1 2024-04-25T22:58:31.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T22:58:31.084 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:58:31.145 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:58:31.602 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-04-25T22:58:31.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-04-25T22:58:31.604 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-25T22:58:31.695 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T22:58:31.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:58:31.705 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:58:31.705 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:31.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T22:58:31.821+0000 7fda0691f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T22:58:31.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T22:58:31.825+0000 7fda0691f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T22:58:31.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T22:58:31.825+0000 7fda0691f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:58:31.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T22:58:31.825+0000 7fda0691f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:58:31.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T22:58:31.825+0000 7fda0691f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:58:31.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T22:58:31.825+0000 7fda0691f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T22:58:34.820 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T22:58:34.834 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T22:58:34.848 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:58:34.848 INFO:tasks.ceph:role: osd.2 2024-04-25T22:58:34.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T22:58:34.849 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:58:34.909 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:58:35.371 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-25T22:58:35.373 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-25T22:58:35.374 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-25T22:58:35.517 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T22:58:35.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:58:35.529 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:58:35.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:35.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T22:58:35.669+0000 7fc74e7797c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T22:58:35.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T22:58:35.673+0000 7fc74e7797c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T22:58:35.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T22:58:35.673+0000 7fc74e7797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:58:35.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T22:58:35.673+0000 7fc74e7797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:58:35.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T22:58:35.673+0000 7fc74e7797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:58:35.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T22:58:35.677+0000 7fc74e7797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T22:58:38.660 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T22:58:38.673 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T22:58:38.674 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:38.674 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T22:58:38.689 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:38.689 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T22:58:38.744 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:38.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T22:58:38.800 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:38.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T22:58:38.814 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:38.814 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T22:58:38.830 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:38.830 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T22:58:38.844 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T22:58:38.844 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T22:58:38.849 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T22:58:38.850 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T22:58:38.903 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-04-25T22:58:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAS4CpmdNQQOxAAeZkM35XEE2HFJpCYTJOS+w== 2024-04-25T22:58:38.903 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-04-25T22:58:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAT4CpmOASbBBAAnjKa58/zRXg89G/8rBAuxQ== 2024-04-25T22:58:38.903 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-25T22:58:38.903 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAT4Cpm01HdCRAATRVW79BqGPL7Cem9XA5yAg== 2024-04-25T22:58:38.903 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-04-25T22:58:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAU4CpmmXMSBBAArrzkJZsBVGUoJqAUQAJOAQ== 2024-04-25T22:58:38.904 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-04-25T22:58:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAX4Cpmgz1FMRAA2wFoZncj1t66Y5i9HWz/eA== 2024-04-25T22:58:38.904 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-04-25T22:58:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAb4Cpmvl05KBAAuY/IhWk9PtbtP0vFE8C4RQ== 2024-04-25T22:58:38.904 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-04-25T22:58:38.904 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAT4CpmsHOwERAAWRJOQkrLG8c/1KKNL+XZeQ== 2024-04-25T22:58:38.905 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:58:38.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:58:39.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T22:58:39.133 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:58:39.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:58:39.257 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:58:39.340 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T22:58:39.428 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T22:58:39.429 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T22:58:39.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:58:39.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T22:58:39.610 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T22:58:39.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:58:39.750 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T22:58:39.760 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T22:58:39.814 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:58:39.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T22:58:39.920 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:58:39.972 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T22:58:39.972 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T22:58:39.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T22:58:40.018 INFO:tasks.ceph.mon.a:Started 2024-04-25T22:58:40.018 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T22:58:40.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T22:58:40.021 INFO:tasks.ceph.mon.b:Started 2024-04-25T22:58:40.021 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T22:58:40.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T22:58:40.024 INFO:tasks.ceph.mon.c:Started 2024-04-25T22:58:40.024 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T22:58:40.024 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T22:58:40.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T22:58:40.027 INFO:tasks.ceph.mgr.x:Started 2024-04-25T22:58:40.027 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T22:58:40.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T22:58:40.029 INFO:tasks.ceph.mgr.y:Started 2024-04-25T22:58:40.029 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T22:58:40.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T22:58:45.553 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-04-25T22:58:45.573 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T22:58:45.573 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T22:58:45.573 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-04-25T22:58:45.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T22:58:45.588 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T22:58:45.588 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T22:58:45.602 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T22:58:45.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T22:58:45.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 3af34823-d803-4ca7-8300-4935c4b3ba2f 0 2024-04-25T22:58:45.678 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:45.675+0000 7f0c7f301180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:58:45.874 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-04-25T22:58:45.892 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 13349ae7-4074-4fe6-8cc5-f6e9a003ba23 1 2024-04-25T22:58:46.105 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T22:58:46.123 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 86c4b994-d0fe-4635-ae55-e8a4902029d3 2 2024-04-25T22:58:46.202 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:46.199+0000 7f0c7f301180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:58:46.277 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:46.275+0000 7f2cc4699180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:58:46.331 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-04-25T22:58:46.348 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T22:58:46.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T22:58:46.351 INFO:tasks.ceph.osd.0:Started 2024-04-25T22:58:46.351 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T22:58:46.351 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T22:58:46.354 INFO:tasks.ceph.osd.1:Started 2024-04-25T22:58:46.354 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T22:58:46.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T22:58:46.356 INFO:tasks.ceph.osd.2:Started 2024-04-25T22:58:46.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:58:46.410 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:46.407+0000 7f0c7f301180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:58:46.548 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:58:46.548 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:58:46.328330+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:58:46.564 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T22:58:46.564 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T22:58:46.686 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:46.683+0000 7f2cc4699180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:58:46.824 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:46.823+0000 7f2cc4699180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:58:46.867 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:58:47.004 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:46.999+0000 7f0c7f301180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:58:47.035 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:58:47.033+0000 7f7f4de2a7c0 -1 Falling back to public interface 2024-04-25T22:58:47.051 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-25T22:58:47.051 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":5,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:58:46.328330+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:58:47.059 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T22:58:47.057+0000 7f30c49ba7c0 -1 Falling back to public interface 2024-04-25T22:58:47.062 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.059+0000 7f0c7f301180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:58:47.067 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-25T22:58:47.067 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:58:47.065+0000 7f38d72657c0 -1 Falling back to public interface 2024-04-25T22:58:47.119 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.115+0000 7f0c7f301180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:58:47.201 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.199+0000 7f0c7f301180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:58:47.257 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.255+0000 7f0c7f301180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:58:47.269 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.267+0000 7f2cc4699180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:58:47.323 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.319+0000 7f2cc4699180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:58:47.339 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.335+0000 7f0c7f301180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:58:47.375 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.371+0000 7f2cc4699180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:58:47.396 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.395+0000 7f0c7f301180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:58:47.455 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.451+0000 7f2cc4699180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:58:47.507 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.503+0000 7f2cc4699180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:58:47.557 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.555+0000 7f0c7f301180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:58:47.584 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.583+0000 7f2cc4699180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:58:47.622 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:47.619+0000 7f0c7f301180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:58:47.636 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.631+0000 7f2cc4699180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:58:47.783 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.779+0000 7f2cc4699180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:58:47.836 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:47.835+0000 7f2cc4699180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:58:48.300 INFO:tasks.ceph.mgr.x.smithi043.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T22:58:48.300 INFO:tasks.ceph.mgr.x.smithi043.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T22:58:48.300 INFO:tasks.ceph.mgr.x.smithi043.stderr: from numpy import show_config as show_numpy_config 2024-04-25T22:58:48.300 INFO:tasks.ceph.mgr.y.smithi043.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T22:58:48.300 INFO:tasks.ceph.mgr.y.smithi043.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T22:58:48.300 INFO:tasks.ceph.mgr.y.smithi043.stderr: from numpy import show_config as show_numpy_config 2024-04-25T22:58:48.378 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:48.375+0000 7f0c7f301180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:58:48.379 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:48.375+0000 7f2cc4699180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:58:48.628 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:48.623+0000 7f0c7f301180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:58:48.630 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:48.627+0000 7f2cc4699180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:58:48.831 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:48.827+0000 7f2cc4699180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:58:48.831 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:48.827+0000 7f0c7f301180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:58:48.898 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:48.895+0000 7f2cc4699180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:58:48.901 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:48.895+0000 7f0c7f301180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:58:49.040 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:49.035+0000 7f2cc4699180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:58:49.043 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:49.039+0000 7f0c7f301180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:58:49.766 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:49.763+0000 7f0c7f301180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:58:49.767 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:49.763+0000 7f2cc4699180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:58:49.847 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:49.843+0000 7f0c7f301180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:58:49.847 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:49.843+0000 7f2cc4699180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:58:50.039 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:50.035+0000 7f2cc4699180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:58:50.039 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:50.035+0000 7f0c7f301180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:58:50.117 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:50.115+0000 7f2cc4699180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:58:50.117 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:50.115+0000 7f0c7f301180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:58:50.425 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:50.423+0000 7f2cc4699180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:58:50.426 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:50.423+0000 7f0c7f301180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:58:50.490 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-25T22:58:50.487+0000 7f2cc4699180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:58:50.491 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:50.487+0000 7f0c7f301180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:58:50.740 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:58:50.737+0000 7f38d72657c0 -1 osd.1 0 log_to_monitors true 2024-04-25T22:58:50.752 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:58:50.749+0000 7f7f4de2a7c0 -1 osd.0 0 log_to_monitors true 2024-04-25T22:58:50.756 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T22:58:50.753+0000 7f30c49ba7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T22:58:51.525 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:51.523+0000 7f0c26749640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T22:58:51.525 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-25T22:58:51.523+0000 7f0c26749640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T22:58:53.368 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:58:53.598 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T22:58:53.597+0000 7f30c0963640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T22:58:53.623 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T22:58:53.621+0000 7f30b8798640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:58:53.624 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:58:53.625+0000 7f7f49dd3640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T22:58:53.649 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:58:53.649+0000 7f7f41c08640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:58:53.672 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-25T22:58:53.672 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":7,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:58:52.560285+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:58:53.680 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:58:53.677+0000 7f38d320e640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T22:58:53.691 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-25T22:58:53.707 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:58:53.705+0000 7f38cb043640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:58:59.993 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:00.297 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-25T22:59:00.297 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":12,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:58:58.646821+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:00.315 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-25T22:59:00.315 INFO:tasks.ceph:Creating RBD pool 2024-04-25T22:59:00.315 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T22:59:00.719 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2024-04-25T22:59:00.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T22:59:01.733 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T22:59:01.755 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T22:59:01.755 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T22:59:01.756 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T22:59:01.758 INFO:tasks.ceph.mds.a:Started 2024-04-25T22:59:01.758 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T22:59:01.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:01.842 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-04-25T22:59:02.066 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:02.067 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":14,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:01.719145+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:58:56.581519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:59:00.664462+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:59:02.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:59:02.382 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T22:59:02.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:59:02.703 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-25T22:59:02.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:59:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:03.099 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6803/857639461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":857639461},{"type":"v1","addr":"172.21.15.43:6803","nonce":857639461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T22:59:03.099 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-04-25T22:59:03.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:03.416 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:02.726996+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:03.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:58:56.581519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:59:00.664462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:59:03.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:59:03.740 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T22:59:03.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:59:04.051 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-25T22:59:04.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T22:59:04.356 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:04.357 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-04-25T22:59:04.375 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T22:59:04.376 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T22:59:04.745 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-04-25T22:59:04.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T22:59:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-04-25T22:59:05.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T22:59:06.764 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 3 and data pool 4 2024-04-25T22:59:06.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:07.095 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:07.096 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":18,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:06.118810+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:07.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:07.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:07.426 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":18,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:06.118810+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:07.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T22:59:08.803 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T22:59:08.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T22:59:09.819 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T22:59:09.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:59:10.156 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:10.156 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:59:06.119108+0000","modified":"2024-04-25T22:59:09.146644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/857639461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":857639461},{"type":"v1","addr":"172.21.15.43:6803","nonce":857639461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-04-25T22:59:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T22:59:10.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:10.472 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:10.473 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:07.768159+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:10.492 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T22:59:10.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:10.803 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:10.819 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:59:10.508089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95108,"kb_used_data":1560,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020412,"statfs":{"total":289910292480,"available":289812901888,"internally_reserved":0,"allocated":1597440,"data_stored":1307278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762027"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757552+0000","last_change":"2024-04-25T22:59:04.757552+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757552+0000","last_undegraded":"2024-04-25T22:59:04.757552+0000","last_fullsized":"2024-04-25T22:59:04.757552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752942+0000","last_change":"2024-04-25T22:59:04.752942+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752942+0000","last_undegraded":"2024-04-25T22:59:04.752942+0000","last_fullsized":"2024-04-25T22:59:04.752942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754846+0000","last_change":"2024-04-25T22:59:04.754846+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754846+0000","last_undegraded":"2024-04-25T22:59:04.754846+0000","last_fullsized":"2024-04-25T22:59:04.754846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756358+0000","last_change":"2024-04-25T22:59:04.756358+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756358+0000","last_undegraded":"2024-04-25T22:59:04.756358+0000","last_fullsized":"2024-04-25T22:59:04.756358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756255+0000","last_change":"2024-04-25T22:59:04.756255+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756255+0000","last_undegraded":"2024-04-25T22:59:04.756255+0000","last_fullsized":"2024-04-25T22:59:04.756255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757650+0000","last_change":"2024-04-25T22:59:04.757650+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757650+0000","last_undegraded":"2024-04-25T22:59:04.757650+0000","last_fullsized":"2024-04-25T22:59:04.757650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757138+0000","last_change":"2024-04-25T22:59:04.757138+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757138+0000","last_undegraded":"2024-04-25T22:59:04.757138+0000","last_fullsized":"2024-04-25T22:59:04.757138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751167+0000","last_change":"2024-04-25T22:59:04.751167+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751167+0000","last_undegraded":"2024-04-25T22:59:04.751167+0000","last_fullsized":"2024-04-25T22:59:04.751167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756202+0000","last_change":"2024-04-25T22:59:04.756202+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756202+0000","last_undegraded":"2024-04-25T22:59:04.756202+0000","last_fullsized":"2024-04-25T22:59:04.756202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753325+0000","last_change":"2024-04-25T22:59:04.753325+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753325+0000","last_undegraded":"2024-04-25T22:59:04.753325+0000","last_fullsized":"2024-04-25T22:59:04.753325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754747+0000","last_change":"2024-04-25T22:59:04.754747+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754747+0000","last_undegraded":"2024-04-25T22:59:04.754747+0000","last_fullsized":"2024-04-25T22:59:04.754747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":216,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760374+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:04.760374+0000","last_peered":"2024-04-25T22:59:04.760374+0000","last_clean":"2024-04-25T22:59:04.760374+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:04.760374+0000","last_undegraded":"2024-04-25T22:59:04.760374+0000","last_fullsized":"2024-04-25T22:59:04.760374+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760799+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:04.760799+0000","last_peered":"2024-04-25T22:59:04.760799+0000","last_clean":"2024-04-25T22:59:04.760799+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:04.760799+0000","last_undegraded":"2024-04-25T22:59:04.760799+0000","last_fullsized":"2024-04-25T22:59:04.760799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750874+0000","last_change":"2024-04-25T22:59:04.750874+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750874+0000","last_undegraded":"2024-04-25T22:59:04.750874+0000","last_fullsized":"2024-04-25T22:59:04.750874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760227+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:04.760227+0000","last_peered":"2024-04-25T22:59:04.760227+0000","last_clean":"2024-04-25T22:59:04.760227+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:04.760227+0000","last_undegraded":"2024-04-25T22:59:04.760227+0000","last_fullsized":"2024-04-25T22:59:04.760227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750775+0000","last_change":"2024-04-25T22:59:04.750775+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750775+0000","last_undegraded":"2024-04-25T22:59:04.750775+0000","last_fullsized":"2024-04-25T22:59:04.750775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755283+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:04.755283+0000","last_peered":"2024-04-25T22:59:04.755283+0000","last_clean":"2024-04-25T22:59:04.755283+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:04.755283+0000","last_undegraded":"2024-04-25T22:59:04.755283+0000","last_fullsized":"2024-04-25T22:59:04.755283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753247+0000","last_change":"2024-04-25T22:59:04.753247+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753247+0000","last_undegraded":"2024-04-25T22:59:04.753247+0000","last_fullsized":"2024-04-25T22:59:04.753247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760434+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:04.760434+0000","last_peered":"2024-04-25T22:59:04.760434+0000","last_clean":"2024-04-25T22:59:04.760434+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:04.760434+0000","last_undegraded":"2024-04-25T22:59:04.760434+0000","last_fullsized":"2024-04-25T22:59:04.760434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756305+0000","last_change":"2024-04-25T22:59:04.756305+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756305+0000","last_undegraded":"2024-04-25T22:59:04.756305+0000","last_fullsized":"2024-04-25T22:59:04.756305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756383+0000","last_change":"2024-04-25T22:59:04.756383+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756383+0000","last_undegraded":"2024-04-25T22:59:04.756383+0000","last_fullsized":"2024-04-25T22:59:04.756383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755739+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:04.755739+0000","last_peered":"2024-04-25T22:59:04.755739+0000","last_clean":"2024-04-25T22:59:04.755739+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:04.755739+0000","last_undegraded":"2024-04-25T22:59:04.755739+0000","last_fullsized":"2024-04-25T22:59:04.755739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751012+0000","last_change":"2024-04-25T22:59:04.751012+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751012+0000","last_undegraded":"2024-04-25T22:59:04.751012+0000","last_fullsized":"2024-04-25T22:59:04.751012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.756123+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:04.756123+0000","last_peered":"2024-04-25T22:59:04.756123+0000","last_clean":"2024-04-25T22:59:04.756123+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:04.756123+0000","last_undegraded":"2024-04-25T22:59:04.756123+0000","last_fullsized":"2024-04-25T22:59:04.756123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751183+0000","last_change":"2024-04-25T22:59:04.751183+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751183+0000","last_undegraded":"2024-04-25T22:59:04.751183+0000","last_fullsized":"2024-04-25T22:59:04.751183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755669+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:04.755669+0000","last_peered":"2024-04-25T22:59:04.755669+0000","last_clean":"2024-04-25T22:59:04.755669+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:04.755669+0000","last_undegraded":"2024-04-25T22:59:04.755669+0000","last_fullsized":"2024-04-25T22:59:04.755669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751135+0000","last_change":"2024-04-25T22:59:04.751135+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751135+0000","last_undegraded":"2024-04-25T22:59:04.751135+0000","last_fullsized":"2024-04-25T22:59:04.751135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.761100+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:04.761100+0000","last_peered":"2024-04-25T22:59:04.761100+0000","last_clean":"2024-04-25T22:59:04.761100+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:04.761100+0000","last_undegraded":"2024-04-25T22:59:04.761100+0000","last_fullsized":"2024-04-25T22:59:04.761100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.758327+0000","last_change":"2024-04-25T22:59:04.758327+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.758327+0000","last_undegraded":"2024-04-25T22:59:04.758327+0000","last_fullsized":"2024-04-25T22:59:04.758327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753470+0000","last_change":"2024-04-25T22:59:04.753470+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753470+0000","last_undegraded":"2024-04-25T22:59:04.753470+0000","last_fullsized":"2024-04-25T22:59:04.753470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756469+0000","last_change":"2024-04-25T22:59:04.756469+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756469+0000","last_undegraded":"2024-04-25T22:59:04.756469+0000","last_fullsized":"2024-04-25T22:59:04.756469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752981+0000","last_change":"2024-04-25T22:59:04.752981+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752981+0000","last_undegraded":"2024-04-25T22:59:04.752981+0000","last_fullsized":"2024-04-25T22:59:04.752981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750954+0000","last_change":"2024-04-25T22:59:04.750954+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750954+0000","last_undegraded":"2024-04-25T22:59:04.750954+0000","last_fullsized":"2024-04-25T22:59:04.750954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752834+0000","last_change":"2024-04-25T22:59:04.752834+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752834+0000","last_undegraded":"2024-04-25T22:59:04.752834+0000","last_fullsized":"2024-04-25T22:59:04.752834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753229+0000","last_change":"2024-04-25T22:59:04.753229+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753229+0000","last_undegraded":"2024-04-25T22:59:04.753229+0000","last_fullsized":"2024-04-25T22:59:04.753229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.759472+0000","last_change":"2024-04-25T22:59:04.759472+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.759472+0000","last_undegraded":"2024-04-25T22:59:04.759472+0000","last_fullsized":"2024-04-25T22:59:04.759472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754875+0000","last_change":"2024-04-25T22:59:04.754875+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754875+0000","last_undegraded":"2024-04-25T22:59:04.754875+0000","last_fullsized":"2024-04-25T22:59:04.754875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753590+0000","last_change":"2024-04-25T22:59:04.753590+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753590+0000","last_undegraded":"2024-04-25T22:59:04.753590+0000","last_fullsized":"2024-04-25T22:59:04.753590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754065+0000","last_change":"2024-04-25T22:59:04.754065+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754065+0000","last_undegraded":"2024-04-25T22:59:04.754065+0000","last_fullsized":"2024-04-25T22:59:04.754065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":633922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":43554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:10.823 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:11.145 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:11.147 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:11.163 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:59:10.508089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95108,"kb_used_data":1560,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020412,"statfs":{"total":289910292480,"available":289812901888,"internally_reserved":0,"allocated":1597440,"data_stored":1307278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762027"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757552+0000","last_change":"2024-04-25T22:59:04.757552+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757552+0000","last_undegraded":"2024-04-25T22:59:04.757552+0000","last_fullsized":"2024-04-25T22:59:04.757552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752942+0000","last_change":"2024-04-25T22:59:04.752942+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752942+0000","last_undegraded":"2024-04-25T22:59:04.752942+0000","last_fullsized":"2024-04-25T22:59:04.752942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754846+0000","last_change":"2024-04-25T22:59:04.754846+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754846+0000","last_undegraded":"2024-04-25T22:59:04.754846+0000","last_fullsized":"2024-04-25T22:59:04.754846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756358+0000","last_change":"2024-04-25T22:59:04.756358+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756358+0000","last_undegraded":"2024-04-25T22:59:04.756358+0000","last_fullsized":"2024-04-25T22:59:04.756358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756255+0000","last_change":"2024-04-25T22:59:04.756255+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756255+0000","last_undegraded":"2024-04-25T22:59:04.756255+0000","last_fullsized":"2024-04-25T22:59:04.756255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757650+0000","last_change":"2024-04-25T22:59:04.757650+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757650+0000","last_undegraded":"2024-04-25T22:59:04.757650+0000","last_fullsized":"2024-04-25T22:59:04.757650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757138+0000","last_change":"2024-04-25T22:59:04.757138+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757138+0000","last_undegraded":"2024-04-25T22:59:04.757138+0000","last_fullsized":"2024-04-25T22:59:04.757138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751167+0000","last_change":"2024-04-25T22:59:04.751167+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751167+0000","last_undegraded":"2024-04-25T22:59:04.751167+0000","last_fullsized":"2024-04-25T22:59:04.751167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756202+0000","last_change":"2024-04-25T22:59:04.756202+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756202+0000","last_undegraded":"2024-04-25T22:59:04.756202+0000","last_fullsized":"2024-04-25T22:59:04.756202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753325+0000","last_change":"2024-04-25T22:59:04.753325+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753325+0000","last_undegraded":"2024-04-25T22:59:04.753325+0000","last_fullsized":"2024-04-25T22:59:04.753325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754747+0000","last_change":"2024-04-25T22:59:04.754747+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754747+0000","last_undegraded":"2024-04-25T22:59:04.754747+0000","last_fullsized":"2024-04-25T22:59:04.754747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":216,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760374+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:04.760374+0000","last_peered":"2024-04-25T22:59:04.760374+0000","last_clean":"2024-04-25T22:59:04.760374+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:04.760374+0000","last_undegraded":"2024-04-25T22:59:04.760374+0000","last_fullsized":"2024-04-25T22:59:04.760374+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760799+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:04.760799+0000","last_peered":"2024-04-25T22:59:04.760799+0000","last_clean":"2024-04-25T22:59:04.760799+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:04.760799+0000","last_undegraded":"2024-04-25T22:59:04.760799+0000","last_fullsized":"2024-04-25T22:59:04.760799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750874+0000","last_change":"2024-04-25T22:59:04.750874+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750874+0000","last_undegraded":"2024-04-25T22:59:04.750874+0000","last_fullsized":"2024-04-25T22:59:04.750874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760227+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:04.760227+0000","last_peered":"2024-04-25T22:59:04.760227+0000","last_clean":"2024-04-25T22:59:04.760227+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:04.760227+0000","last_undegraded":"2024-04-25T22:59:04.760227+0000","last_fullsized":"2024-04-25T22:59:04.760227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750775+0000","last_change":"2024-04-25T22:59:04.750775+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750775+0000","last_undegraded":"2024-04-25T22:59:04.750775+0000","last_fullsized":"2024-04-25T22:59:04.750775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755283+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:04.755283+0000","last_peered":"2024-04-25T22:59:04.755283+0000","last_clean":"2024-04-25T22:59:04.755283+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:04.755283+0000","last_undegraded":"2024-04-25T22:59:04.755283+0000","last_fullsized":"2024-04-25T22:59:04.755283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753247+0000","last_change":"2024-04-25T22:59:04.753247+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753247+0000","last_undegraded":"2024-04-25T22:59:04.753247+0000","last_fullsized":"2024-04-25T22:59:04.753247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760434+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:04.760434+0000","last_peered":"2024-04-25T22:59:04.760434+0000","last_clean":"2024-04-25T22:59:04.760434+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:04.760434+0000","last_undegraded":"2024-04-25T22:59:04.760434+0000","last_fullsized":"2024-04-25T22:59:04.760434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756305+0000","last_change":"2024-04-25T22:59:04.756305+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756305+0000","last_undegraded":"2024-04-25T22:59:04.756305+0000","last_fullsized":"2024-04-25T22:59:04.756305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756383+0000","last_change":"2024-04-25T22:59:04.756383+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756383+0000","last_undegraded":"2024-04-25T22:59:04.756383+0000","last_fullsized":"2024-04-25T22:59:04.756383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755739+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:04.755739+0000","last_peered":"2024-04-25T22:59:04.755739+0000","last_clean":"2024-04-25T22:59:04.755739+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:04.755739+0000","last_undegraded":"2024-04-25T22:59:04.755739+0000","last_fullsized":"2024-04-25T22:59:04.755739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751012+0000","last_change":"2024-04-25T22:59:04.751012+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751012+0000","last_undegraded":"2024-04-25T22:59:04.751012+0000","last_fullsized":"2024-04-25T22:59:04.751012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.756123+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:04.756123+0000","last_peered":"2024-04-25T22:59:04.756123+0000","last_clean":"2024-04-25T22:59:04.756123+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:04.756123+0000","last_undegraded":"2024-04-25T22:59:04.756123+0000","last_fullsized":"2024-04-25T22:59:04.756123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751183+0000","last_change":"2024-04-25T22:59:04.751183+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751183+0000","last_undegraded":"2024-04-25T22:59:04.751183+0000","last_fullsized":"2024-04-25T22:59:04.751183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755669+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:04.755669+0000","last_peered":"2024-04-25T22:59:04.755669+0000","last_clean":"2024-04-25T22:59:04.755669+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:04.755669+0000","last_undegraded":"2024-04-25T22:59:04.755669+0000","last_fullsized":"2024-04-25T22:59:04.755669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751135+0000","last_change":"2024-04-25T22:59:04.751135+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751135+0000","last_undegraded":"2024-04-25T22:59:04.751135+0000","last_fullsized":"2024-04-25T22:59:04.751135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.761100+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:04.761100+0000","last_peered":"2024-04-25T22:59:04.761100+0000","last_clean":"2024-04-25T22:59:04.761100+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:04.761100+0000","last_undegraded":"2024-04-25T22:59:04.761100+0000","last_fullsized":"2024-04-25T22:59:04.761100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.758327+0000","last_change":"2024-04-25T22:59:04.758327+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.758327+0000","last_undegraded":"2024-04-25T22:59:04.758327+0000","last_fullsized":"2024-04-25T22:59:04.758327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753470+0000","last_change":"2024-04-25T22:59:04.753470+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753470+0000","last_undegraded":"2024-04-25T22:59:04.753470+0000","last_fullsized":"2024-04-25T22:59:04.753470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756469+0000","last_change":"2024-04-25T22:59:04.756469+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756469+0000","last_undegraded":"2024-04-25T22:59:04.756469+0000","last_fullsized":"2024-04-25T22:59:04.756469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752981+0000","last_change":"2024-04-25T22:59:04.752981+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752981+0000","last_undegraded":"2024-04-25T22:59:04.752981+0000","last_fullsized":"2024-04-25T22:59:04.752981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750954+0000","last_change":"2024-04-25T22:59:04.750954+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750954+0000","last_undegraded":"2024-04-25T22:59:04.750954+0000","last_fullsized":"2024-04-25T22:59:04.750954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752834+0000","last_change":"2024-04-25T22:59:04.752834+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752834+0000","last_undegraded":"2024-04-25T22:59:04.752834+0000","last_fullsized":"2024-04-25T22:59:04.752834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753229+0000","last_change":"2024-04-25T22:59:04.753229+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753229+0000","last_undegraded":"2024-04-25T22:59:04.753229+0000","last_fullsized":"2024-04-25T22:59:04.753229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.759472+0000","last_change":"2024-04-25T22:59:04.759472+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.759472+0000","last_undegraded":"2024-04-25T22:59:04.759472+0000","last_fullsized":"2024-04-25T22:59:04.759472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754875+0000","last_change":"2024-04-25T22:59:04.754875+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754875+0000","last_undegraded":"2024-04-25T22:59:04.754875+0000","last_fullsized":"2024-04-25T22:59:04.754875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753590+0000","last_change":"2024-04-25T22:59:04.753590+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753590+0000","last_undegraded":"2024-04-25T22:59:04.753590+0000","last_fullsized":"2024-04-25T22:59:04.753590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754065+0000","last_change":"2024-04-25T22:59:04.754065+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754065+0000","last_undegraded":"2024-04-25T22:59:04.754065+0000","last_fullsized":"2024-04-25T22:59:04.754065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":633922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":43554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:11.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:11.519 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:11.521 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:11.539 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:59:10.508089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95108,"kb_used_data":1560,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020412,"statfs":{"total":289910292480,"available":289812901888,"internally_reserved":0,"allocated":1597440,"data_stored":1307278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762027"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757552+0000","last_change":"2024-04-25T22:59:04.757552+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757552+0000","last_undegraded":"2024-04-25T22:59:04.757552+0000","last_fullsized":"2024-04-25T22:59:04.757552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752942+0000","last_change":"2024-04-25T22:59:04.752942+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752942+0000","last_undegraded":"2024-04-25T22:59:04.752942+0000","last_fullsized":"2024-04-25T22:59:04.752942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754846+0000","last_change":"2024-04-25T22:59:04.754846+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754846+0000","last_undegraded":"2024-04-25T22:59:04.754846+0000","last_fullsized":"2024-04-25T22:59:04.754846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756358+0000","last_change":"2024-04-25T22:59:04.756358+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756358+0000","last_undegraded":"2024-04-25T22:59:04.756358+0000","last_fullsized":"2024-04-25T22:59:04.756358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756255+0000","last_change":"2024-04-25T22:59:04.756255+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756255+0000","last_undegraded":"2024-04-25T22:59:04.756255+0000","last_fullsized":"2024-04-25T22:59:04.756255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757650+0000","last_change":"2024-04-25T22:59:04.757650+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757650+0000","last_undegraded":"2024-04-25T22:59:04.757650+0000","last_fullsized":"2024-04-25T22:59:04.757650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757138+0000","last_change":"2024-04-25T22:59:04.757138+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757138+0000","last_undegraded":"2024-04-25T22:59:04.757138+0000","last_fullsized":"2024-04-25T22:59:04.757138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751167+0000","last_change":"2024-04-25T22:59:04.751167+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751167+0000","last_undegraded":"2024-04-25T22:59:04.751167+0000","last_fullsized":"2024-04-25T22:59:04.751167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756202+0000","last_change":"2024-04-25T22:59:04.756202+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756202+0000","last_undegraded":"2024-04-25T22:59:04.756202+0000","last_fullsized":"2024-04-25T22:59:04.756202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753325+0000","last_change":"2024-04-25T22:59:04.753325+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753325+0000","last_undegraded":"2024-04-25T22:59:04.753325+0000","last_fullsized":"2024-04-25T22:59:04.753325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754747+0000","last_change":"2024-04-25T22:59:04.754747+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754747+0000","last_undegraded":"2024-04-25T22:59:04.754747+0000","last_fullsized":"2024-04-25T22:59:04.754747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":216,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760374+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:04.760374+0000","last_peered":"2024-04-25T22:59:04.760374+0000","last_clean":"2024-04-25T22:59:04.760374+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:04.760374+0000","last_undegraded":"2024-04-25T22:59:04.760374+0000","last_fullsized":"2024-04-25T22:59:04.760374+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760799+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:04.760799+0000","last_peered":"2024-04-25T22:59:04.760799+0000","last_clean":"2024-04-25T22:59:04.760799+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:04.760799+0000","last_undegraded":"2024-04-25T22:59:04.760799+0000","last_fullsized":"2024-04-25T22:59:04.760799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750874+0000","last_change":"2024-04-25T22:59:04.750874+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750874+0000","last_undegraded":"2024-04-25T22:59:04.750874+0000","last_fullsized":"2024-04-25T22:59:04.750874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760227+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:04.760227+0000","last_peered":"2024-04-25T22:59:04.760227+0000","last_clean":"2024-04-25T22:59:04.760227+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:04.760227+0000","last_undegraded":"2024-04-25T22:59:04.760227+0000","last_fullsized":"2024-04-25T22:59:04.760227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750775+0000","last_change":"2024-04-25T22:59:04.750775+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750775+0000","last_undegraded":"2024-04-25T22:59:04.750775+0000","last_fullsized":"2024-04-25T22:59:04.750775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755283+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:04.755283+0000","last_peered":"2024-04-25T22:59:04.755283+0000","last_clean":"2024-04-25T22:59:04.755283+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:04.755283+0000","last_undegraded":"2024-04-25T22:59:04.755283+0000","last_fullsized":"2024-04-25T22:59:04.755283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753247+0000","last_change":"2024-04-25T22:59:04.753247+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753247+0000","last_undegraded":"2024-04-25T22:59:04.753247+0000","last_fullsized":"2024-04-25T22:59:04.753247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760434+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:04.760434+0000","last_peered":"2024-04-25T22:59:04.760434+0000","last_clean":"2024-04-25T22:59:04.760434+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:04.760434+0000","last_undegraded":"2024-04-25T22:59:04.760434+0000","last_fullsized":"2024-04-25T22:59:04.760434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756305+0000","last_change":"2024-04-25T22:59:04.756305+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756305+0000","last_undegraded":"2024-04-25T22:59:04.756305+0000","last_fullsized":"2024-04-25T22:59:04.756305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756383+0000","last_change":"2024-04-25T22:59:04.756383+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756383+0000","last_undegraded":"2024-04-25T22:59:04.756383+0000","last_fullsized":"2024-04-25T22:59:04.756383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755739+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:04.755739+0000","last_peered":"2024-04-25T22:59:04.755739+0000","last_clean":"2024-04-25T22:59:04.755739+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:04.755739+0000","last_undegraded":"2024-04-25T22:59:04.755739+0000","last_fullsized":"2024-04-25T22:59:04.755739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751012+0000","last_change":"2024-04-25T22:59:04.751012+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751012+0000","last_undegraded":"2024-04-25T22:59:04.751012+0000","last_fullsized":"2024-04-25T22:59:04.751012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.756123+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:04.756123+0000","last_peered":"2024-04-25T22:59:04.756123+0000","last_clean":"2024-04-25T22:59:04.756123+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:04.756123+0000","last_undegraded":"2024-04-25T22:59:04.756123+0000","last_fullsized":"2024-04-25T22:59:04.756123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751183+0000","last_change":"2024-04-25T22:59:04.751183+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751183+0000","last_undegraded":"2024-04-25T22:59:04.751183+0000","last_fullsized":"2024-04-25T22:59:04.751183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755669+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:04.755669+0000","last_peered":"2024-04-25T22:59:04.755669+0000","last_clean":"2024-04-25T22:59:04.755669+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:04.755669+0000","last_undegraded":"2024-04-25T22:59:04.755669+0000","last_fullsized":"2024-04-25T22:59:04.755669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751135+0000","last_change":"2024-04-25T22:59:04.751135+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751135+0000","last_undegraded":"2024-04-25T22:59:04.751135+0000","last_fullsized":"2024-04-25T22:59:04.751135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.761100+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:04.761100+0000","last_peered":"2024-04-25T22:59:04.761100+0000","last_clean":"2024-04-25T22:59:04.761100+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:04.761100+0000","last_undegraded":"2024-04-25T22:59:04.761100+0000","last_fullsized":"2024-04-25T22:59:04.761100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.758327+0000","last_change":"2024-04-25T22:59:04.758327+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.758327+0000","last_undegraded":"2024-04-25T22:59:04.758327+0000","last_fullsized":"2024-04-25T22:59:04.758327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753470+0000","last_change":"2024-04-25T22:59:04.753470+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753470+0000","last_undegraded":"2024-04-25T22:59:04.753470+0000","last_fullsized":"2024-04-25T22:59:04.753470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756469+0000","last_change":"2024-04-25T22:59:04.756469+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756469+0000","last_undegraded":"2024-04-25T22:59:04.756469+0000","last_fullsized":"2024-04-25T22:59:04.756469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752981+0000","last_change":"2024-04-25T22:59:04.752981+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752981+0000","last_undegraded":"2024-04-25T22:59:04.752981+0000","last_fullsized":"2024-04-25T22:59:04.752981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750954+0000","last_change":"2024-04-25T22:59:04.750954+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750954+0000","last_undegraded":"2024-04-25T22:59:04.750954+0000","last_fullsized":"2024-04-25T22:59:04.750954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752834+0000","last_change":"2024-04-25T22:59:04.752834+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752834+0000","last_undegraded":"2024-04-25T22:59:04.752834+0000","last_fullsized":"2024-04-25T22:59:04.752834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753229+0000","last_change":"2024-04-25T22:59:04.753229+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753229+0000","last_undegraded":"2024-04-25T22:59:04.753229+0000","last_fullsized":"2024-04-25T22:59:04.753229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.759472+0000","last_change":"2024-04-25T22:59:04.759472+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.759472+0000","last_undegraded":"2024-04-25T22:59:04.759472+0000","last_fullsized":"2024-04-25T22:59:04.759472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754875+0000","last_change":"2024-04-25T22:59:04.754875+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754875+0000","last_undegraded":"2024-04-25T22:59:04.754875+0000","last_fullsized":"2024-04-25T22:59:04.754875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753590+0000","last_change":"2024-04-25T22:59:04.753590+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753590+0000","last_undegraded":"2024-04-25T22:59:04.753590+0000","last_fullsized":"2024-04-25T22:59:04.753590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754065+0000","last_change":"2024-04-25T22:59:04.754065+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754065+0000","last_undegraded":"2024-04-25T22:59:04.754065+0000","last_fullsized":"2024-04-25T22:59:04.754065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":633922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":43554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:11.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-25T22:59:11.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-25T22:59:11.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-25T22:59:11.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-25T22:59:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-25T22:59:11.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-25T22:59:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-25T22:59:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.757552+0000', 'last_change': '2024-04-25T22:59:04.757552+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.757552+0000', 'last_undegraded': '2024-04-25T22:59:04.757552+0000', 'last_fullsized': '2024-04-25T22:59:04.757552+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.752942+0000', 'last_change': '2024-04-25T22:59:04.752942+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.752942+0000', 'last_undegraded': '2024-04-25T22:59:04.752942+0000', 'last_fullsized': '2024-04-25T22:59:04.752942+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.754846+0000', 'last_change': '2024-04-25T22:59:04.754846+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.754846+0000', 'last_undegraded': '2024-04-25T22:59:04.754846+0000', 'last_fullsized': '2024-04-25T22:59:04.754846+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.756358+0000', 'last_change': '2024-04-25T22:59:04.756358+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.756358+0000', 'last_undegraded': '2024-04-25T22:59:04.756358+0000', 'last_fullsized': '2024-04-25T22:59:04.756358+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-25T22:59:11.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.756255+0000', 'last_change': '2024-04-25T22:59:04.756255+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.756255+0000', 'last_undegraded': '2024-04-25T22:59:04.756255+0000', 'last_fullsized': '2024-04-25T22:59:04.756255+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.753364+0000', 'last_change': '2024-04-25T22:59:04.753364+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.753364+0000', 'last_undegraded': '2024-04-25T22:59:04.753364+0000', 'last_fullsized': '2024-04-25T22:59:04.753364+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.757650+0000', 'last_change': '2024-04-25T22:59:04.757650+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.757650+0000', 'last_undegraded': '2024-04-25T22:59:04.757650+0000', 'last_fullsized': '2024-04-25T22:59:04.757650+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.757138+0000', 'last_change': '2024-04-25T22:59:04.757138+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.757138+0000', 'last_undegraded': '2024-04-25T22:59:04.757138+0000', 'last_fullsized': '2024-04-25T22:59:04.757138+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.751167+0000', 'last_change': '2024-04-25T22:59:04.751167+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.751167+0000', 'last_undegraded': '2024-04-25T22:59:04.751167+0000', 'last_fullsized': '2024-04-25T22:59:04.751167+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.756202+0000', 'last_change': '2024-04-25T22:59:04.756202+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.756202+0000', 'last_undegraded': '2024-04-25T22:59:04.756202+0000', 'last_fullsized': '2024-04-25T22:59:04.756202+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T22:59:11.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.753325+0000', 'last_change': '2024-04-25T22:59:04.753325+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.753325+0000', 'last_undegraded': '2024-04-25T22:59:04.753325+0000', 'last_fullsized': '2024-04-25T22:59:04.753325+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.754747+0000', 'last_change': '2024-04-25T22:59:04.754747+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.754747+0000', 'last_undegraded': '2024-04-25T22:59:04.754747+0000', 'last_fullsized': '2024-04-25T22:59:04.754747+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.750874+0000', 'last_change': '2024-04-25T22:59:04.750874+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.750874+0000', 'last_undegraded': '2024-04-25T22:59:04.750874+0000', 'last_fullsized': '2024-04-25T22:59:04.750874+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.750775+0000', 'last_change': '2024-04-25T22:59:04.750775+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.750775+0000', 'last_undegraded': '2024-04-25T22:59:04.750775+0000', 'last_fullsized': '2024-04-25T22:59:04.750775+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.753247+0000', 'last_change': '2024-04-25T22:59:04.753247+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.753247+0000', 'last_undegraded': '2024-04-25T22:59:04.753247+0000', 'last_fullsized': '2024-04-25T22:59:04.753247+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-25T22:59:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.756305+0000', 'last_change': '2024-04-25T22:59:04.756305+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.756305+0000', 'last_undegraded': '2024-04-25T22:59:04.756305+0000', 'last_fullsized': '2024-04-25T22:59:04.756305+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.756383+0000', 'last_change': '2024-04-25T22:59:04.756383+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.756383+0000', 'last_undegraded': '2024-04-25T22:59:04.756383+0000', 'last_fullsized': '2024-04-25T22:59:04.756383+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.751012+0000', 'last_change': '2024-04-25T22:59:04.751012+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.751012+0000', 'last_undegraded': '2024-04-25T22:59:04.751012+0000', 'last_fullsized': '2024-04-25T22:59:04.751012+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.751183+0000', 'last_change': '2024-04-25T22:59:04.751183+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.751183+0000', 'last_undegraded': '2024-04-25T22:59:04.751183+0000', 'last_fullsized': '2024-04-25T22:59:04.751183+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.751135+0000', 'last_change': '2024-04-25T22:59:04.751135+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.751135+0000', 'last_undegraded': '2024-04-25T22:59:04.751135+0000', 'last_fullsized': '2024-04-25T22:59:04.751135+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-25T22:59:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.758327+0000', 'last_change': '2024-04-25T22:59:04.758327+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.758327+0000', 'last_undegraded': '2024-04-25T22:59:04.758327+0000', 'last_fullsized': '2024-04-25T22:59:04.758327+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.753470+0000', 'last_change': '2024-04-25T22:59:04.753470+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.753470+0000', 'last_undegraded': '2024-04-25T22:59:04.753470+0000', 'last_fullsized': '2024-04-25T22:59:04.753470+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.756469+0000', 'last_change': '2024-04-25T22:59:04.756469+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.756469+0000', 'last_undegraded': '2024-04-25T22:59:04.756469+0000', 'last_fullsized': '2024-04-25T22:59:04.756469+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.752981+0000', 'last_change': '2024-04-25T22:59:04.752981+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.752981+0000', 'last_undegraded': '2024-04-25T22:59:04.752981+0000', 'last_fullsized': '2024-04-25T22:59:04.752981+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T22:59:11.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.750954+0000', 'last_change': '2024-04-25T22:59:04.750954+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.750954+0000', 'last_undegraded': '2024-04-25T22:59:04.750954+0000', 'last_fullsized': '2024-04-25T22:59:04.750954+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.752834+0000', 'last_change': '2024-04-25T22:59:04.752834+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.752834+0000', 'last_undegraded': '2024-04-25T22:59:04.752834+0000', 'last_fullsized': '2024-04-25T22:59:04.752834+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T22:59:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.753364+0000', 'last_change': '2024-04-25T22:59:04.753364+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.753364+0000', 'last_undegraded': '2024-04-25T22:59:04.753364+0000', 'last_fullsized': '2024-04-25T22:59:04.753364+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.753229+0000', 'last_change': '2024-04-25T22:59:04.753229+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.753229+0000', 'last_undegraded': '2024-04-25T22:59:04.753229+0000', 'last_fullsized': '2024-04-25T22:59:04.753229+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-25T22:59:11.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.759472+0000', 'last_change': '2024-04-25T22:59:04.759472+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.759472+0000', 'last_undegraded': '2024-04-25T22:59:04.759472+0000', 'last_fullsized': '2024-04-25T22:59:04.759472+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.754875+0000', 'last_change': '2024-04-25T22:59:04.754875+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.754875+0000', 'last_undegraded': '2024-04-25T22:59:04.754875+0000', 'last_fullsized': '2024-04-25T22:59:04.754875+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.753590+0000', 'last_change': '2024-04-25T22:59:04.753590+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.753590+0000', 'last_undegraded': '2024-04-25T22:59:04.753590+0000', 'last_fullsized': '2024-04-25T22:59:04.753590+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:59:05.744631+0000', 'last_change': '2024-04-25T22:59:05.744631+0000', 'last_active': '2024-04-25T22:59:05.744631+0000', 'last_peered': '2024-04-25T22:59:05.744631+0000', 'last_clean': '2024-04-25T22:59:05.744631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:05.744631+0000', 'last_undegraded': '2024-04-25T22:59:05.744631+0000', 'last_fullsized': '2024-04-25T22:59:05.744631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:05.744631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-25T22:59:11.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:59:04.754065+0000', 'last_change': '2024-04-25T22:59:04.754065+0000', 'last_active': '2024-04-25T22:59:04.735940+0000', 'last_peered': '2024-04-25T22:59:04.735940+0000', 'last_clean': '2024-04-25T22:59:04.735940+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:59:04.754065+0000', 'last_undegraded': '2024-04-25T22:59:04.754065+0000', 'last_fullsized': '2024-04-25T22:59:04.754065+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'last_clean_scrub_stamp': '2024-04-25T22:59:04.735940+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:59:11.561 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:59:11.938 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:11.938 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1714085934,"num_in_osds":3,"osd_in_since":1714085926,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":97390592,"bytes_avail":289812901888,"bytes_total":289910292480,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4239}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-25T22:58:45.415194+0000","services":{}},"progress_events":{}} 2024-04-25T22:59:11.955 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T22:59:11.955 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:12.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:12.248 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:12.264 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:59:10.508089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95108,"kb_used_data":1560,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020412,"statfs":{"total":289910292480,"available":289812901888,"internally_reserved":0,"allocated":1597440,"data_stored":1307278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762027"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757552+0000","last_change":"2024-04-25T22:59:04.757552+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757552+0000","last_undegraded":"2024-04-25T22:59:04.757552+0000","last_fullsized":"2024-04-25T22:59:04.757552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752942+0000","last_change":"2024-04-25T22:59:04.752942+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752942+0000","last_undegraded":"2024-04-25T22:59:04.752942+0000","last_fullsized":"2024-04-25T22:59:04.752942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754846+0000","last_change":"2024-04-25T22:59:04.754846+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754846+0000","last_undegraded":"2024-04-25T22:59:04.754846+0000","last_fullsized":"2024-04-25T22:59:04.754846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756358+0000","last_change":"2024-04-25T22:59:04.756358+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756358+0000","last_undegraded":"2024-04-25T22:59:04.756358+0000","last_fullsized":"2024-04-25T22:59:04.756358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756255+0000","last_change":"2024-04-25T22:59:04.756255+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756255+0000","last_undegraded":"2024-04-25T22:59:04.756255+0000","last_fullsized":"2024-04-25T22:59:04.756255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757650+0000","last_change":"2024-04-25T22:59:04.757650+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757650+0000","last_undegraded":"2024-04-25T22:59:04.757650+0000","last_fullsized":"2024-04-25T22:59:04.757650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.757138+0000","last_change":"2024-04-25T22:59:04.757138+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.757138+0000","last_undegraded":"2024-04-25T22:59:04.757138+0000","last_fullsized":"2024-04-25T22:59:04.757138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751167+0000","last_change":"2024-04-25T22:59:04.751167+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751167+0000","last_undegraded":"2024-04-25T22:59:04.751167+0000","last_fullsized":"2024-04-25T22:59:04.751167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756202+0000","last_change":"2024-04-25T22:59:04.756202+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756202+0000","last_undegraded":"2024-04-25T22:59:04.756202+0000","last_fullsized":"2024-04-25T22:59:04.756202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753325+0000","last_change":"2024-04-25T22:59:04.753325+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753325+0000","last_undegraded":"2024-04-25T22:59:04.753325+0000","last_fullsized":"2024-04-25T22:59:04.753325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754747+0000","last_change":"2024-04-25T22:59:04.754747+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754747+0000","last_undegraded":"2024-04-25T22:59:04.754747+0000","last_fullsized":"2024-04-25T22:59:04.754747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":216,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760374+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:04.760374+0000","last_peered":"2024-04-25T22:59:04.760374+0000","last_clean":"2024-04-25T22:59:04.760374+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:04.760374+0000","last_undegraded":"2024-04-25T22:59:04.760374+0000","last_fullsized":"2024-04-25T22:59:04.760374+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760799+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:04.760799+0000","last_peered":"2024-04-25T22:59:04.760799+0000","last_clean":"2024-04-25T22:59:04.760799+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:04.760799+0000","last_undegraded":"2024-04-25T22:59:04.760799+0000","last_fullsized":"2024-04-25T22:59:04.760799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750874+0000","last_change":"2024-04-25T22:59:04.750874+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750874+0000","last_undegraded":"2024-04-25T22:59:04.750874+0000","last_fullsized":"2024-04-25T22:59:04.750874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760227+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:04.760227+0000","last_peered":"2024-04-25T22:59:04.760227+0000","last_clean":"2024-04-25T22:59:04.760227+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:04.760227+0000","last_undegraded":"2024-04-25T22:59:04.760227+0000","last_fullsized":"2024-04-25T22:59:04.760227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750775+0000","last_change":"2024-04-25T22:59:04.750775+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750775+0000","last_undegraded":"2024-04-25T22:59:04.750775+0000","last_fullsized":"2024-04-25T22:59:04.750775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755283+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:04.755283+0000","last_peered":"2024-04-25T22:59:04.755283+0000","last_clean":"2024-04-25T22:59:04.755283+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:04.755283+0000","last_undegraded":"2024-04-25T22:59:04.755283+0000","last_fullsized":"2024-04-25T22:59:04.755283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753247+0000","last_change":"2024-04-25T22:59:04.753247+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753247+0000","last_undegraded":"2024-04-25T22:59:04.753247+0000","last_fullsized":"2024-04-25T22:59:04.753247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.760434+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:04.760434+0000","last_peered":"2024-04-25T22:59:04.760434+0000","last_clean":"2024-04-25T22:59:04.760434+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:04.760434+0000","last_undegraded":"2024-04-25T22:59:04.760434+0000","last_fullsized":"2024-04-25T22:59:04.760434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756305+0000","last_change":"2024-04-25T22:59:04.756305+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756305+0000","last_undegraded":"2024-04-25T22:59:04.756305+0000","last_fullsized":"2024-04-25T22:59:04.756305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756383+0000","last_change":"2024-04-25T22:59:04.756383+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756383+0000","last_undegraded":"2024-04-25T22:59:04.756383+0000","last_fullsized":"2024-04-25T22:59:04.756383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755739+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:04.755739+0000","last_peered":"2024-04-25T22:59:04.755739+0000","last_clean":"2024-04-25T22:59:04.755739+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:04.755739+0000","last_undegraded":"2024-04-25T22:59:04.755739+0000","last_fullsized":"2024-04-25T22:59:04.755739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751012+0000","last_change":"2024-04-25T22:59:04.751012+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751012+0000","last_undegraded":"2024-04-25T22:59:04.751012+0000","last_fullsized":"2024-04-25T22:59:04.751012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.756123+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:04.756123+0000","last_peered":"2024-04-25T22:59:04.756123+0000","last_clean":"2024-04-25T22:59:04.756123+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:04.756123+0000","last_undegraded":"2024-04-25T22:59:04.756123+0000","last_fullsized":"2024-04-25T22:59:04.756123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751183+0000","last_change":"2024-04-25T22:59:04.751183+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751183+0000","last_undegraded":"2024-04-25T22:59:04.751183+0000","last_fullsized":"2024-04-25T22:59:04.751183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.755669+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:04.755669+0000","last_peered":"2024-04-25T22:59:04.755669+0000","last_clean":"2024-04-25T22:59:04.755669+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:04.755669+0000","last_undegraded":"2024-04-25T22:59:04.755669+0000","last_fullsized":"2024-04-25T22:59:04.755669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.751135+0000","last_change":"2024-04-25T22:59:04.751135+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.751135+0000","last_undegraded":"2024-04-25T22:59:04.751135+0000","last_fullsized":"2024-04-25T22:59:04.751135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:59:04.761100+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:04.761100+0000","last_peered":"2024-04-25T22:59:04.761100+0000","last_clean":"2024-04-25T22:59:04.761100+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:04.761100+0000","last_undegraded":"2024-04-25T22:59:04.761100+0000","last_fullsized":"2024-04-25T22:59:04.761100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.758327+0000","last_change":"2024-04-25T22:59:04.758327+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.758327+0000","last_undegraded":"2024-04-25T22:59:04.758327+0000","last_fullsized":"2024-04-25T22:59:04.758327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753470+0000","last_change":"2024-04-25T22:59:04.753470+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753470+0000","last_undegraded":"2024-04-25T22:59:04.753470+0000","last_fullsized":"2024-04-25T22:59:04.753470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.756469+0000","last_change":"2024-04-25T22:59:04.756469+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.756469+0000","last_undegraded":"2024-04-25T22:59:04.756469+0000","last_fullsized":"2024-04-25T22:59:04.756469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752981+0000","last_change":"2024-04-25T22:59:04.752981+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752981+0000","last_undegraded":"2024-04-25T22:59:04.752981+0000","last_fullsized":"2024-04-25T22:59:04.752981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.750954+0000","last_change":"2024-04-25T22:59:04.750954+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.750954+0000","last_undegraded":"2024-04-25T22:59:04.750954+0000","last_fullsized":"2024-04-25T22:59:04.750954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.752834+0000","last_change":"2024-04-25T22:59:04.752834+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.752834+0000","last_undegraded":"2024-04-25T22:59:04.752834+0000","last_fullsized":"2024-04-25T22:59:04.752834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753364+0000","last_change":"2024-04-25T22:59:04.753364+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753364+0000","last_undegraded":"2024-04-25T22:59:04.753364+0000","last_fullsized":"2024-04-25T22:59:04.753364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753229+0000","last_change":"2024-04-25T22:59:04.753229+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753229+0000","last_undegraded":"2024-04-25T22:59:04.753229+0000","last_fullsized":"2024-04-25T22:59:04.753229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.759472+0000","last_change":"2024-04-25T22:59:04.759472+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.759472+0000","last_undegraded":"2024-04-25T22:59:04.759472+0000","last_fullsized":"2024-04-25T22:59:04.759472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754875+0000","last_change":"2024-04-25T22:59:04.754875+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754875+0000","last_undegraded":"2024-04-25T22:59:04.754875+0000","last_fullsized":"2024-04-25T22:59:04.754875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.753590+0000","last_change":"2024-04-25T22:59:04.753590+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.753590+0000","last_undegraded":"2024-04-25T22:59:04.753590+0000","last_fullsized":"2024-04-25T22:59:04.753590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:59:05.744631+0000","last_change":"2024-04-25T22:59:05.744631+0000","last_active":"2024-04-25T22:59:05.744631+0000","last_peered":"2024-04-25T22:59:05.744631+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:05.744631+0000","last_undegraded":"2024-04-25T22:59:05.744631+0000","last_fullsized":"2024-04-25T22:59:05.744631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:59:04.754065+0000","last_change":"2024-04-25T22:59:04.754065+0000","last_active":"2024-04-25T22:59:04.735940+0000","last_peered":"2024-04-25T22:59:04.735940+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:59:04.754065+0000","last_undegraded":"2024-04-25T22:59:04.754065+0000","last_fullsized":"2024-04-25T22:59:04.754065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":633922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":43554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:15.272 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:15.599 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:15.601 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:15.619 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-25T22:59:14.509515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95260,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020260,"statfs":{"total":289910292480,"available":289812746240,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002645"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786579+0000","last_change":"2024-04-25T22:59:06.803693+0000","last_active":"2024-04-25T22:59:07.786579+0000","last_peered":"2024-04-25T22:59:07.786579+0000","last_clean":"2024-04-25T22:59:07.786579+0000","last_became_active":"2024-04-25T22:59:06.802949+0000","last_became_peered":"2024-04-25T22:59:06.802949+0000","last_unstale":"2024-04-25T22:59:07.786579+0000","last_undegraded":"2024-04-25T22:59:07.786579+0000","last_fullsized":"2024-04-25T22:59:07.786579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786674+0000","last_change":"2024-04-25T22:59:06.798862+0000","last_active":"2024-04-25T22:59:07.786674+0000","last_peered":"2024-04-25T22:59:07.786674+0000","last_clean":"2024-04-25T22:59:07.786674+0000","last_became_active":"2024-04-25T22:59:06.798150+0000","last_became_peered":"2024-04-25T22:59:06.798150+0000","last_unstale":"2024-04-25T22:59:07.786674+0000","last_undegraded":"2024-04-25T22:59:07.786674+0000","last_fullsized":"2024-04-25T22:59:07.786674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773768+0000","last_change":"2024-04-25T22:59:06.801047+0000","last_active":"2024-04-25T22:59:08.773768+0000","last_peered":"2024-04-25T22:59:08.773768+0000","last_clean":"2024-04-25T22:59:08.773768+0000","last_became_active":"2024-04-25T22:59:06.797208+0000","last_became_peered":"2024-04-25T22:59:06.797208+0000","last_unstale":"2024-04-25T22:59:08.773768+0000","last_undegraded":"2024-04-25T22:59:08.773768+0000","last_fullsized":"2024-04-25T22:59:08.773768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773795+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T22:59:08.773795+0000","last_peered":"2024-04-25T22:59:08.773795+0000","last_clean":"2024-04-25T22:59:08.773795+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T22:59:08.773795+0000","last_undegraded":"2024-04-25T22:59:08.773795+0000","last_fullsized":"2024-04-25T22:59:08.773795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785508+0000","last_change":"2024-04-25T22:59:06.802597+0000","last_active":"2024-04-25T22:59:07.785508+0000","last_peered":"2024-04-25T22:59:07.785508+0000","last_clean":"2024-04-25T22:59:07.785508+0000","last_became_active":"2024-04-25T22:59:06.801813+0000","last_became_peered":"2024-04-25T22:59:06.801813+0000","last_unstale":"2024-04-25T22:59:07.785508+0000","last_undegraded":"2024-04-25T22:59:07.785508+0000","last_fullsized":"2024-04-25T22:59:07.785508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772797+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T22:59:08.772797+0000","last_peered":"2024-04-25T22:59:08.772797+0000","last_clean":"2024-04-25T22:59:08.772797+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T22:59:08.772797+0000","last_undegraded":"2024-04-25T22:59:08.772797+0000","last_fullsized":"2024-04-25T22:59:08.772797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772307+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T22:59:08.772307+0000","last_peered":"2024-04-25T22:59:08.772307+0000","last_clean":"2024-04-25T22:59:08.772307+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T22:59:08.772307+0000","last_undegraded":"2024-04-25T22:59:08.772307+0000","last_fullsized":"2024-04-25T22:59:08.772307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772095+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T22:59:08.772095+0000","last_peered":"2024-04-25T22:59:08.772095+0000","last_clean":"2024-04-25T22:59:08.772095+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T22:59:08.772095+0000","last_undegraded":"2024-04-25T22:59:08.772095+0000","last_fullsized":"2024-04-25T22:59:08.772095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783702+0000","last_change":"2024-04-25T22:59:06.797839+0000","last_active":"2024-04-25T22:59:07.783702+0000","last_peered":"2024-04-25T22:59:07.783702+0000","last_clean":"2024-04-25T22:59:07.783702+0000","last_became_active":"2024-04-25T22:59:06.793135+0000","last_became_peered":"2024-04-25T22:59:06.793135+0000","last_unstale":"2024-04-25T22:59:07.783702+0000","last_undegraded":"2024-04-25T22:59:07.783702+0000","last_fullsized":"2024-04-25T22:59:07.783702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786282+0000","last_change":"2024-04-25T22:59:06.798833+0000","last_active":"2024-04-25T22:59:07.786282+0000","last_peered":"2024-04-25T22:59:07.786282+0000","last_clean":"2024-04-25T22:59:07.786282+0000","last_became_active":"2024-04-25T22:59:06.798100+0000","last_became_peered":"2024-04-25T22:59:06.798100+0000","last_unstale":"2024-04-25T22:59:07.786282+0000","last_undegraded":"2024-04-25T22:59:07.786282+0000","last_fullsized":"2024-04-25T22:59:07.786282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773891+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T22:59:08.773891+0000","last_peered":"2024-04-25T22:59:08.773891+0000","last_clean":"2024-04-25T22:59:08.773891+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T22:59:08.773891+0000","last_undegraded":"2024-04-25T22:59:08.773891+0000","last_fullsized":"2024-04-25T22:59:08.773891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785565+0000","last_change":"2024-04-25T22:59:06.814696+0000","last_active":"2024-04-25T22:59:07.785565+0000","last_peered":"2024-04-25T22:59:07.785565+0000","last_clean":"2024-04-25T22:59:07.785565+0000","last_became_active":"2024-04-25T22:59:06.813961+0000","last_became_peered":"2024-04-25T22:59:06.813961+0000","last_unstale":"2024-04-25T22:59:07.785565+0000","last_undegraded":"2024-04-25T22:59:07.785565+0000","last_fullsized":"2024-04-25T22:59:07.785565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785037+0000","last_change":"2024-04-25T22:59:06.782280+0000","last_active":"2024-04-25T22:59:07.785037+0000","last_peered":"2024-04-25T22:59:07.785037+0000","last_clean":"2024-04-25T22:59:07.785037+0000","last_became_active":"2024-04-25T22:59:06.781484+0000","last_became_peered":"2024-04-25T22:59:06.781484+0000","last_unstale":"2024-04-25T22:59:07.785037+0000","last_undegraded":"2024-04-25T22:59:07.785037+0000","last_fullsized":"2024-04-25T22:59:07.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772933+0000","last_change":"2024-04-25T22:59:06.791816+0000","last_active":"2024-04-25T22:59:08.772933+0000","last_peered":"2024-04-25T22:59:08.772933+0000","last_clean":"2024-04-25T22:59:08.772933+0000","last_became_active":"2024-04-25T22:59:06.789994+0000","last_became_peered":"2024-04-25T22:59:06.789994+0000","last_unstale":"2024-04-25T22:59:08.772933+0000","last_undegraded":"2024-04-25T22:59:08.772933+0000","last_fullsized":"2024-04-25T22:59:08.772933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772628+0000","last_change":"2024-04-25T22:59:06.790804+0000","last_active":"2024-04-25T22:59:08.772628+0000","last_peered":"2024-04-25T22:59:08.772628+0000","last_clean":"2024-04-25T22:59:08.772628+0000","last_became_active":"2024-04-25T22:59:06.789720+0000","last_became_peered":"2024-04-25T22:59:06.789720+0000","last_unstale":"2024-04-25T22:59:08.772628+0000","last_undegraded":"2024-04-25T22:59:08.772628+0000","last_fullsized":"2024-04-25T22:59:08.772628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772244+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T22:59:08.772244+0000","last_peered":"2024-04-25T22:59:08.772244+0000","last_clean":"2024-04-25T22:59:08.772244+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T22:59:08.772244+0000","last_undegraded":"2024-04-25T22:59:08.772244+0000","last_fullsized":"2024-04-25T22:59:08.772244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785932+0000","last_change":"2024-04-25T22:59:06.797073+0000","last_active":"2024-04-25T22:59:07.785932+0000","last_peered":"2024-04-25T22:59:07.785932+0000","last_clean":"2024-04-25T22:59:07.785932+0000","last_became_active":"2024-04-25T22:59:06.791141+0000","last_became_peered":"2024-04-25T22:59:06.791141+0000","last_unstale":"2024-04-25T22:59:07.785932+0000","last_undegraded":"2024-04-25T22:59:07.785932+0000","last_fullsized":"2024-04-25T22:59:07.785932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786658+0000","last_change":"2024-04-25T22:59:06.804912+0000","last_active":"2024-04-25T22:59:07.786658+0000","last_peered":"2024-04-25T22:59:07.786658+0000","last_clean":"2024-04-25T22:59:07.786658+0000","last_became_active":"2024-04-25T22:59:06.804100+0000","last_became_peered":"2024-04-25T22:59:06.804100+0000","last_unstale":"2024-04-25T22:59:07.786658+0000","last_undegraded":"2024-04-25T22:59:07.786658+0000","last_fullsized":"2024-04-25T22:59:07.786658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783693+0000","last_change":"2024-04-25T22:59:06.791947+0000","last_active":"2024-04-25T22:59:07.783693+0000","last_peered":"2024-04-25T22:59:07.783693+0000","last_clean":"2024-04-25T22:59:07.783693+0000","last_became_active":"2024-04-25T22:59:06.791064+0000","last_became_peered":"2024-04-25T22:59:06.791064+0000","last_unstale":"2024-04-25T22:59:07.783693+0000","last_undegraded":"2024-04-25T22:59:07.783693+0000","last_fullsized":"2024-04-25T22:59:07.783693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774184+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T22:59:08.774184+0000","last_peered":"2024-04-25T22:59:08.774184+0000","last_clean":"2024-04-25T22:59:08.774184+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T22:59:08.774184+0000","last_undegraded":"2024-04-25T22:59:08.774184+0000","last_fullsized":"2024-04-25T22:59:08.774184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774337+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T22:59:08.774337+0000","last_peered":"2024-04-25T22:59:08.774337+0000","last_clean":"2024-04-25T22:59:08.774337+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T22:59:08.774337+0000","last_undegraded":"2024-04-25T22:59:08.774337+0000","last_fullsized":"2024-04-25T22:59:08.774337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784814+0000","last_change":"2024-04-25T22:59:06.795909+0000","last_active":"2024-04-25T22:59:07.784814+0000","last_peered":"2024-04-25T22:59:07.784814+0000","last_clean":"2024-04-25T22:59:07.784814+0000","last_became_active":"2024-04-25T22:59:06.794998+0000","last_became_peered":"2024-04-25T22:59:06.794998+0000","last_unstale":"2024-04-25T22:59:07.784814+0000","last_undegraded":"2024-04-25T22:59:07.784814+0000","last_fullsized":"2024-04-25T22:59:07.784814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:17.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782504+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T22:59:07.782504+0000","last_peered":"2024-04-25T22:59:07.782504+0000","last_clean":"2024-04-25T22:59:07.782504+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T22:59:07.782504+0000","last_undegraded":"2024-04-25T22:59:07.782504+0000","last_fullsized":"2024-04-25T22:59:07.782504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784098+0000","last_change":"2024-04-25T22:59:06.783226+0000","last_active":"2024-04-25T22:59:07.784098+0000","last_peered":"2024-04-25T22:59:07.784098+0000","last_clean":"2024-04-25T22:59:07.784098+0000","last_became_active":"2024-04-25T22:59:06.781774+0000","last_became_peered":"2024-04-25T22:59:06.781774+0000","last_unstale":"2024-04-25T22:59:07.784098+0000","last_undegraded":"2024-04-25T22:59:07.784098+0000","last_fullsized":"2024-04-25T22:59:07.784098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:03.122921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787216+0000","last_change":"2024-04-25T22:59:06.795806+0000","last_active":"2024-04-25T22:59:07.787216+0000","last_peered":"2024-04-25T22:59:07.787216+0000","last_clean":"2024-04-25T22:59:07.787216+0000","last_became_active":"2024-04-25T22:59:06.794632+0000","last_became_peered":"2024-04-25T22:59:06.794632+0000","last_unstale":"2024-04-25T22:59:07.787216+0000","last_undegraded":"2024-04-25T22:59:07.787216+0000","last_fullsized":"2024-04-25T22:59:07.787216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784343+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T22:59:07.784343+0000","last_peered":"2024-04-25T22:59:07.784343+0000","last_clean":"2024-04-25T22:59:07.784343+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T22:59:07.784343+0000","last_undegraded":"2024-04-25T22:59:07.784343+0000","last_fullsized":"2024-04-25T22:59:07.784343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774180+0000","last_change":"2024-04-25T22:59:06.800124+0000","last_active":"2024-04-25T22:59:08.774180+0000","last_peered":"2024-04-25T22:59:08.774180+0000","last_clean":"2024-04-25T22:59:08.774180+0000","last_became_active":"2024-04-25T22:59:06.794619+0000","last_became_peered":"2024-04-25T22:59:06.794619+0000","last_unstale":"2024-04-25T22:59:08.774180+0000","last_undegraded":"2024-04-25T22:59:08.774180+0000","last_fullsized":"2024-04-25T22:59:08.774180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:46.277348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786991+0000","last_change":"2024-04-25T22:59:06.814869+0000","last_active":"2024-04-25T22:59:07.786991+0000","last_peered":"2024-04-25T22:59:07.786991+0000","last_clean":"2024-04-25T22:59:07.786991+0000","last_became_active":"2024-04-25T22:59:06.813986+0000","last_became_peered":"2024-04-25T22:59:06.813986+0000","last_unstale":"2024-04-25T22:59:07.786991+0000","last_undegraded":"2024-04-25T22:59:07.786991+0000","last_fullsized":"2024-04-25T22:59:07.786991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783735+0000","last_change":"2024-04-25T22:59:06.791151+0000","last_active":"2024-04-25T22:59:07.783735+0000","last_peered":"2024-04-25T22:59:07.783735+0000","last_clean":"2024-04-25T22:59:07.783735+0000","last_became_active":"2024-04-25T22:59:06.790017+0000","last_became_peered":"2024-04-25T22:59:06.790017+0000","last_unstale":"2024-04-25T22:59:07.783735+0000","last_undegraded":"2024-04-25T22:59:07.783735+0000","last_fullsized":"2024-04-25T22:59:07.783735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785653+0000","last_change":"2024-04-25T22:59:06.796874+0000","last_active":"2024-04-25T22:59:07.785653+0000","last_peered":"2024-04-25T22:59:07.785653+0000","last_clean":"2024-04-25T22:59:07.785653+0000","last_became_active":"2024-04-25T22:59:06.796100+0000","last_became_peered":"2024-04-25T22:59:06.796100+0000","last_unstale":"2024-04-25T22:59:07.785653+0000","last_undegraded":"2024-04-25T22:59:07.785653+0000","last_fullsized":"2024-04-25T22:59:07.785653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782734+0000","last_change":"2024-04-25T22:59:06.794741+0000","last_active":"2024-04-25T22:59:07.782734+0000","last_peered":"2024-04-25T22:59:07.782734+0000","last_clean":"2024-04-25T22:59:07.782734+0000","last_became_active":"2024-04-25T22:59:06.793264+0000","last_became_peered":"2024-04-25T22:59:06.793264+0000","last_unstale":"2024-04-25T22:59:07.782734+0000","last_undegraded":"2024-04-25T22:59:07.782734+0000","last_fullsized":"2024-04-25T22:59:07.782734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772605+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T22:59:08.772605+0000","last_peered":"2024-04-25T22:59:08.772605+0000","last_clean":"2024-04-25T22:59:08.772605+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T22:59:08.772605+0000","last_undegraded":"2024-04-25T22:59:08.772605+0000","last_fullsized":"2024-04-25T22:59:08.772605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786119+0000","last_change":"2024-04-25T22:59:06.802067+0000","last_active":"2024-04-25T22:59:07.786119+0000","last_peered":"2024-04-25T22:59:07.786119+0000","last_clean":"2024-04-25T22:59:07.786119+0000","last_became_active":"2024-04-25T22:59:06.801322+0000","last_became_peered":"2024-04-25T22:59:06.801322+0000","last_unstale":"2024-04-25T22:59:07.786119+0000","last_undegraded":"2024-04-25T22:59:07.786119+0000","last_fullsized":"2024-04-25T22:59:07.786119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774524+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T22:59:08.774524+0000","last_peered":"2024-04-25T22:59:08.774524+0000","last_clean":"2024-04-25T22:59:08.774524+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T22:59:08.774524+0000","last_undegraded":"2024-04-25T22:59:08.774524+0000","last_fullsized":"2024-04-25T22:59:08.774524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786655+0000","last_change":"2024-04-25T22:59:06.798452+0000","last_active":"2024-04-25T22:59:07.786655+0000","last_peered":"2024-04-25T22:59:07.786655+0000","last_clean":"2024-04-25T22:59:07.786655+0000","last_became_active":"2024-04-25T22:59:06.797421+0000","last_became_peered":"2024-04-25T22:59:06.797421+0000","last_unstale":"2024-04-25T22:59:07.786655+0000","last_undegraded":"2024-04-25T22:59:07.786655+0000","last_fullsized":"2024-04-25T22:59:07.786655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783153+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T22:59:07.783153+0000","last_peered":"2024-04-25T22:59:07.783153+0000","last_clean":"2024-04-25T22:59:07.783153+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T22:59:07.783153+0000","last_undegraded":"2024-04-25T22:59:07.783153+0000","last_fullsized":"2024-04-25T22:59:07.783153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785193+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T22:59:07.785193+0000","last_peered":"2024-04-25T22:59:07.785193+0000","last_clean":"2024-04-25T22:59:07.785193+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T22:59:07.785193+0000","last_undegraded":"2024-04-25T22:59:07.785193+0000","last_fullsized":"2024-04-25T22:59:07.785193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784937+0000","last_change":"2024-04-25T22:59:05.782753+0000","last_active":"2024-04-25T22:59:07.784937+0000","last_peered":"2024-04-25T22:59:07.784937+0000","last_clean":"2024-04-25T22:59:07.784937+0000","last_became_active":"2024-04-25T22:59:05.782002+0000","last_became_peered":"2024-04-25T22:59:05.782002+0000","last_unstale":"2024-04-25T22:59:07.784937+0000","last_undegraded":"2024-04-25T22:59:07.784937+0000","last_fullsized":"2024-04-25T22:59:07.784937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:49.136410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784128+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T22:59:07.784128+0000","last_peered":"2024-04-25T22:59:07.784128+0000","last_clean":"2024-04-25T22:59:07.784128+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T22:59:07.784128+0000","last_undegraded":"2024-04-25T22:59:07.784128+0000","last_fullsized":"2024-04-25T22:59:07.784128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772345+0000","last_change":"2024-04-25T22:59:05.781315+0000","last_active":"2024-04-25T22:59:08.772345+0000","last_peered":"2024-04-25T22:59:08.772345+0000","last_clean":"2024-04-25T22:59:08.772345+0000","last_became_active":"2024-04-25T22:59:05.780508+0000","last_became_peered":"2024-04-25T22:59:05.780508+0000","last_unstale":"2024-04-25T22:59:08.772345+0000","last_undegraded":"2024-04-25T22:59:08.772345+0000","last_fullsized":"2024-04-25T22:59:08.772345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774108+0000","last_change":"2024-04-25T22:59:05.781365+0000","last_active":"2024-04-25T22:59:08.774108+0000","last_peered":"2024-04-25T22:59:08.774108+0000","last_clean":"2024-04-25T22:59:08.774108+0000","last_became_active":"2024-04-25T22:59:05.779706+0000","last_became_peered":"2024-04-25T22:59:05.779706+0000","last_unstale":"2024-04-25T22:59:08.774108+0000","last_undegraded":"2024-04-25T22:59:08.774108+0000","last_fullsized":"2024-04-25T22:59:08.774108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784266+0000","last_change":"2024-04-25T22:59:06.814657+0000","last_active":"2024-04-25T22:59:07.784266+0000","last_peered":"2024-04-25T22:59:07.784266+0000","last_clean":"2024-04-25T22:59:07.784266+0000","last_became_active":"2024-04-25T22:59:06.814089+0000","last_became_peered":"2024-04-25T22:59:06.814089+0000","last_unstale":"2024-04-25T22:59:07.784266+0000","last_undegraded":"2024-04-25T22:59:07.784266+0000","last_fullsized":"2024-04-25T22:59:07.784266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:04:21.292902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786825+0000","last_change":"2024-04-25T22:59:05.783434+0000","last_active":"2024-04-25T22:59:07.786825+0000","last_peered":"2024-04-25T22:59:07.786825+0000","last_clean":"2024-04-25T22:59:07.786825+0000","last_became_active":"2024-04-25T22:59:05.782707+0000","last_became_peered":"2024-04-25T22:59:05.782707+0000","last_unstale":"2024-04-25T22:59:07.786825+0000","last_undegraded":"2024-04-25T22:59:07.786825+0000","last_fullsized":"2024-04-25T22:59:07.786825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784791+0000","last_change":"2024-04-25T22:59:06.783092+0000","last_active":"2024-04-25T22:59:07.784791+0000","last_peered":"2024-04-25T22:59:07.784791+0000","last_clean":"2024-04-25T22:59:07.784791+0000","last_became_active":"2024-04-25T22:59:06.781597+0000","last_became_peered":"2024-04-25T22:59:06.781597+0000","last_unstale":"2024-04-25T22:59:07.784791+0000","last_undegraded":"2024-04-25T22:59:07.784791+0000","last_fullsized":"2024-04-25T22:59:07.784791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:04:26.144135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774685+0000","last_change":"2024-04-25T22:59:05.781889+0000","last_active":"2024-04-25T22:59:08.774685+0000","last_peered":"2024-04-25T22:59:08.774685+0000","last_clean":"2024-04-25T22:59:08.774685+0000","last_became_active":"2024-04-25T22:59:05.781215+0000","last_became_peered":"2024-04-25T22:59:05.781215+0000","last_unstale":"2024-04-25T22:59:08.774685+0000","last_undegraded":"2024-04-25T22:59:08.774685+0000","last_fullsized":"2024-04-25T22:59:08.774685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773227+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T22:59:08.773227+0000","last_peered":"2024-04-25T22:59:08.773227+0000","last_clean":"2024-04-25T22:59:08.773227+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T22:59:08.773227+0000","last_undegraded":"2024-04-25T22:59:08.773227+0000","last_fullsized":"2024-04-25T22:59:08.773227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775643+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T22:59:08.775643+0000","last_peered":"2024-04-25T22:59:08.775643+0000","last_clean":"2024-04-25T22:59:08.775643+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T22:59:08.775643+0000","last_undegraded":"2024-04-25T22:59:08.775643+0000","last_fullsized":"2024-04-25T22:59:08.775643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784373+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T22:59:07.784373+0000","last_peered":"2024-04-25T22:59:07.784373+0000","last_clean":"2024-04-25T22:59:07.784373+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T22:59:07.784373+0000","last_undegraded":"2024-04-25T22:59:07.784373+0000","last_fullsized":"2024-04-25T22:59:07.784373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784877+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T22:59:07.784877+0000","last_peered":"2024-04-25T22:59:07.784877+0000","last_clean":"2024-04-25T22:59:07.784877+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T22:59:07.784877+0000","last_undegraded":"2024-04-25T22:59:07.784877+0000","last_fullsized":"2024-04-25T22:59:07.784877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774655+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.774655+0000","last_peered":"2024-04-25T22:59:08.774655+0000","last_clean":"2024-04-25T22:59:08.774655+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T22:59:08.774655+0000","last_undegraded":"2024-04-25T22:59:08.774655+0000","last_fullsized":"2024-04-25T22:59:08.774655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773605+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T22:59:08.773605+0000","last_peered":"2024-04-25T22:59:08.773605+0000","last_clean":"2024-04-25T22:59:08.773605+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T22:59:08.773605+0000","last_undegraded":"2024-04-25T22:59:08.773605+0000","last_fullsized":"2024-04-25T22:59:08.773605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774537+0000","last_change":"2024-04-25T22:59:06.798000+0000","last_active":"2024-04-25T22:59:08.774537+0000","last_peered":"2024-04-25T22:59:08.774537+0000","last_clean":"2024-04-25T22:59:08.774537+0000","last_became_active":"2024-04-25T22:59:06.793483+0000","last_became_peered":"2024-04-25T22:59:06.793483+0000","last_unstale":"2024-04-25T22:59:08.774537+0000","last_undegraded":"2024-04-25T22:59:08.774537+0000","last_fullsized":"2024-04-25T22:59:08.774537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:19.520617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785194+0000","last_change":"2024-04-25T22:59:05.782797+0000","last_active":"2024-04-25T22:59:07.785194+0000","last_peered":"2024-04-25T22:59:07.785194+0000","last_clean":"2024-04-25T22:59:07.785194+0000","last_became_active":"2024-04-25T22:59:05.782123+0000","last_became_peered":"2024-04-25T22:59:05.782123+0000","last_unstale":"2024-04-25T22:59:07.785194+0000","last_undegraded":"2024-04-25T22:59:07.785194+0000","last_fullsized":"2024-04-25T22:59:07.785194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:05.108258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774720+0000","last_change":"2024-04-25T22:59:06.790685+0000","last_active":"2024-04-25T22:59:08.774720+0000","last_peered":"2024-04-25T22:59:08.774720+0000","last_clean":"2024-04-25T22:59:08.774720+0000","last_became_active":"2024-04-25T22:59:06.789885+0000","last_became_peered":"2024-04-25T22:59:06.789885+0000","last_unstale":"2024-04-25T22:59:08.774720+0000","last_undegraded":"2024-04-25T22:59:08.774720+0000","last_fullsized":"2024-04-25T22:59:08.774720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:53.136204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784183+0000","last_change":"2024-04-25T22:59:05.778598+0000","last_active":"2024-04-25T22:59:07.784183+0000","last_peered":"2024-04-25T22:59:07.784183+0000","last_clean":"2024-04-25T22:59:07.784183+0000","last_became_active":"2024-04-25T22:59:05.777930+0000","last_became_peered":"2024-04-25T22:59:05.777930+0000","last_unstale":"2024-04-25T22:59:07.784183+0000","last_undegraded":"2024-04-25T22:59:07.784183+0000","last_fullsized":"2024-04-25T22:59:07.784183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:51.519857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784585+0000","last_change":"2024-04-25T22:59:06.797741+0000","last_active":"2024-04-25T22:59:07.784585+0000","last_peered":"2024-04-25T22:59:07.784585+0000","last_clean":"2024-04-25T22:59:07.784585+0000","last_became_active":"2024-04-25T22:59:06.793110+0000","last_became_peered":"2024-04-25T22:59:06.793110+0000","last_unstale":"2024-04-25T22:59:07.784585+0000","last_undegraded":"2024-04-25T22:59:07.784585+0000","last_fullsized":"2024-04-25T22:59:07.784585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772959+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:08.772959+0000","last_peered":"2024-04-25T22:59:08.772959+0000","last_clean":"2024-04-25T22:59:08.772959+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:08.772959+0000","last_undegraded":"2024-04-25T22:59:08.772959+0000","last_fullsized":"2024-04-25T22:59:08.772959+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775297+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:08.775297+0000","last_peered":"2024-04-25T22:59:08.775297+0000","last_clean":"2024-04-25T22:59:08.775297+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:08.775297+0000","last_undegraded":"2024-04-25T22:59:08.775297+0000","last_fullsized":"2024-04-25T22:59:08.775297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783426+0000","last_change":"2024-04-25T22:59:05.773462+0000","last_active":"2024-04-25T22:59:07.783426+0000","last_peered":"2024-04-25T22:59:07.783426+0000","last_clean":"2024-04-25T22:59:07.783426+0000","last_became_active":"2024-04-25T22:59:05.772642+0000","last_became_peered":"2024-04-25T22:59:05.772642+0000","last_unstale":"2024-04-25T22:59:07.783426+0000","last_undegraded":"2024-04-25T22:59:07.783426+0000","last_fullsized":"2024-04-25T22:59:07.783426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774660+0000","last_change":"2024-04-25T22:59:06.801333+0000","last_active":"2024-04-25T22:59:08.774660+0000","last_peered":"2024-04-25T22:59:08.774660+0000","last_clean":"2024-04-25T22:59:08.774660+0000","last_became_active":"2024-04-25T22:59:06.793589+0000","last_became_peered":"2024-04-25T22:59:06.793589+0000","last_unstale":"2024-04-25T22:59:08.774660+0000","last_undegraded":"2024-04-25T22:59:08.774660+0000","last_fullsized":"2024-04-25T22:59:08.774660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:21.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772753+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:08.772753+0000","last_peered":"2024-04-25T22:59:08.772753+0000","last_clean":"2024-04-25T22:59:08.772753+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:08.772753+0000","last_undegraded":"2024-04-25T22:59:08.772753+0000","last_fullsized":"2024-04-25T22:59:08.772753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784166+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T22:59:07.784166+0000","last_peered":"2024-04-25T22:59:07.784166+0000","last_clean":"2024-04-25T22:59:07.784166+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T22:59:07.784166+0000","last_undegraded":"2024-04-25T22:59:07.784166+0000","last_fullsized":"2024-04-25T22:59:07.784166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786948+0000","last_change":"2024-04-25T22:59:06.802609+0000","last_active":"2024-04-25T22:59:07.786948+0000","last_peered":"2024-04-25T22:59:07.786948+0000","last_clean":"2024-04-25T22:59:07.786948+0000","last_became_active":"2024-04-25T22:59:06.801566+0000","last_became_peered":"2024-04-25T22:59:06.801566+0000","last_unstale":"2024-04-25T22:59:07.786948+0000","last_undegraded":"2024-04-25T22:59:07.786948+0000","last_fullsized":"2024-04-25T22:59:07.786948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784614+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:07.784614+0000","last_peered":"2024-04-25T22:59:07.784614+0000","last_clean":"2024-04-25T22:59:07.784614+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:07.784614+0000","last_undegraded":"2024-04-25T22:59:07.784614+0000","last_fullsized":"2024-04-25T22:59:07.784614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784434+0000","last_change":"2024-04-25T22:59:05.785151+0000","last_active":"2024-04-25T22:59:07.784434+0000","last_peered":"2024-04-25T22:59:07.784434+0000","last_clean":"2024-04-25T22:59:07.784434+0000","last_became_active":"2024-04-25T22:59:05.784380+0000","last_became_peered":"2024-04-25T22:59:05.784380+0000","last_unstale":"2024-04-25T22:59:07.784434+0000","last_undegraded":"2024-04-25T22:59:07.784434+0000","last_fullsized":"2024-04-25T22:59:07.784434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784554+0000","last_change":"2024-04-25T22:59:06.795334+0000","last_active":"2024-04-25T22:59:07.784554+0000","last_peered":"2024-04-25T22:59:07.784554+0000","last_clean":"2024-04-25T22:59:07.784554+0000","last_became_active":"2024-04-25T22:59:06.790600+0000","last_became_peered":"2024-04-25T22:59:06.790600+0000","last_unstale":"2024-04-25T22:59:07.784554+0000","last_undegraded":"2024-04-25T22:59:07.784554+0000","last_fullsized":"2024-04-25T22:59:07.784554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773619+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:08.773619+0000","last_peered":"2024-04-25T22:59:08.773619+0000","last_clean":"2024-04-25T22:59:08.773619+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:08.773619+0000","last_undegraded":"2024-04-25T22:59:08.773619+0000","last_fullsized":"2024-04-25T22:59:08.773619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774622+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T22:59:08.774622+0000","last_peered":"2024-04-25T22:59:08.774622+0000","last_clean":"2024-04-25T22:59:08.774622+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T22:59:08.774622+0000","last_undegraded":"2024-04-25T22:59:08.774622+0000","last_fullsized":"2024-04-25T22:59:08.774622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784919+0000","last_change":"2024-04-25T22:59:06.792116+0000","last_active":"2024-04-25T22:59:07.784919+0000","last_peered":"2024-04-25T22:59:07.784919+0000","last_clean":"2024-04-25T22:59:07.784919+0000","last_became_active":"2024-04-25T22:59:06.788815+0000","last_became_peered":"2024-04-25T22:59:06.788815+0000","last_unstale":"2024-04-25T22:59:07.784919+0000","last_undegraded":"2024-04-25T22:59:07.784919+0000","last_fullsized":"2024-04-25T22:59:07.784919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775231+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T22:59:08.775231+0000","last_peered":"2024-04-25T22:59:08.775231+0000","last_clean":"2024-04-25T22:59:08.775231+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T22:59:08.775231+0000","last_undegraded":"2024-04-25T22:59:08.775231+0000","last_fullsized":"2024-04-25T22:59:08.775231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784998+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:07.784998+0000","last_peered":"2024-04-25T22:59:07.784998+0000","last_clean":"2024-04-25T22:59:07.784998+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:07.784998+0000","last_undegraded":"2024-04-25T22:59:07.784998+0000","last_fullsized":"2024-04-25T22:59:07.784998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785045+0000","last_change":"2024-04-25T22:59:06.796493+0000","last_active":"2024-04-25T22:59:07.785045+0000","last_peered":"2024-04-25T22:59:07.785045+0000","last_clean":"2024-04-25T22:59:07.785045+0000","last_became_active":"2024-04-25T22:59:06.794987+0000","last_became_peered":"2024-04-25T22:59:06.794987+0000","last_unstale":"2024-04-25T22:59:07.785045+0000","last_undegraded":"2024-04-25T22:59:07.785045+0000","last_fullsized":"2024-04-25T22:59:07.785045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784774+0000","last_change":"2024-04-25T22:59:05.774865+0000","last_active":"2024-04-25T22:59:07.784774+0000","last_peered":"2024-04-25T22:59:07.784774+0000","last_clean":"2024-04-25T22:59:07.784774+0000","last_became_active":"2024-04-25T22:59:05.772893+0000","last_became_peered":"2024-04-25T22:59:05.772893+0000","last_unstale":"2024-04-25T22:59:07.784774+0000","last_undegraded":"2024-04-25T22:59:07.784774+0000","last_fullsized":"2024-04-25T22:59:07.784774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787305+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:07.787305+0000","last_peered":"2024-04-25T22:59:07.787305+0000","last_clean":"2024-04-25T22:59:07.787305+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:07.787305+0000","last_undegraded":"2024-04-25T22:59:07.787305+0000","last_fullsized":"2024-04-25T22:59:07.787305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785251+0000","last_change":"2024-04-25T22:59:06.805539+0000","last_active":"2024-04-25T22:59:07.785251+0000","last_peered":"2024-04-25T22:59:07.785251+0000","last_clean":"2024-04-25T22:59:07.785251+0000","last_became_active":"2024-04-25T22:59:06.804693+0000","last_became_peered":"2024-04-25T22:59:06.804693+0000","last_unstale":"2024-04-25T22:59:07.785251+0000","last_undegraded":"2024-04-25T22:59:07.785251+0000","last_fullsized":"2024-04-25T22:59:07.785251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785775+0000","last_change":"2024-04-25T22:59:05.774273+0000","last_active":"2024-04-25T22:59:07.785775+0000","last_peered":"2024-04-25T22:59:07.785775+0000","last_clean":"2024-04-25T22:59:07.785775+0000","last_became_active":"2024-04-25T22:59:05.773115+0000","last_became_peered":"2024-04-25T22:59:05.773115+0000","last_unstale":"2024-04-25T22:59:07.785775+0000","last_undegraded":"2024-04-25T22:59:07.785775+0000","last_fullsized":"2024-04-25T22:59:07.785775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785665+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:07.785665+0000","last_peered":"2024-04-25T22:59:07.785665+0000","last_clean":"2024-04-25T22:59:07.785665+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:07.785665+0000","last_undegraded":"2024-04-25T22:59:07.785665+0000","last_fullsized":"2024-04-25T22:59:07.785665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784045+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T22:59:07.784045+0000","last_peered":"2024-04-25T22:59:07.784045+0000","last_clean":"2024-04-25T22:59:07.784045+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T22:59:07.784045+0000","last_undegraded":"2024-04-25T22:59:07.784045+0000","last_fullsized":"2024-04-25T22:59:07.784045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785198+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T22:59:07.785198+0000","last_peered":"2024-04-25T22:59:07.785198+0000","last_clean":"2024-04-25T22:59:07.785198+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T22:59:07.785198+0000","last_undegraded":"2024-04-25T22:59:07.785198+0000","last_fullsized":"2024-04-25T22:59:07.785198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774258+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:08.774258+0000","last_peered":"2024-04-25T22:59:08.774258+0000","last_clean":"2024-04-25T22:59:08.774258+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:08.774258+0000","last_undegraded":"2024-04-25T22:59:08.774258+0000","last_fullsized":"2024-04-25T22:59:08.774258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785787+0000","last_change":"2024-04-25T22:59:06.805606+0000","last_active":"2024-04-25T22:59:07.785787+0000","last_peered":"2024-04-25T22:59:07.785787+0000","last_clean":"2024-04-25T22:59:07.785787+0000","last_became_active":"2024-04-25T22:59:06.804741+0000","last_became_peered":"2024-04-25T22:59:06.804741+0000","last_unstale":"2024-04-25T22:59:07.785787+0000","last_undegraded":"2024-04-25T22:59:07.785787+0000","last_fullsized":"2024-04-25T22:59:07.785787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774105+0000","last_change":"2024-04-25T22:59:06.792879+0000","last_active":"2024-04-25T22:59:08.774105+0000","last_peered":"2024-04-25T22:59:08.774105+0000","last_clean":"2024-04-25T22:59:08.774105+0000","last_became_active":"2024-04-25T22:59:06.791896+0000","last_became_peered":"2024-04-25T22:59:06.791896+0000","last_unstale":"2024-04-25T22:59:08.774105+0000","last_undegraded":"2024-04-25T22:59:08.774105+0000","last_fullsized":"2024-04-25T22:59:08.774105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775335+0000","last_change":"2024-04-25T22:59:05.777961+0000","last_active":"2024-04-25T22:59:08.775335+0000","last_peered":"2024-04-25T22:59:08.775335+0000","last_clean":"2024-04-25T22:59:08.775335+0000","last_became_active":"2024-04-25T22:59:05.776419+0000","last_became_peered":"2024-04-25T22:59:05.776419+0000","last_unstale":"2024-04-25T22:59:08.775335+0000","last_undegraded":"2024-04-25T22:59:08.775335+0000","last_fullsized":"2024-04-25T22:59:08.775335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782994+0000","last_change":"2024-04-25T22:59:06.795064+0000","last_active":"2024-04-25T22:59:07.782994+0000","last_peered":"2024-04-25T22:59:07.782994+0000","last_clean":"2024-04-25T22:59:07.782994+0000","last_became_active":"2024-04-25T22:59:06.794164+0000","last_became_peered":"2024-04-25T22:59:06.794164+0000","last_unstale":"2024-04-25T22:59:07.782994+0000","last_undegraded":"2024-04-25T22:59:07.782994+0000","last_fullsized":"2024-04-25T22:59:07.782994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787019+0000","last_change":"2024-04-25T22:59:05.784604+0000","last_active":"2024-04-25T22:59:07.787019+0000","last_peered":"2024-04-25T22:59:07.787019+0000","last_clean":"2024-04-25T22:59:07.787019+0000","last_became_active":"2024-04-25T22:59:05.783730+0000","last_became_peered":"2024-04-25T22:59:05.783730+0000","last_unstale":"2024-04-25T22:59:07.787019+0000","last_undegraded":"2024-04-25T22:59:07.787019+0000","last_fullsized":"2024-04-25T22:59:07.787019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:50.670011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775348+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T22:59:08.775348+0000","last_peered":"2024-04-25T22:59:08.775348+0000","last_clean":"2024-04-25T22:59:08.775348+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T22:59:08.775348+0000","last_undegraded":"2024-04-25T22:59:08.775348+0000","last_fullsized":"2024-04-25T22:59:08.775348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782947+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T22:59:07.782947+0000","last_peered":"2024-04-25T22:59:07.782947+0000","last_clean":"2024-04-25T22:59:07.782947+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T22:59:07.782947+0000","last_undegraded":"2024-04-25T22:59:07.782947+0000","last_fullsized":"2024-04-25T22:59:07.782947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785122+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T22:59:07.785122+0000","last_peered":"2024-04-25T22:59:07.785122+0000","last_clean":"2024-04-25T22:59:07.785122+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T22:59:07.785122+0000","last_undegraded":"2024-04-25T22:59:07.785122+0000","last_fullsized":"2024-04-25T22:59:07.785122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783404+0000","last_change":"2024-04-25T22:59:06.790297+0000","last_active":"2024-04-25T22:59:07.783404+0000","last_peered":"2024-04-25T22:59:07.783404+0000","last_clean":"2024-04-25T22:59:07.783404+0000","last_became_active":"2024-04-25T22:59:06.789200+0000","last_became_peered":"2024-04-25T22:59:06.789200+0000","last_unstale":"2024-04-25T22:59:07.783404+0000","last_undegraded":"2024-04-25T22:59:07.783404+0000","last_fullsized":"2024-04-25T22:59:07.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787179+0000","last_change":"2024-04-25T22:59:06.803808+0000","last_active":"2024-04-25T22:59:07.787179+0000","last_peered":"2024-04-25T22:59:07.787179+0000","last_clean":"2024-04-25T22:59:07.787179+0000","last_became_active":"2024-04-25T22:59:06.803285+0000","last_became_peered":"2024-04-25T22:59:06.803285+0000","last_unstale":"2024-04-25T22:59:07.787179+0000","last_undegraded":"2024-04-25T22:59:07.787179+0000","last_fullsized":"2024-04-25T22:59:07.787179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783578+0000","last_change":"2024-04-25T22:59:05.773898+0000","last_active":"2024-04-25T22:59:07.783578+0000","last_peered":"2024-04-25T22:59:07.783578+0000","last_clean":"2024-04-25T22:59:07.783578+0000","last_became_active":"2024-04-25T22:59:05.773068+0000","last_became_peered":"2024-04-25T22:59:05.773068+0000","last_unstale":"2024-04-25T22:59:07.783578+0000","last_undegraded":"2024-04-25T22:59:07.783578+0000","last_fullsized":"2024-04-25T22:59:07.783578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784179+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T22:59:07.784179+0000","last_peered":"2024-04-25T22:59:07.784179+0000","last_clean":"2024-04-25T22:59:07.784179+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T22:59:07.784179+0000","last_undegraded":"2024-04-25T22:59:07.784179+0000","last_fullsized":"2024-04-25T22:59:07.784179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783103+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T22:59:07.783103+0000","last_peered":"2024-04-25T22:59:07.783103+0000","last_clean":"2024-04-25T22:59:07.783103+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T22:59:07.783103+0000","last_undegraded":"2024-04-25T22:59:07.783103+0000","last_fullsized":"2024-04-25T22:59:07.783103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786627+0000","last_change":"2024-04-25T22:59:06.804422+0000","last_active":"2024-04-25T22:59:07.786627+0000","last_peered":"2024-04-25T22:59:07.786627+0000","last_clean":"2024-04-25T22:59:07.786627+0000","last_became_active":"2024-04-25T22:59:06.803684+0000","last_became_peered":"2024-04-25T22:59:06.803684+0000","last_unstale":"2024-04-25T22:59:07.786627+0000","last_undegraded":"2024-04-25T22:59:07.786627+0000","last_fullsized":"2024-04-25T22:59:07.786627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785200+0000","last_change":"2024-04-25T22:59:05.778693+0000","last_active":"2024-04-25T22:59:07.785200+0000","last_peered":"2024-04-25T22:59:07.785200+0000","last_clean":"2024-04-25T22:59:07.785200+0000","last_became_active":"2024-04-25T22:59:05.777959+0000","last_became_peered":"2024-04-25T22:59:05.777959+0000","last_unstale":"2024-04-25T22:59:07.785200+0000","last_undegraded":"2024-04-25T22:59:07.785200+0000","last_fullsized":"2024-04-25T22:59:07.785200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.955918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785912+0000","last_change":"2024-04-25T22:59:06.802535+0000","last_active":"2024-04-25T22:59:07.785912+0000","last_peered":"2024-04-25T22:59:07.785912+0000","last_clean":"2024-04-25T22:59:07.785912+0000","last_became_active":"2024-04-25T22:59:06.801753+0000","last_became_peered":"2024-04-25T22:59:06.801753+0000","last_unstale":"2024-04-25T22:59:07.785912+0000","last_undegraded":"2024-04-25T22:59:07.785912+0000","last_fullsized":"2024-04-25T22:59:07.785912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785421+0000","last_change":"2024-04-25T22:59:05.784336+0000","last_active":"2024-04-25T22:59:07.785421+0000","last_peered":"2024-04-25T22:59:07.785421+0000","last_clean":"2024-04-25T22:59:07.785421+0000","last_became_active":"2024-04-25T22:59:05.783677+0000","last_became_peered":"2024-04-25T22:59:05.783677+0000","last_unstale":"2024-04-25T22:59:07.785421+0000","last_undegraded":"2024-04-25T22:59:07.785421+0000","last_fullsized":"2024-04-25T22:59:07.785421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:16.113762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773869+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.773869+0000","last_peered":"2024-04-25T22:59:08.773869+0000","last_clean":"2024-04-25T22:59:08.773869+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T22:59:08.773869+0000","last_undegraded":"2024-04-25T22:59:08.773869+0000","last_fullsized":"2024-04-25T22:59:08.773869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775261+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T22:59:08.775261+0000","last_peered":"2024-04-25T22:59:08.775261+0000","last_clean":"2024-04-25T22:59:08.775261+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T22:59:08.775261+0000","last_undegraded":"2024-04-25T22:59:08.775261+0000","last_fullsized":"2024-04-25T22:59:08.775261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773439+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T22:59:08.773439+0000","last_peered":"2024-04-25T22:59:08.773439+0000","last_clean":"2024-04-25T22:59:08.773439+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T22:59:08.773439+0000","last_undegraded":"2024-04-25T22:59:08.773439+0000","last_fullsized":"2024-04-25T22:59:08.773439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786795+0000","last_change":"2024-04-25T22:59:05.784872+0000","last_active":"2024-04-25T22:59:07.786795+0000","last_peered":"2024-04-25T22:59:07.786795+0000","last_clean":"2024-04-25T22:59:07.786795+0000","last_became_active":"2024-04-25T22:59:05.782768+0000","last_became_peered":"2024-04-25T22:59:05.782768+0000","last_unstale":"2024-04-25T22:59:07.786795+0000","last_undegraded":"2024-04-25T22:59:07.786795+0000","last_fullsized":"2024-04-25T22:59:07.786795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:31.688776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786229+0000","last_change":"2024-04-25T22:59:06.803221+0000","last_active":"2024-04-25T22:59:07.786229+0000","last_peered":"2024-04-25T22:59:07.786229+0000","last_clean":"2024-04-25T22:59:07.786229+0000","last_became_active":"2024-04-25T22:59:06.802203+0000","last_became_peered":"2024-04-25T22:59:06.802203+0000","last_unstale":"2024-04-25T22:59:07.786229+0000","last_undegraded":"2024-04-25T22:59:07.786229+0000","last_fullsized":"2024-04-25T22:59:07.786229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784817+0000","last_change":"2024-04-25T22:59:05.773997+0000","last_active":"2024-04-25T22:59:07.784817+0000","last_peered":"2024-04-25T22:59:07.784817+0000","last_clean":"2024-04-25T22:59:07.784817+0000","last_became_active":"2024-04-25T22:59:05.772933+0000","last_became_peered":"2024-04-25T22:59:05.772933+0000","last_unstale":"2024-04-25T22:59:07.784817+0000","last_undegraded":"2024-04-25T22:59:07.784817+0000","last_fullsized":"2024-04-25T22:59:07.784817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772813+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T22:59:08.772813+0000","last_peered":"2024-04-25T22:59:08.772813+0000","last_clean":"2024-04-25T22:59:08.772813+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T22:59:08.772813+0000","last_undegraded":"2024-04-25T22:59:08.772813+0000","last_fullsized":"2024-04-25T22:59:08.772813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784853+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T22:59:07.784853+0000","last_peered":"2024-04-25T22:59:07.784853+0000","last_clean":"2024-04-25T22:59:07.784853+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T22:59:07.784853+0000","last_undegraded":"2024-04-25T22:59:07.784853+0000","last_fullsized":"2024-04-25T22:59:07.784853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:15.622 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T22:59:15.623 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T22:59:15.623 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T22:59:15.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T22:59:15.623 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T22:59:16.010 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:16.029 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3309473512},{"type":"v1","addr":"172.21.15.43:6801","nonce":3309473512}]},"active_addr":"172.21.15.43:6801/3309473512","active_change":"2024-04-25T22:58:50.494638+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4125,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2055025107}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1310424722}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3796736329}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2181312844}]}]} 2024-04-25T22:59:16.032 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T22:59:16.032 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T22:59:16.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:16.332 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:16.332 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:07.768159+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:16.349 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T22:59:16.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:16.644 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:16.644 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:07.768159+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:16.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T22:59:16.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T22:59:16.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T22:59:16.824 INFO:teuthology.orchestra.run.smithi043.stdout:34359738377 2024-04-25T22:59:16.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:59:16.827 INFO:teuthology.orchestra.run.smithi043.stdout:34359738377 2024-04-25T22:59:16.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:59:16.828 INFO:teuthology.orchestra.run.smithi043.stdout:34359738377 2024-04-25T22:59:16.829 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:59:17.128 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-04-25T22:59:17.145 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-04-25T22:59:17.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.1 2024-04-25T22:59:17.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.2 2024-04-25T22:59:17.169 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-04-25T22:59:17.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.0 2024-04-25T22:59:18.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:59:18.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:59:18.187 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:59:18.463 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-04-25T22:59:18.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.1 2024-04-25T22:59:18.486 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-04-25T22:59:18.491 INFO:teuthology.orchestra.run.smithi043.stdout:34359738376 2024-04-25T22:59:18.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.0 2024-04-25T22:59:18.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.2 2024-04-25T22:59:19.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:59:19.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:59:19.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:59:19.797 INFO:teuthology.orchestra.run.smithi043.stdout:34359738377 2024-04-25T22:59:19.818 INFO:teuthology.orchestra.run.smithi043.stdout:34359738377 2024-04-25T22:59:19.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.1 2024-04-25T22:59:19.820 DEBUG:teuthology.parallel:result is None 2024-04-25T22:59:19.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.0 2024-04-25T22:59:19.837 DEBUG:teuthology.parallel:result is None 2024-04-25T22:59:19.840 INFO:teuthology.orchestra.run.smithi043.stdout:34359738377 2024-04-25T22:59:19.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.2 2024-04-25T22:59:19.857 DEBUG:teuthology.parallel:result is None 2024-04-25T22:59:19.857 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:59:19.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:20.205 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:20.207 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:20.224 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-25T22:59:18.510629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95260,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020260,"statfs":{"total":289910292480,"available":289812746240,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.733558"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786579+0000","last_change":"2024-04-25T22:59:06.803693+0000","last_active":"2024-04-25T22:59:07.786579+0000","last_peered":"2024-04-25T22:59:07.786579+0000","last_clean":"2024-04-25T22:59:07.786579+0000","last_became_active":"2024-04-25T22:59:06.802949+0000","last_became_peered":"2024-04-25T22:59:06.802949+0000","last_unstale":"2024-04-25T22:59:07.786579+0000","last_undegraded":"2024-04-25T22:59:07.786579+0000","last_fullsized":"2024-04-25T22:59:07.786579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786674+0000","last_change":"2024-04-25T22:59:06.798862+0000","last_active":"2024-04-25T22:59:07.786674+0000","last_peered":"2024-04-25T22:59:07.786674+0000","last_clean":"2024-04-25T22:59:07.786674+0000","last_became_active":"2024-04-25T22:59:06.798150+0000","last_became_peered":"2024-04-25T22:59:06.798150+0000","last_unstale":"2024-04-25T22:59:07.786674+0000","last_undegraded":"2024-04-25T22:59:07.786674+0000","last_fullsized":"2024-04-25T22:59:07.786674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773768+0000","last_change":"2024-04-25T22:59:06.801047+0000","last_active":"2024-04-25T22:59:08.773768+0000","last_peered":"2024-04-25T22:59:08.773768+0000","last_clean":"2024-04-25T22:59:08.773768+0000","last_became_active":"2024-04-25T22:59:06.797208+0000","last_became_peered":"2024-04-25T22:59:06.797208+0000","last_unstale":"2024-04-25T22:59:08.773768+0000","last_undegraded":"2024-04-25T22:59:08.773768+0000","last_fullsized":"2024-04-25T22:59:08.773768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773795+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T22:59:08.773795+0000","last_peered":"2024-04-25T22:59:08.773795+0000","last_clean":"2024-04-25T22:59:08.773795+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T22:59:08.773795+0000","last_undegraded":"2024-04-25T22:59:08.773795+0000","last_fullsized":"2024-04-25T22:59:08.773795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785508+0000","last_change":"2024-04-25T22:59:06.802597+0000","last_active":"2024-04-25T22:59:07.785508+0000","last_peered":"2024-04-25T22:59:07.785508+0000","last_clean":"2024-04-25T22:59:07.785508+0000","last_became_active":"2024-04-25T22:59:06.801813+0000","last_became_peered":"2024-04-25T22:59:06.801813+0000","last_unstale":"2024-04-25T22:59:07.785508+0000","last_undegraded":"2024-04-25T22:59:07.785508+0000","last_fullsized":"2024-04-25T22:59:07.785508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772797+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T22:59:08.772797+0000","last_peered":"2024-04-25T22:59:08.772797+0000","last_clean":"2024-04-25T22:59:08.772797+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T22:59:08.772797+0000","last_undegraded":"2024-04-25T22:59:08.772797+0000","last_fullsized":"2024-04-25T22:59:08.772797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772307+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T22:59:08.772307+0000","last_peered":"2024-04-25T22:59:08.772307+0000","last_clean":"2024-04-25T22:59:08.772307+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T22:59:08.772307+0000","last_undegraded":"2024-04-25T22:59:08.772307+0000","last_fullsized":"2024-04-25T22:59:08.772307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772095+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T22:59:08.772095+0000","last_peered":"2024-04-25T22:59:08.772095+0000","last_clean":"2024-04-25T22:59:08.772095+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T22:59:08.772095+0000","last_undegraded":"2024-04-25T22:59:08.772095+0000","last_fullsized":"2024-04-25T22:59:08.772095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783702+0000","last_change":"2024-04-25T22:59:06.797839+0000","last_active":"2024-04-25T22:59:07.783702+0000","last_peered":"2024-04-25T22:59:07.783702+0000","last_clean":"2024-04-25T22:59:07.783702+0000","last_became_active":"2024-04-25T22:59:06.793135+0000","last_became_peered":"2024-04-25T22:59:06.793135+0000","last_unstale":"2024-04-25T22:59:07.783702+0000","last_undegraded":"2024-04-25T22:59:07.783702+0000","last_fullsized":"2024-04-25T22:59:07.783702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786282+0000","last_change":"2024-04-25T22:59:06.798833+0000","last_active":"2024-04-25T22:59:07.786282+0000","last_peered":"2024-04-25T22:59:07.786282+0000","last_clean":"2024-04-25T22:59:07.786282+0000","last_became_active":"2024-04-25T22:59:06.798100+0000","last_became_peered":"2024-04-25T22:59:06.798100+0000","last_unstale":"2024-04-25T22:59:07.786282+0000","last_undegraded":"2024-04-25T22:59:07.786282+0000","last_fullsized":"2024-04-25T22:59:07.786282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773891+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T22:59:08.773891+0000","last_peered":"2024-04-25T22:59:08.773891+0000","last_clean":"2024-04-25T22:59:08.773891+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T22:59:08.773891+0000","last_undegraded":"2024-04-25T22:59:08.773891+0000","last_fullsized":"2024-04-25T22:59:08.773891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785565+0000","last_change":"2024-04-25T22:59:06.814696+0000","last_active":"2024-04-25T22:59:07.785565+0000","last_peered":"2024-04-25T22:59:07.785565+0000","last_clean":"2024-04-25T22:59:07.785565+0000","last_became_active":"2024-04-25T22:59:06.813961+0000","last_became_peered":"2024-04-25T22:59:06.813961+0000","last_unstale":"2024-04-25T22:59:07.785565+0000","last_undegraded":"2024-04-25T22:59:07.785565+0000","last_fullsized":"2024-04-25T22:59:07.785565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785037+0000","last_change":"2024-04-25T22:59:06.782280+0000","last_active":"2024-04-25T22:59:07.785037+0000","last_peered":"2024-04-25T22:59:07.785037+0000","last_clean":"2024-04-25T22:59:07.785037+0000","last_became_active":"2024-04-25T22:59:06.781484+0000","last_became_peered":"2024-04-25T22:59:06.781484+0000","last_unstale":"2024-04-25T22:59:07.785037+0000","last_undegraded":"2024-04-25T22:59:07.785037+0000","last_fullsized":"2024-04-25T22:59:07.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772933+0000","last_change":"2024-04-25T22:59:06.791816+0000","last_active":"2024-04-25T22:59:08.772933+0000","last_peered":"2024-04-25T22:59:08.772933+0000","last_clean":"2024-04-25T22:59:08.772933+0000","last_became_active":"2024-04-25T22:59:06.789994+0000","last_became_peered":"2024-04-25T22:59:06.789994+0000","last_unstale":"2024-04-25T22:59:08.772933+0000","last_undegraded":"2024-04-25T22:59:08.772933+0000","last_fullsized":"2024-04-25T22:59:08.772933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772628+0000","last_change":"2024-04-25T22:59:06.790804+0000","last_active":"2024-04-25T22:59:08.772628+0000","last_peered":"2024-04-25T22:59:08.772628+0000","last_clean":"2024-04-25T22:59:08.772628+0000","last_became_active":"2024-04-25T22:59:06.789720+0000","last_became_peered":"2024-04-25T22:59:06.789720+0000","last_unstale":"2024-04-25T22:59:08.772628+0000","last_undegraded":"2024-04-25T22:59:08.772628+0000","last_fullsized":"2024-04-25T22:59:08.772628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772244+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T22:59:08.772244+0000","last_peered":"2024-04-25T22:59:08.772244+0000","last_clean":"2024-04-25T22:59:08.772244+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T22:59:08.772244+0000","last_undegraded":"2024-04-25T22:59:08.772244+0000","last_fullsized":"2024-04-25T22:59:08.772244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785932+0000","last_change":"2024-04-25T22:59:06.797073+0000","last_active":"2024-04-25T22:59:07.785932+0000","last_peered":"2024-04-25T22:59:07.785932+0000","last_clean":"2024-04-25T22:59:07.785932+0000","last_became_active":"2024-04-25T22:59:06.791141+0000","last_became_peered":"2024-04-25T22:59:06.791141+0000","last_unstale":"2024-04-25T22:59:07.785932+0000","last_undegraded":"2024-04-25T22:59:07.785932+0000","last_fullsized":"2024-04-25T22:59:07.785932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786658+0000","last_change":"2024-04-25T22:59:06.804912+0000","last_active":"2024-04-25T22:59:07.786658+0000","last_peered":"2024-04-25T22:59:07.786658+0000","last_clean":"2024-04-25T22:59:07.786658+0000","last_became_active":"2024-04-25T22:59:06.804100+0000","last_became_peered":"2024-04-25T22:59:06.804100+0000","last_unstale":"2024-04-25T22:59:07.786658+0000","last_undegraded":"2024-04-25T22:59:07.786658+0000","last_fullsized":"2024-04-25T22:59:07.786658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783693+0000","last_change":"2024-04-25T22:59:06.791947+0000","last_active":"2024-04-25T22:59:07.783693+0000","last_peered":"2024-04-25T22:59:07.783693+0000","last_clean":"2024-04-25T22:59:07.783693+0000","last_became_active":"2024-04-25T22:59:06.791064+0000","last_became_peered":"2024-04-25T22:59:06.791064+0000","last_unstale":"2024-04-25T22:59:07.783693+0000","last_undegraded":"2024-04-25T22:59:07.783693+0000","last_fullsized":"2024-04-25T22:59:07.783693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774184+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T22:59:08.774184+0000","last_peered":"2024-04-25T22:59:08.774184+0000","last_clean":"2024-04-25T22:59:08.774184+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T22:59:08.774184+0000","last_undegraded":"2024-04-25T22:59:08.774184+0000","last_fullsized":"2024-04-25T22:59:08.774184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774337+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T22:59:08.774337+0000","last_peered":"2024-04-25T22:59:08.774337+0000","last_clean":"2024-04-25T22:59:08.774337+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T22:59:08.774337+0000","last_undegraded":"2024-04-25T22:59:08.774337+0000","last_fullsized":"2024-04-25T22:59:08.774337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784814+0000","last_change":"2024-04-25T22:59:06.795909+0000","last_active":"2024-04-25T22:59:07.784814+0000","last_peered":"2024-04-25T22:59:07.784814+0000","last_clean":"2024-04-25T22:59:07.784814+0000","last_became_active":"2024-04-25T22:59:06.794998+0000","last_became_peered":"2024-04-25T22:59:06.794998+0000","last_unstale":"2024-04-25T22:59:07.784814+0000","last_undegraded":"2024-04-25T22:59:07.784814+0000","last_fullsized":"2024-04-25T22:59:07.784814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:17.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782504+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T22:59:07.782504+0000","last_peered":"2024-04-25T22:59:07.782504+0000","last_clean":"2024-04-25T22:59:07.782504+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T22:59:07.782504+0000","last_undegraded":"2024-04-25T22:59:07.782504+0000","last_fullsized":"2024-04-25T22:59:07.782504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784098+0000","last_change":"2024-04-25T22:59:06.783226+0000","last_active":"2024-04-25T22:59:07.784098+0000","last_peered":"2024-04-25T22:59:07.784098+0000","last_clean":"2024-04-25T22:59:07.784098+0000","last_became_active":"2024-04-25T22:59:06.781774+0000","last_became_peered":"2024-04-25T22:59:06.781774+0000","last_unstale":"2024-04-25T22:59:07.784098+0000","last_undegraded":"2024-04-25T22:59:07.784098+0000","last_fullsized":"2024-04-25T22:59:07.784098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:03.122921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787216+0000","last_change":"2024-04-25T22:59:06.795806+0000","last_active":"2024-04-25T22:59:07.787216+0000","last_peered":"2024-04-25T22:59:07.787216+0000","last_clean":"2024-04-25T22:59:07.787216+0000","last_became_active":"2024-04-25T22:59:06.794632+0000","last_became_peered":"2024-04-25T22:59:06.794632+0000","last_unstale":"2024-04-25T22:59:07.787216+0000","last_undegraded":"2024-04-25T22:59:07.787216+0000","last_fullsized":"2024-04-25T22:59:07.787216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784343+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T22:59:07.784343+0000","last_peered":"2024-04-25T22:59:07.784343+0000","last_clean":"2024-04-25T22:59:07.784343+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T22:59:07.784343+0000","last_undegraded":"2024-04-25T22:59:07.784343+0000","last_fullsized":"2024-04-25T22:59:07.784343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774180+0000","last_change":"2024-04-25T22:59:06.800124+0000","last_active":"2024-04-25T22:59:08.774180+0000","last_peered":"2024-04-25T22:59:08.774180+0000","last_clean":"2024-04-25T22:59:08.774180+0000","last_became_active":"2024-04-25T22:59:06.794619+0000","last_became_peered":"2024-04-25T22:59:06.794619+0000","last_unstale":"2024-04-25T22:59:08.774180+0000","last_undegraded":"2024-04-25T22:59:08.774180+0000","last_fullsized":"2024-04-25T22:59:08.774180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:46.277348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786991+0000","last_change":"2024-04-25T22:59:06.814869+0000","last_active":"2024-04-25T22:59:07.786991+0000","last_peered":"2024-04-25T22:59:07.786991+0000","last_clean":"2024-04-25T22:59:07.786991+0000","last_became_active":"2024-04-25T22:59:06.813986+0000","last_became_peered":"2024-04-25T22:59:06.813986+0000","last_unstale":"2024-04-25T22:59:07.786991+0000","last_undegraded":"2024-04-25T22:59:07.786991+0000","last_fullsized":"2024-04-25T22:59:07.786991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783735+0000","last_change":"2024-04-25T22:59:06.791151+0000","last_active":"2024-04-25T22:59:07.783735+0000","last_peered":"2024-04-25T22:59:07.783735+0000","last_clean":"2024-04-25T22:59:07.783735+0000","last_became_active":"2024-04-25T22:59:06.790017+0000","last_became_peered":"2024-04-25T22:59:06.790017+0000","last_unstale":"2024-04-25T22:59:07.783735+0000","last_undegraded":"2024-04-25T22:59:07.783735+0000","last_fullsized":"2024-04-25T22:59:07.783735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785653+0000","last_change":"2024-04-25T22:59:06.796874+0000","last_active":"2024-04-25T22:59:07.785653+0000","last_peered":"2024-04-25T22:59:07.785653+0000","last_clean":"2024-04-25T22:59:07.785653+0000","last_became_active":"2024-04-25T22:59:06.796100+0000","last_became_peered":"2024-04-25T22:59:06.796100+0000","last_unstale":"2024-04-25T22:59:07.785653+0000","last_undegraded":"2024-04-25T22:59:07.785653+0000","last_fullsized":"2024-04-25T22:59:07.785653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782734+0000","last_change":"2024-04-25T22:59:06.794741+0000","last_active":"2024-04-25T22:59:07.782734+0000","last_peered":"2024-04-25T22:59:07.782734+0000","last_clean":"2024-04-25T22:59:07.782734+0000","last_became_active":"2024-04-25T22:59:06.793264+0000","last_became_peered":"2024-04-25T22:59:06.793264+0000","last_unstale":"2024-04-25T22:59:07.782734+0000","last_undegraded":"2024-04-25T22:59:07.782734+0000","last_fullsized":"2024-04-25T22:59:07.782734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772605+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T22:59:08.772605+0000","last_peered":"2024-04-25T22:59:08.772605+0000","last_clean":"2024-04-25T22:59:08.772605+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T22:59:08.772605+0000","last_undegraded":"2024-04-25T22:59:08.772605+0000","last_fullsized":"2024-04-25T22:59:08.772605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786119+0000","last_change":"2024-04-25T22:59:06.802067+0000","last_active":"2024-04-25T22:59:07.786119+0000","last_peered":"2024-04-25T22:59:07.786119+0000","last_clean":"2024-04-25T22:59:07.786119+0000","last_became_active":"2024-04-25T22:59:06.801322+0000","last_became_peered":"2024-04-25T22:59:06.801322+0000","last_unstale":"2024-04-25T22:59:07.786119+0000","last_undegraded":"2024-04-25T22:59:07.786119+0000","last_fullsized":"2024-04-25T22:59:07.786119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774524+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T22:59:08.774524+0000","last_peered":"2024-04-25T22:59:08.774524+0000","last_clean":"2024-04-25T22:59:08.774524+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T22:59:08.774524+0000","last_undegraded":"2024-04-25T22:59:08.774524+0000","last_fullsized":"2024-04-25T22:59:08.774524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786655+0000","last_change":"2024-04-25T22:59:06.798452+0000","last_active":"2024-04-25T22:59:07.786655+0000","last_peered":"2024-04-25T22:59:07.786655+0000","last_clean":"2024-04-25T22:59:07.786655+0000","last_became_active":"2024-04-25T22:59:06.797421+0000","last_became_peered":"2024-04-25T22:59:06.797421+0000","last_unstale":"2024-04-25T22:59:07.786655+0000","last_undegraded":"2024-04-25T22:59:07.786655+0000","last_fullsized":"2024-04-25T22:59:07.786655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783153+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T22:59:07.783153+0000","last_peered":"2024-04-25T22:59:07.783153+0000","last_clean":"2024-04-25T22:59:07.783153+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T22:59:07.783153+0000","last_undegraded":"2024-04-25T22:59:07.783153+0000","last_fullsized":"2024-04-25T22:59:07.783153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785193+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T22:59:07.785193+0000","last_peered":"2024-04-25T22:59:07.785193+0000","last_clean":"2024-04-25T22:59:07.785193+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T22:59:07.785193+0000","last_undegraded":"2024-04-25T22:59:07.785193+0000","last_fullsized":"2024-04-25T22:59:07.785193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784937+0000","last_change":"2024-04-25T22:59:05.782753+0000","last_active":"2024-04-25T22:59:07.784937+0000","last_peered":"2024-04-25T22:59:07.784937+0000","last_clean":"2024-04-25T22:59:07.784937+0000","last_became_active":"2024-04-25T22:59:05.782002+0000","last_became_peered":"2024-04-25T22:59:05.782002+0000","last_unstale":"2024-04-25T22:59:07.784937+0000","last_undegraded":"2024-04-25T22:59:07.784937+0000","last_fullsized":"2024-04-25T22:59:07.784937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:49.136410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784128+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T22:59:07.784128+0000","last_peered":"2024-04-25T22:59:07.784128+0000","last_clean":"2024-04-25T22:59:07.784128+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T22:59:07.784128+0000","last_undegraded":"2024-04-25T22:59:07.784128+0000","last_fullsized":"2024-04-25T22:59:07.784128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772345+0000","last_change":"2024-04-25T22:59:05.781315+0000","last_active":"2024-04-25T22:59:08.772345+0000","last_peered":"2024-04-25T22:59:08.772345+0000","last_clean":"2024-04-25T22:59:08.772345+0000","last_became_active":"2024-04-25T22:59:05.780508+0000","last_became_peered":"2024-04-25T22:59:05.780508+0000","last_unstale":"2024-04-25T22:59:08.772345+0000","last_undegraded":"2024-04-25T22:59:08.772345+0000","last_fullsized":"2024-04-25T22:59:08.772345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774108+0000","last_change":"2024-04-25T22:59:05.781365+0000","last_active":"2024-04-25T22:59:08.774108+0000","last_peered":"2024-04-25T22:59:08.774108+0000","last_clean":"2024-04-25T22:59:08.774108+0000","last_became_active":"2024-04-25T22:59:05.779706+0000","last_became_peered":"2024-04-25T22:59:05.779706+0000","last_unstale":"2024-04-25T22:59:08.774108+0000","last_undegraded":"2024-04-25T22:59:08.774108+0000","last_fullsized":"2024-04-25T22:59:08.774108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784266+0000","last_change":"2024-04-25T22:59:06.814657+0000","last_active":"2024-04-25T22:59:07.784266+0000","last_peered":"2024-04-25T22:59:07.784266+0000","last_clean":"2024-04-25T22:59:07.784266+0000","last_became_active":"2024-04-25T22:59:06.814089+0000","last_became_peered":"2024-04-25T22:59:06.814089+0000","last_unstale":"2024-04-25T22:59:07.784266+0000","last_undegraded":"2024-04-25T22:59:07.784266+0000","last_fullsized":"2024-04-25T22:59:07.784266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:04:21.292902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786825+0000","last_change":"2024-04-25T22:59:05.783434+0000","last_active":"2024-04-25T22:59:07.786825+0000","last_peered":"2024-04-25T22:59:07.786825+0000","last_clean":"2024-04-25T22:59:07.786825+0000","last_became_active":"2024-04-25T22:59:05.782707+0000","last_became_peered":"2024-04-25T22:59:05.782707+0000","last_unstale":"2024-04-25T22:59:07.786825+0000","last_undegraded":"2024-04-25T22:59:07.786825+0000","last_fullsized":"2024-04-25T22:59:07.786825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784791+0000","last_change":"2024-04-25T22:59:06.783092+0000","last_active":"2024-04-25T22:59:07.784791+0000","last_peered":"2024-04-25T22:59:07.784791+0000","last_clean":"2024-04-25T22:59:07.784791+0000","last_became_active":"2024-04-25T22:59:06.781597+0000","last_became_peered":"2024-04-25T22:59:06.781597+0000","last_unstale":"2024-04-25T22:59:07.784791+0000","last_undegraded":"2024-04-25T22:59:07.784791+0000","last_fullsized":"2024-04-25T22:59:07.784791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:04:26.144135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774685+0000","last_change":"2024-04-25T22:59:05.781889+0000","last_active":"2024-04-25T22:59:08.774685+0000","last_peered":"2024-04-25T22:59:08.774685+0000","last_clean":"2024-04-25T22:59:08.774685+0000","last_became_active":"2024-04-25T22:59:05.781215+0000","last_became_peered":"2024-04-25T22:59:05.781215+0000","last_unstale":"2024-04-25T22:59:08.774685+0000","last_undegraded":"2024-04-25T22:59:08.774685+0000","last_fullsized":"2024-04-25T22:59:08.774685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773227+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T22:59:08.773227+0000","last_peered":"2024-04-25T22:59:08.773227+0000","last_clean":"2024-04-25T22:59:08.773227+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T22:59:08.773227+0000","last_undegraded":"2024-04-25T22:59:08.773227+0000","last_fullsized":"2024-04-25T22:59:08.773227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775643+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T22:59:08.775643+0000","last_peered":"2024-04-25T22:59:08.775643+0000","last_clean":"2024-04-25T22:59:08.775643+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T22:59:08.775643+0000","last_undegraded":"2024-04-25T22:59:08.775643+0000","last_fullsized":"2024-04-25T22:59:08.775643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784373+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T22:59:07.784373+0000","last_peered":"2024-04-25T22:59:07.784373+0000","last_clean":"2024-04-25T22:59:07.784373+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T22:59:07.784373+0000","last_undegraded":"2024-04-25T22:59:07.784373+0000","last_fullsized":"2024-04-25T22:59:07.784373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784877+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T22:59:07.784877+0000","last_peered":"2024-04-25T22:59:07.784877+0000","last_clean":"2024-04-25T22:59:07.784877+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T22:59:07.784877+0000","last_undegraded":"2024-04-25T22:59:07.784877+0000","last_fullsized":"2024-04-25T22:59:07.784877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774655+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.774655+0000","last_peered":"2024-04-25T22:59:08.774655+0000","last_clean":"2024-04-25T22:59:08.774655+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T22:59:08.774655+0000","last_undegraded":"2024-04-25T22:59:08.774655+0000","last_fullsized":"2024-04-25T22:59:08.774655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773605+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T22:59:08.773605+0000","last_peered":"2024-04-25T22:59:08.773605+0000","last_clean":"2024-04-25T22:59:08.773605+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T22:59:08.773605+0000","last_undegraded":"2024-04-25T22:59:08.773605+0000","last_fullsized":"2024-04-25T22:59:08.773605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774537+0000","last_change":"2024-04-25T22:59:06.798000+0000","last_active":"2024-04-25T22:59:08.774537+0000","last_peered":"2024-04-25T22:59:08.774537+0000","last_clean":"2024-04-25T22:59:08.774537+0000","last_became_active":"2024-04-25T22:59:06.793483+0000","last_became_peered":"2024-04-25T22:59:06.793483+0000","last_unstale":"2024-04-25T22:59:08.774537+0000","last_undegraded":"2024-04-25T22:59:08.774537+0000","last_fullsized":"2024-04-25T22:59:08.774537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:19.520617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785194+0000","last_change":"2024-04-25T22:59:05.782797+0000","last_active":"2024-04-25T22:59:07.785194+0000","last_peered":"2024-04-25T22:59:07.785194+0000","last_clean":"2024-04-25T22:59:07.785194+0000","last_became_active":"2024-04-25T22:59:05.782123+0000","last_became_peered":"2024-04-25T22:59:05.782123+0000","last_unstale":"2024-04-25T22:59:07.785194+0000","last_undegraded":"2024-04-25T22:59:07.785194+0000","last_fullsized":"2024-04-25T22:59:07.785194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:05.108258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774720+0000","last_change":"2024-04-25T22:59:06.790685+0000","last_active":"2024-04-25T22:59:08.774720+0000","last_peered":"2024-04-25T22:59:08.774720+0000","last_clean":"2024-04-25T22:59:08.774720+0000","last_became_active":"2024-04-25T22:59:06.789885+0000","last_became_peered":"2024-04-25T22:59:06.789885+0000","last_unstale":"2024-04-25T22:59:08.774720+0000","last_undegraded":"2024-04-25T22:59:08.774720+0000","last_fullsized":"2024-04-25T22:59:08.774720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:53.136204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784183+0000","last_change":"2024-04-25T22:59:05.778598+0000","last_active":"2024-04-25T22:59:07.784183+0000","last_peered":"2024-04-25T22:59:07.784183+0000","last_clean":"2024-04-25T22:59:07.784183+0000","last_became_active":"2024-04-25T22:59:05.777930+0000","last_became_peered":"2024-04-25T22:59:05.777930+0000","last_unstale":"2024-04-25T22:59:07.784183+0000","last_undegraded":"2024-04-25T22:59:07.784183+0000","last_fullsized":"2024-04-25T22:59:07.784183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:51.519857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784585+0000","last_change":"2024-04-25T22:59:06.797741+0000","last_active":"2024-04-25T22:59:07.784585+0000","last_peered":"2024-04-25T22:59:07.784585+0000","last_clean":"2024-04-25T22:59:07.784585+0000","last_became_active":"2024-04-25T22:59:06.793110+0000","last_became_peered":"2024-04-25T22:59:06.793110+0000","last_unstale":"2024-04-25T22:59:07.784585+0000","last_undegraded":"2024-04-25T22:59:07.784585+0000","last_fullsized":"2024-04-25T22:59:07.784585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772959+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:08.772959+0000","last_peered":"2024-04-25T22:59:08.772959+0000","last_clean":"2024-04-25T22:59:08.772959+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:08.772959+0000","last_undegraded":"2024-04-25T22:59:08.772959+0000","last_fullsized":"2024-04-25T22:59:08.772959+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775297+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:08.775297+0000","last_peered":"2024-04-25T22:59:08.775297+0000","last_clean":"2024-04-25T22:59:08.775297+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:08.775297+0000","last_undegraded":"2024-04-25T22:59:08.775297+0000","last_fullsized":"2024-04-25T22:59:08.775297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783426+0000","last_change":"2024-04-25T22:59:05.773462+0000","last_active":"2024-04-25T22:59:07.783426+0000","last_peered":"2024-04-25T22:59:07.783426+0000","last_clean":"2024-04-25T22:59:07.783426+0000","last_became_active":"2024-04-25T22:59:05.772642+0000","last_became_peered":"2024-04-25T22:59:05.772642+0000","last_unstale":"2024-04-25T22:59:07.783426+0000","last_undegraded":"2024-04-25T22:59:07.783426+0000","last_fullsized":"2024-04-25T22:59:07.783426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774660+0000","last_change":"2024-04-25T22:59:06.801333+0000","last_active":"2024-04-25T22:59:08.774660+0000","last_peered":"2024-04-25T22:59:08.774660+0000","last_clean":"2024-04-25T22:59:08.774660+0000","last_became_active":"2024-04-25T22:59:06.793589+0000","last_became_peered":"2024-04-25T22:59:06.793589+0000","last_unstale":"2024-04-25T22:59:08.774660+0000","last_undegraded":"2024-04-25T22:59:08.774660+0000","last_fullsized":"2024-04-25T22:59:08.774660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:21.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772753+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:08.772753+0000","last_peered":"2024-04-25T22:59:08.772753+0000","last_clean":"2024-04-25T22:59:08.772753+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:08.772753+0000","last_undegraded":"2024-04-25T22:59:08.772753+0000","last_fullsized":"2024-04-25T22:59:08.772753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784166+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T22:59:07.784166+0000","last_peered":"2024-04-25T22:59:07.784166+0000","last_clean":"2024-04-25T22:59:07.784166+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T22:59:07.784166+0000","last_undegraded":"2024-04-25T22:59:07.784166+0000","last_fullsized":"2024-04-25T22:59:07.784166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786948+0000","last_change":"2024-04-25T22:59:06.802609+0000","last_active":"2024-04-25T22:59:07.786948+0000","last_peered":"2024-04-25T22:59:07.786948+0000","last_clean":"2024-04-25T22:59:07.786948+0000","last_became_active":"2024-04-25T22:59:06.801566+0000","last_became_peered":"2024-04-25T22:59:06.801566+0000","last_unstale":"2024-04-25T22:59:07.786948+0000","last_undegraded":"2024-04-25T22:59:07.786948+0000","last_fullsized":"2024-04-25T22:59:07.786948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784614+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:07.784614+0000","last_peered":"2024-04-25T22:59:07.784614+0000","last_clean":"2024-04-25T22:59:07.784614+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:07.784614+0000","last_undegraded":"2024-04-25T22:59:07.784614+0000","last_fullsized":"2024-04-25T22:59:07.784614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784434+0000","last_change":"2024-04-25T22:59:05.785151+0000","last_active":"2024-04-25T22:59:07.784434+0000","last_peered":"2024-04-25T22:59:07.784434+0000","last_clean":"2024-04-25T22:59:07.784434+0000","last_became_active":"2024-04-25T22:59:05.784380+0000","last_became_peered":"2024-04-25T22:59:05.784380+0000","last_unstale":"2024-04-25T22:59:07.784434+0000","last_undegraded":"2024-04-25T22:59:07.784434+0000","last_fullsized":"2024-04-25T22:59:07.784434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784554+0000","last_change":"2024-04-25T22:59:06.795334+0000","last_active":"2024-04-25T22:59:07.784554+0000","last_peered":"2024-04-25T22:59:07.784554+0000","last_clean":"2024-04-25T22:59:07.784554+0000","last_became_active":"2024-04-25T22:59:06.790600+0000","last_became_peered":"2024-04-25T22:59:06.790600+0000","last_unstale":"2024-04-25T22:59:07.784554+0000","last_undegraded":"2024-04-25T22:59:07.784554+0000","last_fullsized":"2024-04-25T22:59:07.784554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773619+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:08.773619+0000","last_peered":"2024-04-25T22:59:08.773619+0000","last_clean":"2024-04-25T22:59:08.773619+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:08.773619+0000","last_undegraded":"2024-04-25T22:59:08.773619+0000","last_fullsized":"2024-04-25T22:59:08.773619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774622+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T22:59:08.774622+0000","last_peered":"2024-04-25T22:59:08.774622+0000","last_clean":"2024-04-25T22:59:08.774622+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T22:59:08.774622+0000","last_undegraded":"2024-04-25T22:59:08.774622+0000","last_fullsized":"2024-04-25T22:59:08.774622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784919+0000","last_change":"2024-04-25T22:59:06.792116+0000","last_active":"2024-04-25T22:59:07.784919+0000","last_peered":"2024-04-25T22:59:07.784919+0000","last_clean":"2024-04-25T22:59:07.784919+0000","last_became_active":"2024-04-25T22:59:06.788815+0000","last_became_peered":"2024-04-25T22:59:06.788815+0000","last_unstale":"2024-04-25T22:59:07.784919+0000","last_undegraded":"2024-04-25T22:59:07.784919+0000","last_fullsized":"2024-04-25T22:59:07.784919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775231+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T22:59:08.775231+0000","last_peered":"2024-04-25T22:59:08.775231+0000","last_clean":"2024-04-25T22:59:08.775231+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T22:59:08.775231+0000","last_undegraded":"2024-04-25T22:59:08.775231+0000","last_fullsized":"2024-04-25T22:59:08.775231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784998+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:07.784998+0000","last_peered":"2024-04-25T22:59:07.784998+0000","last_clean":"2024-04-25T22:59:07.784998+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:07.784998+0000","last_undegraded":"2024-04-25T22:59:07.784998+0000","last_fullsized":"2024-04-25T22:59:07.784998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785045+0000","last_change":"2024-04-25T22:59:06.796493+0000","last_active":"2024-04-25T22:59:07.785045+0000","last_peered":"2024-04-25T22:59:07.785045+0000","last_clean":"2024-04-25T22:59:07.785045+0000","last_became_active":"2024-04-25T22:59:06.794987+0000","last_became_peered":"2024-04-25T22:59:06.794987+0000","last_unstale":"2024-04-25T22:59:07.785045+0000","last_undegraded":"2024-04-25T22:59:07.785045+0000","last_fullsized":"2024-04-25T22:59:07.785045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784774+0000","last_change":"2024-04-25T22:59:05.774865+0000","last_active":"2024-04-25T22:59:07.784774+0000","last_peered":"2024-04-25T22:59:07.784774+0000","last_clean":"2024-04-25T22:59:07.784774+0000","last_became_active":"2024-04-25T22:59:05.772893+0000","last_became_peered":"2024-04-25T22:59:05.772893+0000","last_unstale":"2024-04-25T22:59:07.784774+0000","last_undegraded":"2024-04-25T22:59:07.784774+0000","last_fullsized":"2024-04-25T22:59:07.784774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787305+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:07.787305+0000","last_peered":"2024-04-25T22:59:07.787305+0000","last_clean":"2024-04-25T22:59:07.787305+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:07.787305+0000","last_undegraded":"2024-04-25T22:59:07.787305+0000","last_fullsized":"2024-04-25T22:59:07.787305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785251+0000","last_change":"2024-04-25T22:59:06.805539+0000","last_active":"2024-04-25T22:59:07.785251+0000","last_peered":"2024-04-25T22:59:07.785251+0000","last_clean":"2024-04-25T22:59:07.785251+0000","last_became_active":"2024-04-25T22:59:06.804693+0000","last_became_peered":"2024-04-25T22:59:06.804693+0000","last_unstale":"2024-04-25T22:59:07.785251+0000","last_undegraded":"2024-04-25T22:59:07.785251+0000","last_fullsized":"2024-04-25T22:59:07.785251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785775+0000","last_change":"2024-04-25T22:59:05.774273+0000","last_active":"2024-04-25T22:59:07.785775+0000","last_peered":"2024-04-25T22:59:07.785775+0000","last_clean":"2024-04-25T22:59:07.785775+0000","last_became_active":"2024-04-25T22:59:05.773115+0000","last_became_peered":"2024-04-25T22:59:05.773115+0000","last_unstale":"2024-04-25T22:59:07.785775+0000","last_undegraded":"2024-04-25T22:59:07.785775+0000","last_fullsized":"2024-04-25T22:59:07.785775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785665+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:07.785665+0000","last_peered":"2024-04-25T22:59:07.785665+0000","last_clean":"2024-04-25T22:59:07.785665+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:07.785665+0000","last_undegraded":"2024-04-25T22:59:07.785665+0000","last_fullsized":"2024-04-25T22:59:07.785665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784045+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T22:59:07.784045+0000","last_peered":"2024-04-25T22:59:07.784045+0000","last_clean":"2024-04-25T22:59:07.784045+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T22:59:07.784045+0000","last_undegraded":"2024-04-25T22:59:07.784045+0000","last_fullsized":"2024-04-25T22:59:07.784045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785198+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T22:59:07.785198+0000","last_peered":"2024-04-25T22:59:07.785198+0000","last_clean":"2024-04-25T22:59:07.785198+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T22:59:07.785198+0000","last_undegraded":"2024-04-25T22:59:07.785198+0000","last_fullsized":"2024-04-25T22:59:07.785198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774258+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:08.774258+0000","last_peered":"2024-04-25T22:59:08.774258+0000","last_clean":"2024-04-25T22:59:08.774258+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:08.774258+0000","last_undegraded":"2024-04-25T22:59:08.774258+0000","last_fullsized":"2024-04-25T22:59:08.774258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785787+0000","last_change":"2024-04-25T22:59:06.805606+0000","last_active":"2024-04-25T22:59:07.785787+0000","last_peered":"2024-04-25T22:59:07.785787+0000","last_clean":"2024-04-25T22:59:07.785787+0000","last_became_active":"2024-04-25T22:59:06.804741+0000","last_became_peered":"2024-04-25T22:59:06.804741+0000","last_unstale":"2024-04-25T22:59:07.785787+0000","last_undegraded":"2024-04-25T22:59:07.785787+0000","last_fullsized":"2024-04-25T22:59:07.785787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774105+0000","last_change":"2024-04-25T22:59:06.792879+0000","last_active":"2024-04-25T22:59:08.774105+0000","last_peered":"2024-04-25T22:59:08.774105+0000","last_clean":"2024-04-25T22:59:08.774105+0000","last_became_active":"2024-04-25T22:59:06.791896+0000","last_became_peered":"2024-04-25T22:59:06.791896+0000","last_unstale":"2024-04-25T22:59:08.774105+0000","last_undegraded":"2024-04-25T22:59:08.774105+0000","last_fullsized":"2024-04-25T22:59:08.774105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775335+0000","last_change":"2024-04-25T22:59:05.777961+0000","last_active":"2024-04-25T22:59:08.775335+0000","last_peered":"2024-04-25T22:59:08.775335+0000","last_clean":"2024-04-25T22:59:08.775335+0000","last_became_active":"2024-04-25T22:59:05.776419+0000","last_became_peered":"2024-04-25T22:59:05.776419+0000","last_unstale":"2024-04-25T22:59:08.775335+0000","last_undegraded":"2024-04-25T22:59:08.775335+0000","last_fullsized":"2024-04-25T22:59:08.775335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782994+0000","last_change":"2024-04-25T22:59:06.795064+0000","last_active":"2024-04-25T22:59:07.782994+0000","last_peered":"2024-04-25T22:59:07.782994+0000","last_clean":"2024-04-25T22:59:07.782994+0000","last_became_active":"2024-04-25T22:59:06.794164+0000","last_became_peered":"2024-04-25T22:59:06.794164+0000","last_unstale":"2024-04-25T22:59:07.782994+0000","last_undegraded":"2024-04-25T22:59:07.782994+0000","last_fullsized":"2024-04-25T22:59:07.782994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787019+0000","last_change":"2024-04-25T22:59:05.784604+0000","last_active":"2024-04-25T22:59:07.787019+0000","last_peered":"2024-04-25T22:59:07.787019+0000","last_clean":"2024-04-25T22:59:07.787019+0000","last_became_active":"2024-04-25T22:59:05.783730+0000","last_became_peered":"2024-04-25T22:59:05.783730+0000","last_unstale":"2024-04-25T22:59:07.787019+0000","last_undegraded":"2024-04-25T22:59:07.787019+0000","last_fullsized":"2024-04-25T22:59:07.787019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:50.670011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775348+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T22:59:08.775348+0000","last_peered":"2024-04-25T22:59:08.775348+0000","last_clean":"2024-04-25T22:59:08.775348+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T22:59:08.775348+0000","last_undegraded":"2024-04-25T22:59:08.775348+0000","last_fullsized":"2024-04-25T22:59:08.775348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782947+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T22:59:07.782947+0000","last_peered":"2024-04-25T22:59:07.782947+0000","last_clean":"2024-04-25T22:59:07.782947+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T22:59:07.782947+0000","last_undegraded":"2024-04-25T22:59:07.782947+0000","last_fullsized":"2024-04-25T22:59:07.782947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785122+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T22:59:07.785122+0000","last_peered":"2024-04-25T22:59:07.785122+0000","last_clean":"2024-04-25T22:59:07.785122+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T22:59:07.785122+0000","last_undegraded":"2024-04-25T22:59:07.785122+0000","last_fullsized":"2024-04-25T22:59:07.785122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783404+0000","last_change":"2024-04-25T22:59:06.790297+0000","last_active":"2024-04-25T22:59:07.783404+0000","last_peered":"2024-04-25T22:59:07.783404+0000","last_clean":"2024-04-25T22:59:07.783404+0000","last_became_active":"2024-04-25T22:59:06.789200+0000","last_became_peered":"2024-04-25T22:59:06.789200+0000","last_unstale":"2024-04-25T22:59:07.783404+0000","last_undegraded":"2024-04-25T22:59:07.783404+0000","last_fullsized":"2024-04-25T22:59:07.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787179+0000","last_change":"2024-04-25T22:59:06.803808+0000","last_active":"2024-04-25T22:59:07.787179+0000","last_peered":"2024-04-25T22:59:07.787179+0000","last_clean":"2024-04-25T22:59:07.787179+0000","last_became_active":"2024-04-25T22:59:06.803285+0000","last_became_peered":"2024-04-25T22:59:06.803285+0000","last_unstale":"2024-04-25T22:59:07.787179+0000","last_undegraded":"2024-04-25T22:59:07.787179+0000","last_fullsized":"2024-04-25T22:59:07.787179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783578+0000","last_change":"2024-04-25T22:59:05.773898+0000","last_active":"2024-04-25T22:59:07.783578+0000","last_peered":"2024-04-25T22:59:07.783578+0000","last_clean":"2024-04-25T22:59:07.783578+0000","last_became_active":"2024-04-25T22:59:05.773068+0000","last_became_peered":"2024-04-25T22:59:05.773068+0000","last_unstale":"2024-04-25T22:59:07.783578+0000","last_undegraded":"2024-04-25T22:59:07.783578+0000","last_fullsized":"2024-04-25T22:59:07.783578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784179+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T22:59:07.784179+0000","last_peered":"2024-04-25T22:59:07.784179+0000","last_clean":"2024-04-25T22:59:07.784179+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T22:59:07.784179+0000","last_undegraded":"2024-04-25T22:59:07.784179+0000","last_fullsized":"2024-04-25T22:59:07.784179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783103+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T22:59:07.783103+0000","last_peered":"2024-04-25T22:59:07.783103+0000","last_clean":"2024-04-25T22:59:07.783103+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T22:59:07.783103+0000","last_undegraded":"2024-04-25T22:59:07.783103+0000","last_fullsized":"2024-04-25T22:59:07.783103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786627+0000","last_change":"2024-04-25T22:59:06.804422+0000","last_active":"2024-04-25T22:59:07.786627+0000","last_peered":"2024-04-25T22:59:07.786627+0000","last_clean":"2024-04-25T22:59:07.786627+0000","last_became_active":"2024-04-25T22:59:06.803684+0000","last_became_peered":"2024-04-25T22:59:06.803684+0000","last_unstale":"2024-04-25T22:59:07.786627+0000","last_undegraded":"2024-04-25T22:59:07.786627+0000","last_fullsized":"2024-04-25T22:59:07.786627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785200+0000","last_change":"2024-04-25T22:59:05.778693+0000","last_active":"2024-04-25T22:59:07.785200+0000","last_peered":"2024-04-25T22:59:07.785200+0000","last_clean":"2024-04-25T22:59:07.785200+0000","last_became_active":"2024-04-25T22:59:05.777959+0000","last_became_peered":"2024-04-25T22:59:05.777959+0000","last_unstale":"2024-04-25T22:59:07.785200+0000","last_undegraded":"2024-04-25T22:59:07.785200+0000","last_fullsized":"2024-04-25T22:59:07.785200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.955918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785912+0000","last_change":"2024-04-25T22:59:06.802535+0000","last_active":"2024-04-25T22:59:07.785912+0000","last_peered":"2024-04-25T22:59:07.785912+0000","last_clean":"2024-04-25T22:59:07.785912+0000","last_became_active":"2024-04-25T22:59:06.801753+0000","last_became_peered":"2024-04-25T22:59:06.801753+0000","last_unstale":"2024-04-25T22:59:07.785912+0000","last_undegraded":"2024-04-25T22:59:07.785912+0000","last_fullsized":"2024-04-25T22:59:07.785912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785421+0000","last_change":"2024-04-25T22:59:05.784336+0000","last_active":"2024-04-25T22:59:07.785421+0000","last_peered":"2024-04-25T22:59:07.785421+0000","last_clean":"2024-04-25T22:59:07.785421+0000","last_became_active":"2024-04-25T22:59:05.783677+0000","last_became_peered":"2024-04-25T22:59:05.783677+0000","last_unstale":"2024-04-25T22:59:07.785421+0000","last_undegraded":"2024-04-25T22:59:07.785421+0000","last_fullsized":"2024-04-25T22:59:07.785421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:16.113762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773869+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.773869+0000","last_peered":"2024-04-25T22:59:08.773869+0000","last_clean":"2024-04-25T22:59:08.773869+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T22:59:08.773869+0000","last_undegraded":"2024-04-25T22:59:08.773869+0000","last_fullsized":"2024-04-25T22:59:08.773869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775261+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T22:59:08.775261+0000","last_peered":"2024-04-25T22:59:08.775261+0000","last_clean":"2024-04-25T22:59:08.775261+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T22:59:08.775261+0000","last_undegraded":"2024-04-25T22:59:08.775261+0000","last_fullsized":"2024-04-25T22:59:08.775261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773439+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T22:59:08.773439+0000","last_peered":"2024-04-25T22:59:08.773439+0000","last_clean":"2024-04-25T22:59:08.773439+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T22:59:08.773439+0000","last_undegraded":"2024-04-25T22:59:08.773439+0000","last_fullsized":"2024-04-25T22:59:08.773439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786795+0000","last_change":"2024-04-25T22:59:05.784872+0000","last_active":"2024-04-25T22:59:07.786795+0000","last_peered":"2024-04-25T22:59:07.786795+0000","last_clean":"2024-04-25T22:59:07.786795+0000","last_became_active":"2024-04-25T22:59:05.782768+0000","last_became_peered":"2024-04-25T22:59:05.782768+0000","last_unstale":"2024-04-25T22:59:07.786795+0000","last_undegraded":"2024-04-25T22:59:07.786795+0000","last_fullsized":"2024-04-25T22:59:07.786795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:31.688776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786229+0000","last_change":"2024-04-25T22:59:06.803221+0000","last_active":"2024-04-25T22:59:07.786229+0000","last_peered":"2024-04-25T22:59:07.786229+0000","last_clean":"2024-04-25T22:59:07.786229+0000","last_became_active":"2024-04-25T22:59:06.802203+0000","last_became_peered":"2024-04-25T22:59:06.802203+0000","last_unstale":"2024-04-25T22:59:07.786229+0000","last_undegraded":"2024-04-25T22:59:07.786229+0000","last_fullsized":"2024-04-25T22:59:07.786229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784817+0000","last_change":"2024-04-25T22:59:05.773997+0000","last_active":"2024-04-25T22:59:07.784817+0000","last_peered":"2024-04-25T22:59:07.784817+0000","last_clean":"2024-04-25T22:59:07.784817+0000","last_became_active":"2024-04-25T22:59:05.772933+0000","last_became_peered":"2024-04-25T22:59:05.772933+0000","last_unstale":"2024-04-25T22:59:07.784817+0000","last_undegraded":"2024-04-25T22:59:07.784817+0000","last_fullsized":"2024-04-25T22:59:07.784817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772813+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T22:59:08.772813+0000","last_peered":"2024-04-25T22:59:08.772813+0000","last_clean":"2024-04-25T22:59:08.772813+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T22:59:08.772813+0000","last_undegraded":"2024-04-25T22:59:08.772813+0000","last_fullsized":"2024-04-25T22:59:08.772813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784853+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T22:59:07.784853+0000","last_peered":"2024-04-25T22:59:07.784853+0000","last_clean":"2024-04-25T22:59:07.784853+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T22:59:07.784853+0000","last_undegraded":"2024-04-25T22:59:07.784853+0000","last_fullsized":"2024-04-25T22:59:07.784853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:20.229 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:20.570 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:20.572 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:20.587 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-25T22:59:20.511153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95260,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020260,"statfs":{"total":289910292480,"available":289812746240,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003646"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786579+0000","last_change":"2024-04-25T22:59:06.803693+0000","last_active":"2024-04-25T22:59:07.786579+0000","last_peered":"2024-04-25T22:59:07.786579+0000","last_clean":"2024-04-25T22:59:07.786579+0000","last_became_active":"2024-04-25T22:59:06.802949+0000","last_became_peered":"2024-04-25T22:59:06.802949+0000","last_unstale":"2024-04-25T22:59:07.786579+0000","last_undegraded":"2024-04-25T22:59:07.786579+0000","last_fullsized":"2024-04-25T22:59:07.786579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786674+0000","last_change":"2024-04-25T22:59:06.798862+0000","last_active":"2024-04-25T22:59:07.786674+0000","last_peered":"2024-04-25T22:59:07.786674+0000","last_clean":"2024-04-25T22:59:07.786674+0000","last_became_active":"2024-04-25T22:59:06.798150+0000","last_became_peered":"2024-04-25T22:59:06.798150+0000","last_unstale":"2024-04-25T22:59:07.786674+0000","last_undegraded":"2024-04-25T22:59:07.786674+0000","last_fullsized":"2024-04-25T22:59:07.786674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773768+0000","last_change":"2024-04-25T22:59:06.801047+0000","last_active":"2024-04-25T22:59:08.773768+0000","last_peered":"2024-04-25T22:59:08.773768+0000","last_clean":"2024-04-25T22:59:08.773768+0000","last_became_active":"2024-04-25T22:59:06.797208+0000","last_became_peered":"2024-04-25T22:59:06.797208+0000","last_unstale":"2024-04-25T22:59:08.773768+0000","last_undegraded":"2024-04-25T22:59:08.773768+0000","last_fullsized":"2024-04-25T22:59:08.773768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773795+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T22:59:08.773795+0000","last_peered":"2024-04-25T22:59:08.773795+0000","last_clean":"2024-04-25T22:59:08.773795+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T22:59:08.773795+0000","last_undegraded":"2024-04-25T22:59:08.773795+0000","last_fullsized":"2024-04-25T22:59:08.773795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785508+0000","last_change":"2024-04-25T22:59:06.802597+0000","last_active":"2024-04-25T22:59:07.785508+0000","last_peered":"2024-04-25T22:59:07.785508+0000","last_clean":"2024-04-25T22:59:07.785508+0000","last_became_active":"2024-04-25T22:59:06.801813+0000","last_became_peered":"2024-04-25T22:59:06.801813+0000","last_unstale":"2024-04-25T22:59:07.785508+0000","last_undegraded":"2024-04-25T22:59:07.785508+0000","last_fullsized":"2024-04-25T22:59:07.785508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772797+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T22:59:08.772797+0000","last_peered":"2024-04-25T22:59:08.772797+0000","last_clean":"2024-04-25T22:59:08.772797+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T22:59:08.772797+0000","last_undegraded":"2024-04-25T22:59:08.772797+0000","last_fullsized":"2024-04-25T22:59:08.772797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772307+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T22:59:08.772307+0000","last_peered":"2024-04-25T22:59:08.772307+0000","last_clean":"2024-04-25T22:59:08.772307+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T22:59:08.772307+0000","last_undegraded":"2024-04-25T22:59:08.772307+0000","last_fullsized":"2024-04-25T22:59:08.772307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772095+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T22:59:08.772095+0000","last_peered":"2024-04-25T22:59:08.772095+0000","last_clean":"2024-04-25T22:59:08.772095+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T22:59:08.772095+0000","last_undegraded":"2024-04-25T22:59:08.772095+0000","last_fullsized":"2024-04-25T22:59:08.772095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783702+0000","last_change":"2024-04-25T22:59:06.797839+0000","last_active":"2024-04-25T22:59:07.783702+0000","last_peered":"2024-04-25T22:59:07.783702+0000","last_clean":"2024-04-25T22:59:07.783702+0000","last_became_active":"2024-04-25T22:59:06.793135+0000","last_became_peered":"2024-04-25T22:59:06.793135+0000","last_unstale":"2024-04-25T22:59:07.783702+0000","last_undegraded":"2024-04-25T22:59:07.783702+0000","last_fullsized":"2024-04-25T22:59:07.783702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786282+0000","last_change":"2024-04-25T22:59:06.798833+0000","last_active":"2024-04-25T22:59:07.786282+0000","last_peered":"2024-04-25T22:59:07.786282+0000","last_clean":"2024-04-25T22:59:07.786282+0000","last_became_active":"2024-04-25T22:59:06.798100+0000","last_became_peered":"2024-04-25T22:59:06.798100+0000","last_unstale":"2024-04-25T22:59:07.786282+0000","last_undegraded":"2024-04-25T22:59:07.786282+0000","last_fullsized":"2024-04-25T22:59:07.786282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773891+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T22:59:08.773891+0000","last_peered":"2024-04-25T22:59:08.773891+0000","last_clean":"2024-04-25T22:59:08.773891+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T22:59:08.773891+0000","last_undegraded":"2024-04-25T22:59:08.773891+0000","last_fullsized":"2024-04-25T22:59:08.773891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785565+0000","last_change":"2024-04-25T22:59:06.814696+0000","last_active":"2024-04-25T22:59:07.785565+0000","last_peered":"2024-04-25T22:59:07.785565+0000","last_clean":"2024-04-25T22:59:07.785565+0000","last_became_active":"2024-04-25T22:59:06.813961+0000","last_became_peered":"2024-04-25T22:59:06.813961+0000","last_unstale":"2024-04-25T22:59:07.785565+0000","last_undegraded":"2024-04-25T22:59:07.785565+0000","last_fullsized":"2024-04-25T22:59:07.785565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785037+0000","last_change":"2024-04-25T22:59:06.782280+0000","last_active":"2024-04-25T22:59:07.785037+0000","last_peered":"2024-04-25T22:59:07.785037+0000","last_clean":"2024-04-25T22:59:07.785037+0000","last_became_active":"2024-04-25T22:59:06.781484+0000","last_became_peered":"2024-04-25T22:59:06.781484+0000","last_unstale":"2024-04-25T22:59:07.785037+0000","last_undegraded":"2024-04-25T22:59:07.785037+0000","last_fullsized":"2024-04-25T22:59:07.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772933+0000","last_change":"2024-04-25T22:59:06.791816+0000","last_active":"2024-04-25T22:59:08.772933+0000","last_peered":"2024-04-25T22:59:08.772933+0000","last_clean":"2024-04-25T22:59:08.772933+0000","last_became_active":"2024-04-25T22:59:06.789994+0000","last_became_peered":"2024-04-25T22:59:06.789994+0000","last_unstale":"2024-04-25T22:59:08.772933+0000","last_undegraded":"2024-04-25T22:59:08.772933+0000","last_fullsized":"2024-04-25T22:59:08.772933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772628+0000","last_change":"2024-04-25T22:59:06.790804+0000","last_active":"2024-04-25T22:59:08.772628+0000","last_peered":"2024-04-25T22:59:08.772628+0000","last_clean":"2024-04-25T22:59:08.772628+0000","last_became_active":"2024-04-25T22:59:06.789720+0000","last_became_peered":"2024-04-25T22:59:06.789720+0000","last_unstale":"2024-04-25T22:59:08.772628+0000","last_undegraded":"2024-04-25T22:59:08.772628+0000","last_fullsized":"2024-04-25T22:59:08.772628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772244+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T22:59:08.772244+0000","last_peered":"2024-04-25T22:59:08.772244+0000","last_clean":"2024-04-25T22:59:08.772244+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T22:59:08.772244+0000","last_undegraded":"2024-04-25T22:59:08.772244+0000","last_fullsized":"2024-04-25T22:59:08.772244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785932+0000","last_change":"2024-04-25T22:59:06.797073+0000","last_active":"2024-04-25T22:59:07.785932+0000","last_peered":"2024-04-25T22:59:07.785932+0000","last_clean":"2024-04-25T22:59:07.785932+0000","last_became_active":"2024-04-25T22:59:06.791141+0000","last_became_peered":"2024-04-25T22:59:06.791141+0000","last_unstale":"2024-04-25T22:59:07.785932+0000","last_undegraded":"2024-04-25T22:59:07.785932+0000","last_fullsized":"2024-04-25T22:59:07.785932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786658+0000","last_change":"2024-04-25T22:59:06.804912+0000","last_active":"2024-04-25T22:59:07.786658+0000","last_peered":"2024-04-25T22:59:07.786658+0000","last_clean":"2024-04-25T22:59:07.786658+0000","last_became_active":"2024-04-25T22:59:06.804100+0000","last_became_peered":"2024-04-25T22:59:06.804100+0000","last_unstale":"2024-04-25T22:59:07.786658+0000","last_undegraded":"2024-04-25T22:59:07.786658+0000","last_fullsized":"2024-04-25T22:59:07.786658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783693+0000","last_change":"2024-04-25T22:59:06.791947+0000","last_active":"2024-04-25T22:59:07.783693+0000","last_peered":"2024-04-25T22:59:07.783693+0000","last_clean":"2024-04-25T22:59:07.783693+0000","last_became_active":"2024-04-25T22:59:06.791064+0000","last_became_peered":"2024-04-25T22:59:06.791064+0000","last_unstale":"2024-04-25T22:59:07.783693+0000","last_undegraded":"2024-04-25T22:59:07.783693+0000","last_fullsized":"2024-04-25T22:59:07.783693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774184+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T22:59:08.774184+0000","last_peered":"2024-04-25T22:59:08.774184+0000","last_clean":"2024-04-25T22:59:08.774184+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T22:59:08.774184+0000","last_undegraded":"2024-04-25T22:59:08.774184+0000","last_fullsized":"2024-04-25T22:59:08.774184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774337+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T22:59:08.774337+0000","last_peered":"2024-04-25T22:59:08.774337+0000","last_clean":"2024-04-25T22:59:08.774337+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T22:59:08.774337+0000","last_undegraded":"2024-04-25T22:59:08.774337+0000","last_fullsized":"2024-04-25T22:59:08.774337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784814+0000","last_change":"2024-04-25T22:59:06.795909+0000","last_active":"2024-04-25T22:59:07.784814+0000","last_peered":"2024-04-25T22:59:07.784814+0000","last_clean":"2024-04-25T22:59:07.784814+0000","last_became_active":"2024-04-25T22:59:06.794998+0000","last_became_peered":"2024-04-25T22:59:06.794998+0000","last_unstale":"2024-04-25T22:59:07.784814+0000","last_undegraded":"2024-04-25T22:59:07.784814+0000","last_fullsized":"2024-04-25T22:59:07.784814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:17.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782504+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T22:59:07.782504+0000","last_peered":"2024-04-25T22:59:07.782504+0000","last_clean":"2024-04-25T22:59:07.782504+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T22:59:07.782504+0000","last_undegraded":"2024-04-25T22:59:07.782504+0000","last_fullsized":"2024-04-25T22:59:07.782504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784098+0000","last_change":"2024-04-25T22:59:06.783226+0000","last_active":"2024-04-25T22:59:07.784098+0000","last_peered":"2024-04-25T22:59:07.784098+0000","last_clean":"2024-04-25T22:59:07.784098+0000","last_became_active":"2024-04-25T22:59:06.781774+0000","last_became_peered":"2024-04-25T22:59:06.781774+0000","last_unstale":"2024-04-25T22:59:07.784098+0000","last_undegraded":"2024-04-25T22:59:07.784098+0000","last_fullsized":"2024-04-25T22:59:07.784098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:03.122921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787216+0000","last_change":"2024-04-25T22:59:06.795806+0000","last_active":"2024-04-25T22:59:07.787216+0000","last_peered":"2024-04-25T22:59:07.787216+0000","last_clean":"2024-04-25T22:59:07.787216+0000","last_became_active":"2024-04-25T22:59:06.794632+0000","last_became_peered":"2024-04-25T22:59:06.794632+0000","last_unstale":"2024-04-25T22:59:07.787216+0000","last_undegraded":"2024-04-25T22:59:07.787216+0000","last_fullsized":"2024-04-25T22:59:07.787216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784343+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T22:59:07.784343+0000","last_peered":"2024-04-25T22:59:07.784343+0000","last_clean":"2024-04-25T22:59:07.784343+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T22:59:07.784343+0000","last_undegraded":"2024-04-25T22:59:07.784343+0000","last_fullsized":"2024-04-25T22:59:07.784343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774180+0000","last_change":"2024-04-25T22:59:06.800124+0000","last_active":"2024-04-25T22:59:08.774180+0000","last_peered":"2024-04-25T22:59:08.774180+0000","last_clean":"2024-04-25T22:59:08.774180+0000","last_became_active":"2024-04-25T22:59:06.794619+0000","last_became_peered":"2024-04-25T22:59:06.794619+0000","last_unstale":"2024-04-25T22:59:08.774180+0000","last_undegraded":"2024-04-25T22:59:08.774180+0000","last_fullsized":"2024-04-25T22:59:08.774180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:46.277348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786991+0000","last_change":"2024-04-25T22:59:06.814869+0000","last_active":"2024-04-25T22:59:07.786991+0000","last_peered":"2024-04-25T22:59:07.786991+0000","last_clean":"2024-04-25T22:59:07.786991+0000","last_became_active":"2024-04-25T22:59:06.813986+0000","last_became_peered":"2024-04-25T22:59:06.813986+0000","last_unstale":"2024-04-25T22:59:07.786991+0000","last_undegraded":"2024-04-25T22:59:07.786991+0000","last_fullsized":"2024-04-25T22:59:07.786991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783735+0000","last_change":"2024-04-25T22:59:06.791151+0000","last_active":"2024-04-25T22:59:07.783735+0000","last_peered":"2024-04-25T22:59:07.783735+0000","last_clean":"2024-04-25T22:59:07.783735+0000","last_became_active":"2024-04-25T22:59:06.790017+0000","last_became_peered":"2024-04-25T22:59:06.790017+0000","last_unstale":"2024-04-25T22:59:07.783735+0000","last_undegraded":"2024-04-25T22:59:07.783735+0000","last_fullsized":"2024-04-25T22:59:07.783735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785653+0000","last_change":"2024-04-25T22:59:06.796874+0000","last_active":"2024-04-25T22:59:07.785653+0000","last_peered":"2024-04-25T22:59:07.785653+0000","last_clean":"2024-04-25T22:59:07.785653+0000","last_became_active":"2024-04-25T22:59:06.796100+0000","last_became_peered":"2024-04-25T22:59:06.796100+0000","last_unstale":"2024-04-25T22:59:07.785653+0000","last_undegraded":"2024-04-25T22:59:07.785653+0000","last_fullsized":"2024-04-25T22:59:07.785653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782734+0000","last_change":"2024-04-25T22:59:06.794741+0000","last_active":"2024-04-25T22:59:07.782734+0000","last_peered":"2024-04-25T22:59:07.782734+0000","last_clean":"2024-04-25T22:59:07.782734+0000","last_became_active":"2024-04-25T22:59:06.793264+0000","last_became_peered":"2024-04-25T22:59:06.793264+0000","last_unstale":"2024-04-25T22:59:07.782734+0000","last_undegraded":"2024-04-25T22:59:07.782734+0000","last_fullsized":"2024-04-25T22:59:07.782734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772605+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T22:59:08.772605+0000","last_peered":"2024-04-25T22:59:08.772605+0000","last_clean":"2024-04-25T22:59:08.772605+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T22:59:08.772605+0000","last_undegraded":"2024-04-25T22:59:08.772605+0000","last_fullsized":"2024-04-25T22:59:08.772605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786119+0000","last_change":"2024-04-25T22:59:06.802067+0000","last_active":"2024-04-25T22:59:07.786119+0000","last_peered":"2024-04-25T22:59:07.786119+0000","last_clean":"2024-04-25T22:59:07.786119+0000","last_became_active":"2024-04-25T22:59:06.801322+0000","last_became_peered":"2024-04-25T22:59:06.801322+0000","last_unstale":"2024-04-25T22:59:07.786119+0000","last_undegraded":"2024-04-25T22:59:07.786119+0000","last_fullsized":"2024-04-25T22:59:07.786119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774524+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T22:59:08.774524+0000","last_peered":"2024-04-25T22:59:08.774524+0000","last_clean":"2024-04-25T22:59:08.774524+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T22:59:08.774524+0000","last_undegraded":"2024-04-25T22:59:08.774524+0000","last_fullsized":"2024-04-25T22:59:08.774524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786655+0000","last_change":"2024-04-25T22:59:06.798452+0000","last_active":"2024-04-25T22:59:07.786655+0000","last_peered":"2024-04-25T22:59:07.786655+0000","last_clean":"2024-04-25T22:59:07.786655+0000","last_became_active":"2024-04-25T22:59:06.797421+0000","last_became_peered":"2024-04-25T22:59:06.797421+0000","last_unstale":"2024-04-25T22:59:07.786655+0000","last_undegraded":"2024-04-25T22:59:07.786655+0000","last_fullsized":"2024-04-25T22:59:07.786655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783153+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T22:59:07.783153+0000","last_peered":"2024-04-25T22:59:07.783153+0000","last_clean":"2024-04-25T22:59:07.783153+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T22:59:07.783153+0000","last_undegraded":"2024-04-25T22:59:07.783153+0000","last_fullsized":"2024-04-25T22:59:07.783153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785193+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T22:59:07.785193+0000","last_peered":"2024-04-25T22:59:07.785193+0000","last_clean":"2024-04-25T22:59:07.785193+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T22:59:07.785193+0000","last_undegraded":"2024-04-25T22:59:07.785193+0000","last_fullsized":"2024-04-25T22:59:07.785193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784937+0000","last_change":"2024-04-25T22:59:05.782753+0000","last_active":"2024-04-25T22:59:07.784937+0000","last_peered":"2024-04-25T22:59:07.784937+0000","last_clean":"2024-04-25T22:59:07.784937+0000","last_became_active":"2024-04-25T22:59:05.782002+0000","last_became_peered":"2024-04-25T22:59:05.782002+0000","last_unstale":"2024-04-25T22:59:07.784937+0000","last_undegraded":"2024-04-25T22:59:07.784937+0000","last_fullsized":"2024-04-25T22:59:07.784937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:49.136410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784128+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T22:59:07.784128+0000","last_peered":"2024-04-25T22:59:07.784128+0000","last_clean":"2024-04-25T22:59:07.784128+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T22:59:07.784128+0000","last_undegraded":"2024-04-25T22:59:07.784128+0000","last_fullsized":"2024-04-25T22:59:07.784128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772345+0000","last_change":"2024-04-25T22:59:05.781315+0000","last_active":"2024-04-25T22:59:08.772345+0000","last_peered":"2024-04-25T22:59:08.772345+0000","last_clean":"2024-04-25T22:59:08.772345+0000","last_became_active":"2024-04-25T22:59:05.780508+0000","last_became_peered":"2024-04-25T22:59:05.780508+0000","last_unstale":"2024-04-25T22:59:08.772345+0000","last_undegraded":"2024-04-25T22:59:08.772345+0000","last_fullsized":"2024-04-25T22:59:08.772345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774108+0000","last_change":"2024-04-25T22:59:05.781365+0000","last_active":"2024-04-25T22:59:08.774108+0000","last_peered":"2024-04-25T22:59:08.774108+0000","last_clean":"2024-04-25T22:59:08.774108+0000","last_became_active":"2024-04-25T22:59:05.779706+0000","last_became_peered":"2024-04-25T22:59:05.779706+0000","last_unstale":"2024-04-25T22:59:08.774108+0000","last_undegraded":"2024-04-25T22:59:08.774108+0000","last_fullsized":"2024-04-25T22:59:08.774108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784266+0000","last_change":"2024-04-25T22:59:06.814657+0000","last_active":"2024-04-25T22:59:07.784266+0000","last_peered":"2024-04-25T22:59:07.784266+0000","last_clean":"2024-04-25T22:59:07.784266+0000","last_became_active":"2024-04-25T22:59:06.814089+0000","last_became_peered":"2024-04-25T22:59:06.814089+0000","last_unstale":"2024-04-25T22:59:07.784266+0000","last_undegraded":"2024-04-25T22:59:07.784266+0000","last_fullsized":"2024-04-25T22:59:07.784266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:04:21.292902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786825+0000","last_change":"2024-04-25T22:59:05.783434+0000","last_active":"2024-04-25T22:59:07.786825+0000","last_peered":"2024-04-25T22:59:07.786825+0000","last_clean":"2024-04-25T22:59:07.786825+0000","last_became_active":"2024-04-25T22:59:05.782707+0000","last_became_peered":"2024-04-25T22:59:05.782707+0000","last_unstale":"2024-04-25T22:59:07.786825+0000","last_undegraded":"2024-04-25T22:59:07.786825+0000","last_fullsized":"2024-04-25T22:59:07.786825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784791+0000","last_change":"2024-04-25T22:59:06.783092+0000","last_active":"2024-04-25T22:59:07.784791+0000","last_peered":"2024-04-25T22:59:07.784791+0000","last_clean":"2024-04-25T22:59:07.784791+0000","last_became_active":"2024-04-25T22:59:06.781597+0000","last_became_peered":"2024-04-25T22:59:06.781597+0000","last_unstale":"2024-04-25T22:59:07.784791+0000","last_undegraded":"2024-04-25T22:59:07.784791+0000","last_fullsized":"2024-04-25T22:59:07.784791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:04:26.144135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774685+0000","last_change":"2024-04-25T22:59:05.781889+0000","last_active":"2024-04-25T22:59:08.774685+0000","last_peered":"2024-04-25T22:59:08.774685+0000","last_clean":"2024-04-25T22:59:08.774685+0000","last_became_active":"2024-04-25T22:59:05.781215+0000","last_became_peered":"2024-04-25T22:59:05.781215+0000","last_unstale":"2024-04-25T22:59:08.774685+0000","last_undegraded":"2024-04-25T22:59:08.774685+0000","last_fullsized":"2024-04-25T22:59:08.774685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773227+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T22:59:08.773227+0000","last_peered":"2024-04-25T22:59:08.773227+0000","last_clean":"2024-04-25T22:59:08.773227+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T22:59:08.773227+0000","last_undegraded":"2024-04-25T22:59:08.773227+0000","last_fullsized":"2024-04-25T22:59:08.773227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775643+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T22:59:08.775643+0000","last_peered":"2024-04-25T22:59:08.775643+0000","last_clean":"2024-04-25T22:59:08.775643+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T22:59:08.775643+0000","last_undegraded":"2024-04-25T22:59:08.775643+0000","last_fullsized":"2024-04-25T22:59:08.775643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784373+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T22:59:07.784373+0000","last_peered":"2024-04-25T22:59:07.784373+0000","last_clean":"2024-04-25T22:59:07.784373+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T22:59:07.784373+0000","last_undegraded":"2024-04-25T22:59:07.784373+0000","last_fullsized":"2024-04-25T22:59:07.784373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784877+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T22:59:07.784877+0000","last_peered":"2024-04-25T22:59:07.784877+0000","last_clean":"2024-04-25T22:59:07.784877+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T22:59:07.784877+0000","last_undegraded":"2024-04-25T22:59:07.784877+0000","last_fullsized":"2024-04-25T22:59:07.784877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774655+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.774655+0000","last_peered":"2024-04-25T22:59:08.774655+0000","last_clean":"2024-04-25T22:59:08.774655+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T22:59:08.774655+0000","last_undegraded":"2024-04-25T22:59:08.774655+0000","last_fullsized":"2024-04-25T22:59:08.774655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773605+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T22:59:08.773605+0000","last_peered":"2024-04-25T22:59:08.773605+0000","last_clean":"2024-04-25T22:59:08.773605+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T22:59:08.773605+0000","last_undegraded":"2024-04-25T22:59:08.773605+0000","last_fullsized":"2024-04-25T22:59:08.773605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774537+0000","last_change":"2024-04-25T22:59:06.798000+0000","last_active":"2024-04-25T22:59:08.774537+0000","last_peered":"2024-04-25T22:59:08.774537+0000","last_clean":"2024-04-25T22:59:08.774537+0000","last_became_active":"2024-04-25T22:59:06.793483+0000","last_became_peered":"2024-04-25T22:59:06.793483+0000","last_unstale":"2024-04-25T22:59:08.774537+0000","last_undegraded":"2024-04-25T22:59:08.774537+0000","last_fullsized":"2024-04-25T22:59:08.774537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:19.520617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785194+0000","last_change":"2024-04-25T22:59:05.782797+0000","last_active":"2024-04-25T22:59:07.785194+0000","last_peered":"2024-04-25T22:59:07.785194+0000","last_clean":"2024-04-25T22:59:07.785194+0000","last_became_active":"2024-04-25T22:59:05.782123+0000","last_became_peered":"2024-04-25T22:59:05.782123+0000","last_unstale":"2024-04-25T22:59:07.785194+0000","last_undegraded":"2024-04-25T22:59:07.785194+0000","last_fullsized":"2024-04-25T22:59:07.785194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:05.108258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774720+0000","last_change":"2024-04-25T22:59:06.790685+0000","last_active":"2024-04-25T22:59:08.774720+0000","last_peered":"2024-04-25T22:59:08.774720+0000","last_clean":"2024-04-25T22:59:08.774720+0000","last_became_active":"2024-04-25T22:59:06.789885+0000","last_became_peered":"2024-04-25T22:59:06.789885+0000","last_unstale":"2024-04-25T22:59:08.774720+0000","last_undegraded":"2024-04-25T22:59:08.774720+0000","last_fullsized":"2024-04-25T22:59:08.774720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:53.136204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784183+0000","last_change":"2024-04-25T22:59:05.778598+0000","last_active":"2024-04-25T22:59:07.784183+0000","last_peered":"2024-04-25T22:59:07.784183+0000","last_clean":"2024-04-25T22:59:07.784183+0000","last_became_active":"2024-04-25T22:59:05.777930+0000","last_became_peered":"2024-04-25T22:59:05.777930+0000","last_unstale":"2024-04-25T22:59:07.784183+0000","last_undegraded":"2024-04-25T22:59:07.784183+0000","last_fullsized":"2024-04-25T22:59:07.784183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:51.519857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784585+0000","last_change":"2024-04-25T22:59:06.797741+0000","last_active":"2024-04-25T22:59:07.784585+0000","last_peered":"2024-04-25T22:59:07.784585+0000","last_clean":"2024-04-25T22:59:07.784585+0000","last_became_active":"2024-04-25T22:59:06.793110+0000","last_became_peered":"2024-04-25T22:59:06.793110+0000","last_unstale":"2024-04-25T22:59:07.784585+0000","last_undegraded":"2024-04-25T22:59:07.784585+0000","last_fullsized":"2024-04-25T22:59:07.784585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772959+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:08.772959+0000","last_peered":"2024-04-25T22:59:08.772959+0000","last_clean":"2024-04-25T22:59:08.772959+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:08.772959+0000","last_undegraded":"2024-04-25T22:59:08.772959+0000","last_fullsized":"2024-04-25T22:59:08.772959+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775297+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:08.775297+0000","last_peered":"2024-04-25T22:59:08.775297+0000","last_clean":"2024-04-25T22:59:08.775297+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:08.775297+0000","last_undegraded":"2024-04-25T22:59:08.775297+0000","last_fullsized":"2024-04-25T22:59:08.775297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783426+0000","last_change":"2024-04-25T22:59:05.773462+0000","last_active":"2024-04-25T22:59:07.783426+0000","last_peered":"2024-04-25T22:59:07.783426+0000","last_clean":"2024-04-25T22:59:07.783426+0000","last_became_active":"2024-04-25T22:59:05.772642+0000","last_became_peered":"2024-04-25T22:59:05.772642+0000","last_unstale":"2024-04-25T22:59:07.783426+0000","last_undegraded":"2024-04-25T22:59:07.783426+0000","last_fullsized":"2024-04-25T22:59:07.783426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774660+0000","last_change":"2024-04-25T22:59:06.801333+0000","last_active":"2024-04-25T22:59:08.774660+0000","last_peered":"2024-04-25T22:59:08.774660+0000","last_clean":"2024-04-25T22:59:08.774660+0000","last_became_active":"2024-04-25T22:59:06.793589+0000","last_became_peered":"2024-04-25T22:59:06.793589+0000","last_unstale":"2024-04-25T22:59:08.774660+0000","last_undegraded":"2024-04-25T22:59:08.774660+0000","last_fullsized":"2024-04-25T22:59:08.774660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:21.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772753+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:08.772753+0000","last_peered":"2024-04-25T22:59:08.772753+0000","last_clean":"2024-04-25T22:59:08.772753+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:08.772753+0000","last_undegraded":"2024-04-25T22:59:08.772753+0000","last_fullsized":"2024-04-25T22:59:08.772753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784166+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T22:59:07.784166+0000","last_peered":"2024-04-25T22:59:07.784166+0000","last_clean":"2024-04-25T22:59:07.784166+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T22:59:07.784166+0000","last_undegraded":"2024-04-25T22:59:07.784166+0000","last_fullsized":"2024-04-25T22:59:07.784166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786948+0000","last_change":"2024-04-25T22:59:06.802609+0000","last_active":"2024-04-25T22:59:07.786948+0000","last_peered":"2024-04-25T22:59:07.786948+0000","last_clean":"2024-04-25T22:59:07.786948+0000","last_became_active":"2024-04-25T22:59:06.801566+0000","last_became_peered":"2024-04-25T22:59:06.801566+0000","last_unstale":"2024-04-25T22:59:07.786948+0000","last_undegraded":"2024-04-25T22:59:07.786948+0000","last_fullsized":"2024-04-25T22:59:07.786948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784614+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:07.784614+0000","last_peered":"2024-04-25T22:59:07.784614+0000","last_clean":"2024-04-25T22:59:07.784614+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:07.784614+0000","last_undegraded":"2024-04-25T22:59:07.784614+0000","last_fullsized":"2024-04-25T22:59:07.784614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784434+0000","last_change":"2024-04-25T22:59:05.785151+0000","last_active":"2024-04-25T22:59:07.784434+0000","last_peered":"2024-04-25T22:59:07.784434+0000","last_clean":"2024-04-25T22:59:07.784434+0000","last_became_active":"2024-04-25T22:59:05.784380+0000","last_became_peered":"2024-04-25T22:59:05.784380+0000","last_unstale":"2024-04-25T22:59:07.784434+0000","last_undegraded":"2024-04-25T22:59:07.784434+0000","last_fullsized":"2024-04-25T22:59:07.784434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784554+0000","last_change":"2024-04-25T22:59:06.795334+0000","last_active":"2024-04-25T22:59:07.784554+0000","last_peered":"2024-04-25T22:59:07.784554+0000","last_clean":"2024-04-25T22:59:07.784554+0000","last_became_active":"2024-04-25T22:59:06.790600+0000","last_became_peered":"2024-04-25T22:59:06.790600+0000","last_unstale":"2024-04-25T22:59:07.784554+0000","last_undegraded":"2024-04-25T22:59:07.784554+0000","last_fullsized":"2024-04-25T22:59:07.784554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773619+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:08.773619+0000","last_peered":"2024-04-25T22:59:08.773619+0000","last_clean":"2024-04-25T22:59:08.773619+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:08.773619+0000","last_undegraded":"2024-04-25T22:59:08.773619+0000","last_fullsized":"2024-04-25T22:59:08.773619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774622+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T22:59:08.774622+0000","last_peered":"2024-04-25T22:59:08.774622+0000","last_clean":"2024-04-25T22:59:08.774622+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T22:59:08.774622+0000","last_undegraded":"2024-04-25T22:59:08.774622+0000","last_fullsized":"2024-04-25T22:59:08.774622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784919+0000","last_change":"2024-04-25T22:59:06.792116+0000","last_active":"2024-04-25T22:59:07.784919+0000","last_peered":"2024-04-25T22:59:07.784919+0000","last_clean":"2024-04-25T22:59:07.784919+0000","last_became_active":"2024-04-25T22:59:06.788815+0000","last_became_peered":"2024-04-25T22:59:06.788815+0000","last_unstale":"2024-04-25T22:59:07.784919+0000","last_undegraded":"2024-04-25T22:59:07.784919+0000","last_fullsized":"2024-04-25T22:59:07.784919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775231+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T22:59:08.775231+0000","last_peered":"2024-04-25T22:59:08.775231+0000","last_clean":"2024-04-25T22:59:08.775231+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T22:59:08.775231+0000","last_undegraded":"2024-04-25T22:59:08.775231+0000","last_fullsized":"2024-04-25T22:59:08.775231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784998+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:07.784998+0000","last_peered":"2024-04-25T22:59:07.784998+0000","last_clean":"2024-04-25T22:59:07.784998+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:07.784998+0000","last_undegraded":"2024-04-25T22:59:07.784998+0000","last_fullsized":"2024-04-25T22:59:07.784998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785045+0000","last_change":"2024-04-25T22:59:06.796493+0000","last_active":"2024-04-25T22:59:07.785045+0000","last_peered":"2024-04-25T22:59:07.785045+0000","last_clean":"2024-04-25T22:59:07.785045+0000","last_became_active":"2024-04-25T22:59:06.794987+0000","last_became_peered":"2024-04-25T22:59:06.794987+0000","last_unstale":"2024-04-25T22:59:07.785045+0000","last_undegraded":"2024-04-25T22:59:07.785045+0000","last_fullsized":"2024-04-25T22:59:07.785045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784774+0000","last_change":"2024-04-25T22:59:05.774865+0000","last_active":"2024-04-25T22:59:07.784774+0000","last_peered":"2024-04-25T22:59:07.784774+0000","last_clean":"2024-04-25T22:59:07.784774+0000","last_became_active":"2024-04-25T22:59:05.772893+0000","last_became_peered":"2024-04-25T22:59:05.772893+0000","last_unstale":"2024-04-25T22:59:07.784774+0000","last_undegraded":"2024-04-25T22:59:07.784774+0000","last_fullsized":"2024-04-25T22:59:07.784774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787305+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:07.787305+0000","last_peered":"2024-04-25T22:59:07.787305+0000","last_clean":"2024-04-25T22:59:07.787305+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:07.787305+0000","last_undegraded":"2024-04-25T22:59:07.787305+0000","last_fullsized":"2024-04-25T22:59:07.787305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785251+0000","last_change":"2024-04-25T22:59:06.805539+0000","last_active":"2024-04-25T22:59:07.785251+0000","last_peered":"2024-04-25T22:59:07.785251+0000","last_clean":"2024-04-25T22:59:07.785251+0000","last_became_active":"2024-04-25T22:59:06.804693+0000","last_became_peered":"2024-04-25T22:59:06.804693+0000","last_unstale":"2024-04-25T22:59:07.785251+0000","last_undegraded":"2024-04-25T22:59:07.785251+0000","last_fullsized":"2024-04-25T22:59:07.785251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785775+0000","last_change":"2024-04-25T22:59:05.774273+0000","last_active":"2024-04-25T22:59:07.785775+0000","last_peered":"2024-04-25T22:59:07.785775+0000","last_clean":"2024-04-25T22:59:07.785775+0000","last_became_active":"2024-04-25T22:59:05.773115+0000","last_became_peered":"2024-04-25T22:59:05.773115+0000","last_unstale":"2024-04-25T22:59:07.785775+0000","last_undegraded":"2024-04-25T22:59:07.785775+0000","last_fullsized":"2024-04-25T22:59:07.785775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785665+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:07.785665+0000","last_peered":"2024-04-25T22:59:07.785665+0000","last_clean":"2024-04-25T22:59:07.785665+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:07.785665+0000","last_undegraded":"2024-04-25T22:59:07.785665+0000","last_fullsized":"2024-04-25T22:59:07.785665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784045+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T22:59:07.784045+0000","last_peered":"2024-04-25T22:59:07.784045+0000","last_clean":"2024-04-25T22:59:07.784045+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T22:59:07.784045+0000","last_undegraded":"2024-04-25T22:59:07.784045+0000","last_fullsized":"2024-04-25T22:59:07.784045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785198+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T22:59:07.785198+0000","last_peered":"2024-04-25T22:59:07.785198+0000","last_clean":"2024-04-25T22:59:07.785198+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T22:59:07.785198+0000","last_undegraded":"2024-04-25T22:59:07.785198+0000","last_fullsized":"2024-04-25T22:59:07.785198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774258+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:08.774258+0000","last_peered":"2024-04-25T22:59:08.774258+0000","last_clean":"2024-04-25T22:59:08.774258+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:08.774258+0000","last_undegraded":"2024-04-25T22:59:08.774258+0000","last_fullsized":"2024-04-25T22:59:08.774258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785787+0000","last_change":"2024-04-25T22:59:06.805606+0000","last_active":"2024-04-25T22:59:07.785787+0000","last_peered":"2024-04-25T22:59:07.785787+0000","last_clean":"2024-04-25T22:59:07.785787+0000","last_became_active":"2024-04-25T22:59:06.804741+0000","last_became_peered":"2024-04-25T22:59:06.804741+0000","last_unstale":"2024-04-25T22:59:07.785787+0000","last_undegraded":"2024-04-25T22:59:07.785787+0000","last_fullsized":"2024-04-25T22:59:07.785787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774105+0000","last_change":"2024-04-25T22:59:06.792879+0000","last_active":"2024-04-25T22:59:08.774105+0000","last_peered":"2024-04-25T22:59:08.774105+0000","last_clean":"2024-04-25T22:59:08.774105+0000","last_became_active":"2024-04-25T22:59:06.791896+0000","last_became_peered":"2024-04-25T22:59:06.791896+0000","last_unstale":"2024-04-25T22:59:08.774105+0000","last_undegraded":"2024-04-25T22:59:08.774105+0000","last_fullsized":"2024-04-25T22:59:08.774105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775335+0000","last_change":"2024-04-25T22:59:05.777961+0000","last_active":"2024-04-25T22:59:08.775335+0000","last_peered":"2024-04-25T22:59:08.775335+0000","last_clean":"2024-04-25T22:59:08.775335+0000","last_became_active":"2024-04-25T22:59:05.776419+0000","last_became_peered":"2024-04-25T22:59:05.776419+0000","last_unstale":"2024-04-25T22:59:08.775335+0000","last_undegraded":"2024-04-25T22:59:08.775335+0000","last_fullsized":"2024-04-25T22:59:08.775335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782994+0000","last_change":"2024-04-25T22:59:06.795064+0000","last_active":"2024-04-25T22:59:07.782994+0000","last_peered":"2024-04-25T22:59:07.782994+0000","last_clean":"2024-04-25T22:59:07.782994+0000","last_became_active":"2024-04-25T22:59:06.794164+0000","last_became_peered":"2024-04-25T22:59:06.794164+0000","last_unstale":"2024-04-25T22:59:07.782994+0000","last_undegraded":"2024-04-25T22:59:07.782994+0000","last_fullsized":"2024-04-25T22:59:07.782994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787019+0000","last_change":"2024-04-25T22:59:05.784604+0000","last_active":"2024-04-25T22:59:07.787019+0000","last_peered":"2024-04-25T22:59:07.787019+0000","last_clean":"2024-04-25T22:59:07.787019+0000","last_became_active":"2024-04-25T22:59:05.783730+0000","last_became_peered":"2024-04-25T22:59:05.783730+0000","last_unstale":"2024-04-25T22:59:07.787019+0000","last_undegraded":"2024-04-25T22:59:07.787019+0000","last_fullsized":"2024-04-25T22:59:07.787019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:50.670011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775348+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T22:59:08.775348+0000","last_peered":"2024-04-25T22:59:08.775348+0000","last_clean":"2024-04-25T22:59:08.775348+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T22:59:08.775348+0000","last_undegraded":"2024-04-25T22:59:08.775348+0000","last_fullsized":"2024-04-25T22:59:08.775348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782947+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T22:59:07.782947+0000","last_peered":"2024-04-25T22:59:07.782947+0000","last_clean":"2024-04-25T22:59:07.782947+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T22:59:07.782947+0000","last_undegraded":"2024-04-25T22:59:07.782947+0000","last_fullsized":"2024-04-25T22:59:07.782947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785122+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T22:59:07.785122+0000","last_peered":"2024-04-25T22:59:07.785122+0000","last_clean":"2024-04-25T22:59:07.785122+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T22:59:07.785122+0000","last_undegraded":"2024-04-25T22:59:07.785122+0000","last_fullsized":"2024-04-25T22:59:07.785122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783404+0000","last_change":"2024-04-25T22:59:06.790297+0000","last_active":"2024-04-25T22:59:07.783404+0000","last_peered":"2024-04-25T22:59:07.783404+0000","last_clean":"2024-04-25T22:59:07.783404+0000","last_became_active":"2024-04-25T22:59:06.789200+0000","last_became_peered":"2024-04-25T22:59:06.789200+0000","last_unstale":"2024-04-25T22:59:07.783404+0000","last_undegraded":"2024-04-25T22:59:07.783404+0000","last_fullsized":"2024-04-25T22:59:07.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787179+0000","last_change":"2024-04-25T22:59:06.803808+0000","last_active":"2024-04-25T22:59:07.787179+0000","last_peered":"2024-04-25T22:59:07.787179+0000","last_clean":"2024-04-25T22:59:07.787179+0000","last_became_active":"2024-04-25T22:59:06.803285+0000","last_became_peered":"2024-04-25T22:59:06.803285+0000","last_unstale":"2024-04-25T22:59:07.787179+0000","last_undegraded":"2024-04-25T22:59:07.787179+0000","last_fullsized":"2024-04-25T22:59:07.787179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783578+0000","last_change":"2024-04-25T22:59:05.773898+0000","last_active":"2024-04-25T22:59:07.783578+0000","last_peered":"2024-04-25T22:59:07.783578+0000","last_clean":"2024-04-25T22:59:07.783578+0000","last_became_active":"2024-04-25T22:59:05.773068+0000","last_became_peered":"2024-04-25T22:59:05.773068+0000","last_unstale":"2024-04-25T22:59:07.783578+0000","last_undegraded":"2024-04-25T22:59:07.783578+0000","last_fullsized":"2024-04-25T22:59:07.783578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784179+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T22:59:07.784179+0000","last_peered":"2024-04-25T22:59:07.784179+0000","last_clean":"2024-04-25T22:59:07.784179+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T22:59:07.784179+0000","last_undegraded":"2024-04-25T22:59:07.784179+0000","last_fullsized":"2024-04-25T22:59:07.784179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783103+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T22:59:07.783103+0000","last_peered":"2024-04-25T22:59:07.783103+0000","last_clean":"2024-04-25T22:59:07.783103+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T22:59:07.783103+0000","last_undegraded":"2024-04-25T22:59:07.783103+0000","last_fullsized":"2024-04-25T22:59:07.783103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786627+0000","last_change":"2024-04-25T22:59:06.804422+0000","last_active":"2024-04-25T22:59:07.786627+0000","last_peered":"2024-04-25T22:59:07.786627+0000","last_clean":"2024-04-25T22:59:07.786627+0000","last_became_active":"2024-04-25T22:59:06.803684+0000","last_became_peered":"2024-04-25T22:59:06.803684+0000","last_unstale":"2024-04-25T22:59:07.786627+0000","last_undegraded":"2024-04-25T22:59:07.786627+0000","last_fullsized":"2024-04-25T22:59:07.786627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785200+0000","last_change":"2024-04-25T22:59:05.778693+0000","last_active":"2024-04-25T22:59:07.785200+0000","last_peered":"2024-04-25T22:59:07.785200+0000","last_clean":"2024-04-25T22:59:07.785200+0000","last_became_active":"2024-04-25T22:59:05.777959+0000","last_became_peered":"2024-04-25T22:59:05.777959+0000","last_unstale":"2024-04-25T22:59:07.785200+0000","last_undegraded":"2024-04-25T22:59:07.785200+0000","last_fullsized":"2024-04-25T22:59:07.785200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.955918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785912+0000","last_change":"2024-04-25T22:59:06.802535+0000","last_active":"2024-04-25T22:59:07.785912+0000","last_peered":"2024-04-25T22:59:07.785912+0000","last_clean":"2024-04-25T22:59:07.785912+0000","last_became_active":"2024-04-25T22:59:06.801753+0000","last_became_peered":"2024-04-25T22:59:06.801753+0000","last_unstale":"2024-04-25T22:59:07.785912+0000","last_undegraded":"2024-04-25T22:59:07.785912+0000","last_fullsized":"2024-04-25T22:59:07.785912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785421+0000","last_change":"2024-04-25T22:59:05.784336+0000","last_active":"2024-04-25T22:59:07.785421+0000","last_peered":"2024-04-25T22:59:07.785421+0000","last_clean":"2024-04-25T22:59:07.785421+0000","last_became_active":"2024-04-25T22:59:05.783677+0000","last_became_peered":"2024-04-25T22:59:05.783677+0000","last_unstale":"2024-04-25T22:59:07.785421+0000","last_undegraded":"2024-04-25T22:59:07.785421+0000","last_fullsized":"2024-04-25T22:59:07.785421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:16.113762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773869+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.773869+0000","last_peered":"2024-04-25T22:59:08.773869+0000","last_clean":"2024-04-25T22:59:08.773869+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T22:59:08.773869+0000","last_undegraded":"2024-04-25T22:59:08.773869+0000","last_fullsized":"2024-04-25T22:59:08.773869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775261+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T22:59:08.775261+0000","last_peered":"2024-04-25T22:59:08.775261+0000","last_clean":"2024-04-25T22:59:08.775261+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T22:59:08.775261+0000","last_undegraded":"2024-04-25T22:59:08.775261+0000","last_fullsized":"2024-04-25T22:59:08.775261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773439+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T22:59:08.773439+0000","last_peered":"2024-04-25T22:59:08.773439+0000","last_clean":"2024-04-25T22:59:08.773439+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T22:59:08.773439+0000","last_undegraded":"2024-04-25T22:59:08.773439+0000","last_fullsized":"2024-04-25T22:59:08.773439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786795+0000","last_change":"2024-04-25T22:59:05.784872+0000","last_active":"2024-04-25T22:59:07.786795+0000","last_peered":"2024-04-25T22:59:07.786795+0000","last_clean":"2024-04-25T22:59:07.786795+0000","last_became_active":"2024-04-25T22:59:05.782768+0000","last_became_peered":"2024-04-25T22:59:05.782768+0000","last_unstale":"2024-04-25T22:59:07.786795+0000","last_undegraded":"2024-04-25T22:59:07.786795+0000","last_fullsized":"2024-04-25T22:59:07.786795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:31.688776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786229+0000","last_change":"2024-04-25T22:59:06.803221+0000","last_active":"2024-04-25T22:59:07.786229+0000","last_peered":"2024-04-25T22:59:07.786229+0000","last_clean":"2024-04-25T22:59:07.786229+0000","last_became_active":"2024-04-25T22:59:06.802203+0000","last_became_peered":"2024-04-25T22:59:06.802203+0000","last_unstale":"2024-04-25T22:59:07.786229+0000","last_undegraded":"2024-04-25T22:59:07.786229+0000","last_fullsized":"2024-04-25T22:59:07.786229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784817+0000","last_change":"2024-04-25T22:59:05.773997+0000","last_active":"2024-04-25T22:59:07.784817+0000","last_peered":"2024-04-25T22:59:07.784817+0000","last_clean":"2024-04-25T22:59:07.784817+0000","last_became_active":"2024-04-25T22:59:05.772933+0000","last_became_peered":"2024-04-25T22:59:05.772933+0000","last_unstale":"2024-04-25T22:59:07.784817+0000","last_undegraded":"2024-04-25T22:59:07.784817+0000","last_fullsized":"2024-04-25T22:59:07.784817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772813+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T22:59:08.772813+0000","last_peered":"2024-04-25T22:59:08.772813+0000","last_clean":"2024-04-25T22:59:08.772813+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T22:59:08.772813+0000","last_undegraded":"2024-04-25T22:59:08.772813+0000","last_fullsized":"2024-04-25T22:59:08.772813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784853+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T22:59:07.784853+0000","last_peered":"2024-04-25T22:59:07.784853+0000","last_clean":"2024-04-25T22:59:07.784853+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T22:59:07.784853+0000","last_undegraded":"2024-04-25T22:59:07.784853+0000","last_fullsized":"2024-04-25T22:59:07.784853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:20.591 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:59:20.592 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T22:59:20.592 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T22:59:20.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T22:59:20.958 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:20.958 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T22:59:20.976 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T22:59:20.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:21.279 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:21.279 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:07.768159+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:21.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:58:56.581519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:59:00.664462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:59:04.692579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:59:05.120185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:59:21.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:59:21.598 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T22:59:21.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:59:21.914 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-25T22:59:21.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:59:22.217 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T22:59:22.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:59:22.514 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T22:59:22.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:59:22.850 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:22.850 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:59:06.119108+0000","modified":"2024-04-25T22:59:09.146644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/857639461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":857639461},{"type":"v1","addr":"172.21.15.43:6803","nonce":857639461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-04-25T22:59:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T22:59:22.868 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:23.149 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:23.149 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:07.768159+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:23.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:58:56.581519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:59:00.664462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:59:04.692579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:59:05.120185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:59:23.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:59:23.450 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T22:59:23.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:59:23.756 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-25T22:59:23.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:59:24.055 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T22:59:24.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:59:24.375 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T22:59:24.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:59:24.720 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:24.720 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:59:06.119108+0000","modified":"2024-04-25T22:59:09.146644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/857639461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":857639461},{"type":"v1","addr":"172.21.15.43:6803","nonce":857639461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-04-25T22:59:24.720 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T22:59:24.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:59:25.037 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:25.037 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T22:59:07.768159+0000","last_up_change":"2024-04-25T22:58:54.626266+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:59:25.056 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:59:25.385 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:25.385 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:59:06.119108+0000","modified":"2024-04-25T22:59:09.146644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/857639461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":857639461},{"type":"v1","addr":"172.21.15.43:6803","nonce":857639461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-04-25T22:59:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T22:59:25.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T22:59:06.119108+0000', 'modified': '2024-04-25T22:59:09.146644+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6803/857639461', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6802', 'nonce': 857639461}, {'type': 'v1', 'addr': '172.21.15.43:6803', 'nonce': 857639461}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4239, 'qdb_cluster': [4239]} 2024-04-25T22:59:25.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T22:59:25.505 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T22:59:25.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:25.642+0000 7ff826ffd640 0 client.4496 ms_handle_reset on v2:172.21.15.43:6802/857639461 2024-04-25T22:59:25.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:25.662+0000 7ff826ffd640 0 client.4502 ms_handle_reset on v2:172.21.15.43:6802/857639461 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "8d6ec37a-06d7-4d24-9516-19a660848874", 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4239, 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 18.907471880999999, 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 6, 2024-04-25T22:59:25.668 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 19, 2024-04-25T22:59:25.669 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 19, 2024-04-25T22:59:25.669 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 23.824781366 2024-04-25T22:59:25.669 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T22:59:25.684 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-25T22:59:25.696 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-25T22:59:25.697 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}} 2024-04-25T22:59:25.697 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-25T22:59:25.697 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-25T22:59:25.697 DEBUG:teuthology.orchestra.run.smithi043:> sync 2024-04-25T22:59:25.935 DEBUG:teuthology.orchestra.run.smithi099:> sync 2024-04-25T22:59:26.008 DEBUG:teuthology.orchestra.run.smithi165:> sync 2024-04-25T22:59:26.157 DEBUG:teuthology.orchestra.run.smithi172:> sync 2024-04-25T22:59:26.306 DEBUG:tasks.thrashosds:checking console status of smithi043 2024-04-25T22:59:26.306 DEBUG:teuthology.orchestra.console.smithi043:Waiting for login prompt 2024-04-25T22:59:26.306 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi043 2024-04-25T22:59:26.452 DEBUG:teuthology.orchestra.console.smithi043:expect before: [Enter `^Ec?' for help] 2024-04-25T22:59:26.453 DEBUG:teuthology.orchestra.console.smithi043:expect after: smithi043 login: 2024-04-25T22:59:26.506 DEBUG:teuthology.orchestra.console.smithi043:console disconnect output: [Enter `^Ec?' for help] smithi043 login: [disconnect] 2024-04-25T22:59:26.607 DEBUG:tasks.thrashosds:checking console status of smithi099 2024-04-25T22:59:26.607 DEBUG:teuthology.orchestra.console.smithi099:Waiting for login prompt 2024-04-25T22:59:26.607 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi099 2024-04-25T22:59:26.762 DEBUG:teuthology.orchestra.console.smithi099:expect before: [Enter `^Ec?' for help] 2024-04-25T22:59:26.762 DEBUG:teuthology.orchestra.console.smithi099:expect after: smithi099 login: 2024-04-25T22:59:26.814 DEBUG:teuthology.orchestra.console.smithi099:console disconnect output: [Enter `^Ec?' for help] smithi099 login: [disconnect] 2024-04-25T22:59:26.915 DEBUG:tasks.thrashosds:checking console status of smithi165 2024-04-25T22:59:26.915 DEBUG:teuthology.orchestra.console.smithi165:Waiting for login prompt 2024-04-25T22:59:26.915 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi165 2024-04-25T22:59:27.012 DEBUG:teuthology.orchestra.console.smithi165:expect before: [Enter `^Ec?' for help] 2024-04-25T22:59:27.012 DEBUG:teuthology.orchestra.console.smithi165:expect after: smithi165 login: 2024-04-25T22:59:27.064 DEBUG:teuthology.orchestra.console.smithi165:console disconnect output: [Enter `^Ec?' for help] smithi165 login: [disconnect] 2024-04-25T22:59:27.165 DEBUG:tasks.thrashosds:checking console status of smithi172 2024-04-25T22:59:27.165 DEBUG:teuthology.orchestra.console.smithi172:Waiting for login prompt 2024-04-25T22:59:27.165 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi172 2024-04-25T22:59:27.283 DEBUG:teuthology.orchestra.console.smithi172:expect before: [Enter `^Ec?' for help] 2024-04-25T22:59:27.283 DEBUG:teuthology.orchestra.console.smithi172:expect after: smithi172 login: 2024-04-25T22:59:27.335 DEBUG:teuthology.orchestra.console.smithi172:console disconnect output: [Enter `^Ec?' for help] smithi172 login: [disconnect] 2024-04-25T22:59:27.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-25T22:59:27.783 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-25T22:59:27.783 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:59:27.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:28.089 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:28.091 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:28.105 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T22:59:26.512646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95260,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020260,"statfs":{"total":289910292480,"available":289812746240,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003131"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786579+0000","last_change":"2024-04-25T22:59:06.803693+0000","last_active":"2024-04-25T22:59:07.786579+0000","last_peered":"2024-04-25T22:59:07.786579+0000","last_clean":"2024-04-25T22:59:07.786579+0000","last_became_active":"2024-04-25T22:59:06.802949+0000","last_became_peered":"2024-04-25T22:59:06.802949+0000","last_unstale":"2024-04-25T22:59:07.786579+0000","last_undegraded":"2024-04-25T22:59:07.786579+0000","last_fullsized":"2024-04-25T22:59:07.786579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786674+0000","last_change":"2024-04-25T22:59:06.798862+0000","last_active":"2024-04-25T22:59:07.786674+0000","last_peered":"2024-04-25T22:59:07.786674+0000","last_clean":"2024-04-25T22:59:07.786674+0000","last_became_active":"2024-04-25T22:59:06.798150+0000","last_became_peered":"2024-04-25T22:59:06.798150+0000","last_unstale":"2024-04-25T22:59:07.786674+0000","last_undegraded":"2024-04-25T22:59:07.786674+0000","last_fullsized":"2024-04-25T22:59:07.786674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773768+0000","last_change":"2024-04-25T22:59:06.801047+0000","last_active":"2024-04-25T22:59:08.773768+0000","last_peered":"2024-04-25T22:59:08.773768+0000","last_clean":"2024-04-25T22:59:08.773768+0000","last_became_active":"2024-04-25T22:59:06.797208+0000","last_became_peered":"2024-04-25T22:59:06.797208+0000","last_unstale":"2024-04-25T22:59:08.773768+0000","last_undegraded":"2024-04-25T22:59:08.773768+0000","last_fullsized":"2024-04-25T22:59:08.773768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773795+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T22:59:08.773795+0000","last_peered":"2024-04-25T22:59:08.773795+0000","last_clean":"2024-04-25T22:59:08.773795+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T22:59:08.773795+0000","last_undegraded":"2024-04-25T22:59:08.773795+0000","last_fullsized":"2024-04-25T22:59:08.773795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785508+0000","last_change":"2024-04-25T22:59:06.802597+0000","last_active":"2024-04-25T22:59:07.785508+0000","last_peered":"2024-04-25T22:59:07.785508+0000","last_clean":"2024-04-25T22:59:07.785508+0000","last_became_active":"2024-04-25T22:59:06.801813+0000","last_became_peered":"2024-04-25T22:59:06.801813+0000","last_unstale":"2024-04-25T22:59:07.785508+0000","last_undegraded":"2024-04-25T22:59:07.785508+0000","last_fullsized":"2024-04-25T22:59:07.785508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772797+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T22:59:08.772797+0000","last_peered":"2024-04-25T22:59:08.772797+0000","last_clean":"2024-04-25T22:59:08.772797+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T22:59:08.772797+0000","last_undegraded":"2024-04-25T22:59:08.772797+0000","last_fullsized":"2024-04-25T22:59:08.772797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772307+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T22:59:08.772307+0000","last_peered":"2024-04-25T22:59:08.772307+0000","last_clean":"2024-04-25T22:59:08.772307+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T22:59:08.772307+0000","last_undegraded":"2024-04-25T22:59:08.772307+0000","last_fullsized":"2024-04-25T22:59:08.772307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772095+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T22:59:08.772095+0000","last_peered":"2024-04-25T22:59:08.772095+0000","last_clean":"2024-04-25T22:59:08.772095+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T22:59:08.772095+0000","last_undegraded":"2024-04-25T22:59:08.772095+0000","last_fullsized":"2024-04-25T22:59:08.772095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783702+0000","last_change":"2024-04-25T22:59:06.797839+0000","last_active":"2024-04-25T22:59:07.783702+0000","last_peered":"2024-04-25T22:59:07.783702+0000","last_clean":"2024-04-25T22:59:07.783702+0000","last_became_active":"2024-04-25T22:59:06.793135+0000","last_became_peered":"2024-04-25T22:59:06.793135+0000","last_unstale":"2024-04-25T22:59:07.783702+0000","last_undegraded":"2024-04-25T22:59:07.783702+0000","last_fullsized":"2024-04-25T22:59:07.783702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786282+0000","last_change":"2024-04-25T22:59:06.798833+0000","last_active":"2024-04-25T22:59:07.786282+0000","last_peered":"2024-04-25T22:59:07.786282+0000","last_clean":"2024-04-25T22:59:07.786282+0000","last_became_active":"2024-04-25T22:59:06.798100+0000","last_became_peered":"2024-04-25T22:59:06.798100+0000","last_unstale":"2024-04-25T22:59:07.786282+0000","last_undegraded":"2024-04-25T22:59:07.786282+0000","last_fullsized":"2024-04-25T22:59:07.786282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773891+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T22:59:08.773891+0000","last_peered":"2024-04-25T22:59:08.773891+0000","last_clean":"2024-04-25T22:59:08.773891+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T22:59:08.773891+0000","last_undegraded":"2024-04-25T22:59:08.773891+0000","last_fullsized":"2024-04-25T22:59:08.773891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785565+0000","last_change":"2024-04-25T22:59:06.814696+0000","last_active":"2024-04-25T22:59:07.785565+0000","last_peered":"2024-04-25T22:59:07.785565+0000","last_clean":"2024-04-25T22:59:07.785565+0000","last_became_active":"2024-04-25T22:59:06.813961+0000","last_became_peered":"2024-04-25T22:59:06.813961+0000","last_unstale":"2024-04-25T22:59:07.785565+0000","last_undegraded":"2024-04-25T22:59:07.785565+0000","last_fullsized":"2024-04-25T22:59:07.785565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785037+0000","last_change":"2024-04-25T22:59:06.782280+0000","last_active":"2024-04-25T22:59:07.785037+0000","last_peered":"2024-04-25T22:59:07.785037+0000","last_clean":"2024-04-25T22:59:07.785037+0000","last_became_active":"2024-04-25T22:59:06.781484+0000","last_became_peered":"2024-04-25T22:59:06.781484+0000","last_unstale":"2024-04-25T22:59:07.785037+0000","last_undegraded":"2024-04-25T22:59:07.785037+0000","last_fullsized":"2024-04-25T22:59:07.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772933+0000","last_change":"2024-04-25T22:59:06.791816+0000","last_active":"2024-04-25T22:59:08.772933+0000","last_peered":"2024-04-25T22:59:08.772933+0000","last_clean":"2024-04-25T22:59:08.772933+0000","last_became_active":"2024-04-25T22:59:06.789994+0000","last_became_peered":"2024-04-25T22:59:06.789994+0000","last_unstale":"2024-04-25T22:59:08.772933+0000","last_undegraded":"2024-04-25T22:59:08.772933+0000","last_fullsized":"2024-04-25T22:59:08.772933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772628+0000","last_change":"2024-04-25T22:59:06.790804+0000","last_active":"2024-04-25T22:59:08.772628+0000","last_peered":"2024-04-25T22:59:08.772628+0000","last_clean":"2024-04-25T22:59:08.772628+0000","last_became_active":"2024-04-25T22:59:06.789720+0000","last_became_peered":"2024-04-25T22:59:06.789720+0000","last_unstale":"2024-04-25T22:59:08.772628+0000","last_undegraded":"2024-04-25T22:59:08.772628+0000","last_fullsized":"2024-04-25T22:59:08.772628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772244+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T22:59:08.772244+0000","last_peered":"2024-04-25T22:59:08.772244+0000","last_clean":"2024-04-25T22:59:08.772244+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T22:59:08.772244+0000","last_undegraded":"2024-04-25T22:59:08.772244+0000","last_fullsized":"2024-04-25T22:59:08.772244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785932+0000","last_change":"2024-04-25T22:59:06.797073+0000","last_active":"2024-04-25T22:59:07.785932+0000","last_peered":"2024-04-25T22:59:07.785932+0000","last_clean":"2024-04-25T22:59:07.785932+0000","last_became_active":"2024-04-25T22:59:06.791141+0000","last_became_peered":"2024-04-25T22:59:06.791141+0000","last_unstale":"2024-04-25T22:59:07.785932+0000","last_undegraded":"2024-04-25T22:59:07.785932+0000","last_fullsized":"2024-04-25T22:59:07.785932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786658+0000","last_change":"2024-04-25T22:59:06.804912+0000","last_active":"2024-04-25T22:59:07.786658+0000","last_peered":"2024-04-25T22:59:07.786658+0000","last_clean":"2024-04-25T22:59:07.786658+0000","last_became_active":"2024-04-25T22:59:06.804100+0000","last_became_peered":"2024-04-25T22:59:06.804100+0000","last_unstale":"2024-04-25T22:59:07.786658+0000","last_undegraded":"2024-04-25T22:59:07.786658+0000","last_fullsized":"2024-04-25T22:59:07.786658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783693+0000","last_change":"2024-04-25T22:59:06.791947+0000","last_active":"2024-04-25T22:59:07.783693+0000","last_peered":"2024-04-25T22:59:07.783693+0000","last_clean":"2024-04-25T22:59:07.783693+0000","last_became_active":"2024-04-25T22:59:06.791064+0000","last_became_peered":"2024-04-25T22:59:06.791064+0000","last_unstale":"2024-04-25T22:59:07.783693+0000","last_undegraded":"2024-04-25T22:59:07.783693+0000","last_fullsized":"2024-04-25T22:59:07.783693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774184+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T22:59:08.774184+0000","last_peered":"2024-04-25T22:59:08.774184+0000","last_clean":"2024-04-25T22:59:08.774184+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T22:59:08.774184+0000","last_undegraded":"2024-04-25T22:59:08.774184+0000","last_fullsized":"2024-04-25T22:59:08.774184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774337+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T22:59:08.774337+0000","last_peered":"2024-04-25T22:59:08.774337+0000","last_clean":"2024-04-25T22:59:08.774337+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T22:59:08.774337+0000","last_undegraded":"2024-04-25T22:59:08.774337+0000","last_fullsized":"2024-04-25T22:59:08.774337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784814+0000","last_change":"2024-04-25T22:59:06.795909+0000","last_active":"2024-04-25T22:59:07.784814+0000","last_peered":"2024-04-25T22:59:07.784814+0000","last_clean":"2024-04-25T22:59:07.784814+0000","last_became_active":"2024-04-25T22:59:06.794998+0000","last_became_peered":"2024-04-25T22:59:06.794998+0000","last_unstale":"2024-04-25T22:59:07.784814+0000","last_undegraded":"2024-04-25T22:59:07.784814+0000","last_fullsized":"2024-04-25T22:59:07.784814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:17.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782504+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T22:59:07.782504+0000","last_peered":"2024-04-25T22:59:07.782504+0000","last_clean":"2024-04-25T22:59:07.782504+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T22:59:07.782504+0000","last_undegraded":"2024-04-25T22:59:07.782504+0000","last_fullsized":"2024-04-25T22:59:07.782504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784098+0000","last_change":"2024-04-25T22:59:06.783226+0000","last_active":"2024-04-25T22:59:07.784098+0000","last_peered":"2024-04-25T22:59:07.784098+0000","last_clean":"2024-04-25T22:59:07.784098+0000","last_became_active":"2024-04-25T22:59:06.781774+0000","last_became_peered":"2024-04-25T22:59:06.781774+0000","last_unstale":"2024-04-25T22:59:07.784098+0000","last_undegraded":"2024-04-25T22:59:07.784098+0000","last_fullsized":"2024-04-25T22:59:07.784098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:03.122921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787216+0000","last_change":"2024-04-25T22:59:06.795806+0000","last_active":"2024-04-25T22:59:07.787216+0000","last_peered":"2024-04-25T22:59:07.787216+0000","last_clean":"2024-04-25T22:59:07.787216+0000","last_became_active":"2024-04-25T22:59:06.794632+0000","last_became_peered":"2024-04-25T22:59:06.794632+0000","last_unstale":"2024-04-25T22:59:07.787216+0000","last_undegraded":"2024-04-25T22:59:07.787216+0000","last_fullsized":"2024-04-25T22:59:07.787216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784343+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T22:59:07.784343+0000","last_peered":"2024-04-25T22:59:07.784343+0000","last_clean":"2024-04-25T22:59:07.784343+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T22:59:07.784343+0000","last_undegraded":"2024-04-25T22:59:07.784343+0000","last_fullsized":"2024-04-25T22:59:07.784343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774180+0000","last_change":"2024-04-25T22:59:06.800124+0000","last_active":"2024-04-25T22:59:08.774180+0000","last_peered":"2024-04-25T22:59:08.774180+0000","last_clean":"2024-04-25T22:59:08.774180+0000","last_became_active":"2024-04-25T22:59:06.794619+0000","last_became_peered":"2024-04-25T22:59:06.794619+0000","last_unstale":"2024-04-25T22:59:08.774180+0000","last_undegraded":"2024-04-25T22:59:08.774180+0000","last_fullsized":"2024-04-25T22:59:08.774180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:46.277348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786991+0000","last_change":"2024-04-25T22:59:06.814869+0000","last_active":"2024-04-25T22:59:07.786991+0000","last_peered":"2024-04-25T22:59:07.786991+0000","last_clean":"2024-04-25T22:59:07.786991+0000","last_became_active":"2024-04-25T22:59:06.813986+0000","last_became_peered":"2024-04-25T22:59:06.813986+0000","last_unstale":"2024-04-25T22:59:07.786991+0000","last_undegraded":"2024-04-25T22:59:07.786991+0000","last_fullsized":"2024-04-25T22:59:07.786991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783735+0000","last_change":"2024-04-25T22:59:06.791151+0000","last_active":"2024-04-25T22:59:07.783735+0000","last_peered":"2024-04-25T22:59:07.783735+0000","last_clean":"2024-04-25T22:59:07.783735+0000","last_became_active":"2024-04-25T22:59:06.790017+0000","last_became_peered":"2024-04-25T22:59:06.790017+0000","last_unstale":"2024-04-25T22:59:07.783735+0000","last_undegraded":"2024-04-25T22:59:07.783735+0000","last_fullsized":"2024-04-25T22:59:07.783735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785653+0000","last_change":"2024-04-25T22:59:06.796874+0000","last_active":"2024-04-25T22:59:07.785653+0000","last_peered":"2024-04-25T22:59:07.785653+0000","last_clean":"2024-04-25T22:59:07.785653+0000","last_became_active":"2024-04-25T22:59:06.796100+0000","last_became_peered":"2024-04-25T22:59:06.796100+0000","last_unstale":"2024-04-25T22:59:07.785653+0000","last_undegraded":"2024-04-25T22:59:07.785653+0000","last_fullsized":"2024-04-25T22:59:07.785653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782734+0000","last_change":"2024-04-25T22:59:06.794741+0000","last_active":"2024-04-25T22:59:07.782734+0000","last_peered":"2024-04-25T22:59:07.782734+0000","last_clean":"2024-04-25T22:59:07.782734+0000","last_became_active":"2024-04-25T22:59:06.793264+0000","last_became_peered":"2024-04-25T22:59:06.793264+0000","last_unstale":"2024-04-25T22:59:07.782734+0000","last_undegraded":"2024-04-25T22:59:07.782734+0000","last_fullsized":"2024-04-25T22:59:07.782734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772605+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T22:59:08.772605+0000","last_peered":"2024-04-25T22:59:08.772605+0000","last_clean":"2024-04-25T22:59:08.772605+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T22:59:08.772605+0000","last_undegraded":"2024-04-25T22:59:08.772605+0000","last_fullsized":"2024-04-25T22:59:08.772605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786119+0000","last_change":"2024-04-25T22:59:06.802067+0000","last_active":"2024-04-25T22:59:07.786119+0000","last_peered":"2024-04-25T22:59:07.786119+0000","last_clean":"2024-04-25T22:59:07.786119+0000","last_became_active":"2024-04-25T22:59:06.801322+0000","last_became_peered":"2024-04-25T22:59:06.801322+0000","last_unstale":"2024-04-25T22:59:07.786119+0000","last_undegraded":"2024-04-25T22:59:07.786119+0000","last_fullsized":"2024-04-25T22:59:07.786119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774524+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T22:59:08.774524+0000","last_peered":"2024-04-25T22:59:08.774524+0000","last_clean":"2024-04-25T22:59:08.774524+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T22:59:08.774524+0000","last_undegraded":"2024-04-25T22:59:08.774524+0000","last_fullsized":"2024-04-25T22:59:08.774524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786655+0000","last_change":"2024-04-25T22:59:06.798452+0000","last_active":"2024-04-25T22:59:07.786655+0000","last_peered":"2024-04-25T22:59:07.786655+0000","last_clean":"2024-04-25T22:59:07.786655+0000","last_became_active":"2024-04-25T22:59:06.797421+0000","last_became_peered":"2024-04-25T22:59:06.797421+0000","last_unstale":"2024-04-25T22:59:07.786655+0000","last_undegraded":"2024-04-25T22:59:07.786655+0000","last_fullsized":"2024-04-25T22:59:07.786655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783153+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T22:59:07.783153+0000","last_peered":"2024-04-25T22:59:07.783153+0000","last_clean":"2024-04-25T22:59:07.783153+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T22:59:07.783153+0000","last_undegraded":"2024-04-25T22:59:07.783153+0000","last_fullsized":"2024-04-25T22:59:07.783153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785193+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T22:59:07.785193+0000","last_peered":"2024-04-25T22:59:07.785193+0000","last_clean":"2024-04-25T22:59:07.785193+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T22:59:07.785193+0000","last_undegraded":"2024-04-25T22:59:07.785193+0000","last_fullsized":"2024-04-25T22:59:07.785193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784937+0000","last_change":"2024-04-25T22:59:05.782753+0000","last_active":"2024-04-25T22:59:07.784937+0000","last_peered":"2024-04-25T22:59:07.784937+0000","last_clean":"2024-04-25T22:59:07.784937+0000","last_became_active":"2024-04-25T22:59:05.782002+0000","last_became_peered":"2024-04-25T22:59:05.782002+0000","last_unstale":"2024-04-25T22:59:07.784937+0000","last_undegraded":"2024-04-25T22:59:07.784937+0000","last_fullsized":"2024-04-25T22:59:07.784937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:49.136410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784128+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T22:59:07.784128+0000","last_peered":"2024-04-25T22:59:07.784128+0000","last_clean":"2024-04-25T22:59:07.784128+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T22:59:07.784128+0000","last_undegraded":"2024-04-25T22:59:07.784128+0000","last_fullsized":"2024-04-25T22:59:07.784128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772345+0000","last_change":"2024-04-25T22:59:05.781315+0000","last_active":"2024-04-25T22:59:08.772345+0000","last_peered":"2024-04-25T22:59:08.772345+0000","last_clean":"2024-04-25T22:59:08.772345+0000","last_became_active":"2024-04-25T22:59:05.780508+0000","last_became_peered":"2024-04-25T22:59:05.780508+0000","last_unstale":"2024-04-25T22:59:08.772345+0000","last_undegraded":"2024-04-25T22:59:08.772345+0000","last_fullsized":"2024-04-25T22:59:08.772345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774108+0000","last_change":"2024-04-25T22:59:05.781365+0000","last_active":"2024-04-25T22:59:08.774108+0000","last_peered":"2024-04-25T22:59:08.774108+0000","last_clean":"2024-04-25T22:59:08.774108+0000","last_became_active":"2024-04-25T22:59:05.779706+0000","last_became_peered":"2024-04-25T22:59:05.779706+0000","last_unstale":"2024-04-25T22:59:08.774108+0000","last_undegraded":"2024-04-25T22:59:08.774108+0000","last_fullsized":"2024-04-25T22:59:08.774108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784266+0000","last_change":"2024-04-25T22:59:06.814657+0000","last_active":"2024-04-25T22:59:07.784266+0000","last_peered":"2024-04-25T22:59:07.784266+0000","last_clean":"2024-04-25T22:59:07.784266+0000","last_became_active":"2024-04-25T22:59:06.814089+0000","last_became_peered":"2024-04-25T22:59:06.814089+0000","last_unstale":"2024-04-25T22:59:07.784266+0000","last_undegraded":"2024-04-25T22:59:07.784266+0000","last_fullsized":"2024-04-25T22:59:07.784266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:04:21.292902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786825+0000","last_change":"2024-04-25T22:59:05.783434+0000","last_active":"2024-04-25T22:59:07.786825+0000","last_peered":"2024-04-25T22:59:07.786825+0000","last_clean":"2024-04-25T22:59:07.786825+0000","last_became_active":"2024-04-25T22:59:05.782707+0000","last_became_peered":"2024-04-25T22:59:05.782707+0000","last_unstale":"2024-04-25T22:59:07.786825+0000","last_undegraded":"2024-04-25T22:59:07.786825+0000","last_fullsized":"2024-04-25T22:59:07.786825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784791+0000","last_change":"2024-04-25T22:59:06.783092+0000","last_active":"2024-04-25T22:59:07.784791+0000","last_peered":"2024-04-25T22:59:07.784791+0000","last_clean":"2024-04-25T22:59:07.784791+0000","last_became_active":"2024-04-25T22:59:06.781597+0000","last_became_peered":"2024-04-25T22:59:06.781597+0000","last_unstale":"2024-04-25T22:59:07.784791+0000","last_undegraded":"2024-04-25T22:59:07.784791+0000","last_fullsized":"2024-04-25T22:59:07.784791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:04:26.144135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774685+0000","last_change":"2024-04-25T22:59:05.781889+0000","last_active":"2024-04-25T22:59:08.774685+0000","last_peered":"2024-04-25T22:59:08.774685+0000","last_clean":"2024-04-25T22:59:08.774685+0000","last_became_active":"2024-04-25T22:59:05.781215+0000","last_became_peered":"2024-04-25T22:59:05.781215+0000","last_unstale":"2024-04-25T22:59:08.774685+0000","last_undegraded":"2024-04-25T22:59:08.774685+0000","last_fullsized":"2024-04-25T22:59:08.774685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773227+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T22:59:08.773227+0000","last_peered":"2024-04-25T22:59:08.773227+0000","last_clean":"2024-04-25T22:59:08.773227+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T22:59:08.773227+0000","last_undegraded":"2024-04-25T22:59:08.773227+0000","last_fullsized":"2024-04-25T22:59:08.773227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775643+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T22:59:08.775643+0000","last_peered":"2024-04-25T22:59:08.775643+0000","last_clean":"2024-04-25T22:59:08.775643+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T22:59:08.775643+0000","last_undegraded":"2024-04-25T22:59:08.775643+0000","last_fullsized":"2024-04-25T22:59:08.775643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784373+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T22:59:07.784373+0000","last_peered":"2024-04-25T22:59:07.784373+0000","last_clean":"2024-04-25T22:59:07.784373+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T22:59:07.784373+0000","last_undegraded":"2024-04-25T22:59:07.784373+0000","last_fullsized":"2024-04-25T22:59:07.784373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784877+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T22:59:07.784877+0000","last_peered":"2024-04-25T22:59:07.784877+0000","last_clean":"2024-04-25T22:59:07.784877+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T22:59:07.784877+0000","last_undegraded":"2024-04-25T22:59:07.784877+0000","last_fullsized":"2024-04-25T22:59:07.784877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774655+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.774655+0000","last_peered":"2024-04-25T22:59:08.774655+0000","last_clean":"2024-04-25T22:59:08.774655+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T22:59:08.774655+0000","last_undegraded":"2024-04-25T22:59:08.774655+0000","last_fullsized":"2024-04-25T22:59:08.774655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773605+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T22:59:08.773605+0000","last_peered":"2024-04-25T22:59:08.773605+0000","last_clean":"2024-04-25T22:59:08.773605+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T22:59:08.773605+0000","last_undegraded":"2024-04-25T22:59:08.773605+0000","last_fullsized":"2024-04-25T22:59:08.773605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774537+0000","last_change":"2024-04-25T22:59:06.798000+0000","last_active":"2024-04-25T22:59:08.774537+0000","last_peered":"2024-04-25T22:59:08.774537+0000","last_clean":"2024-04-25T22:59:08.774537+0000","last_became_active":"2024-04-25T22:59:06.793483+0000","last_became_peered":"2024-04-25T22:59:06.793483+0000","last_unstale":"2024-04-25T22:59:08.774537+0000","last_undegraded":"2024-04-25T22:59:08.774537+0000","last_fullsized":"2024-04-25T22:59:08.774537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:19.520617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785194+0000","last_change":"2024-04-25T22:59:05.782797+0000","last_active":"2024-04-25T22:59:07.785194+0000","last_peered":"2024-04-25T22:59:07.785194+0000","last_clean":"2024-04-25T22:59:07.785194+0000","last_became_active":"2024-04-25T22:59:05.782123+0000","last_became_peered":"2024-04-25T22:59:05.782123+0000","last_unstale":"2024-04-25T22:59:07.785194+0000","last_undegraded":"2024-04-25T22:59:07.785194+0000","last_fullsized":"2024-04-25T22:59:07.785194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:05.108258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774720+0000","last_change":"2024-04-25T22:59:06.790685+0000","last_active":"2024-04-25T22:59:08.774720+0000","last_peered":"2024-04-25T22:59:08.774720+0000","last_clean":"2024-04-25T22:59:08.774720+0000","last_became_active":"2024-04-25T22:59:06.789885+0000","last_became_peered":"2024-04-25T22:59:06.789885+0000","last_unstale":"2024-04-25T22:59:08.774720+0000","last_undegraded":"2024-04-25T22:59:08.774720+0000","last_fullsized":"2024-04-25T22:59:08.774720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:53.136204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784183+0000","last_change":"2024-04-25T22:59:05.778598+0000","last_active":"2024-04-25T22:59:07.784183+0000","last_peered":"2024-04-25T22:59:07.784183+0000","last_clean":"2024-04-25T22:59:07.784183+0000","last_became_active":"2024-04-25T22:59:05.777930+0000","last_became_peered":"2024-04-25T22:59:05.777930+0000","last_unstale":"2024-04-25T22:59:07.784183+0000","last_undegraded":"2024-04-25T22:59:07.784183+0000","last_fullsized":"2024-04-25T22:59:07.784183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:51.519857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784585+0000","last_change":"2024-04-25T22:59:06.797741+0000","last_active":"2024-04-25T22:59:07.784585+0000","last_peered":"2024-04-25T22:59:07.784585+0000","last_clean":"2024-04-25T22:59:07.784585+0000","last_became_active":"2024-04-25T22:59:06.793110+0000","last_became_peered":"2024-04-25T22:59:06.793110+0000","last_unstale":"2024-04-25T22:59:07.784585+0000","last_undegraded":"2024-04-25T22:59:07.784585+0000","last_fullsized":"2024-04-25T22:59:07.784585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772959+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:08.772959+0000","last_peered":"2024-04-25T22:59:08.772959+0000","last_clean":"2024-04-25T22:59:08.772959+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:08.772959+0000","last_undegraded":"2024-04-25T22:59:08.772959+0000","last_fullsized":"2024-04-25T22:59:08.772959+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775297+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:08.775297+0000","last_peered":"2024-04-25T22:59:08.775297+0000","last_clean":"2024-04-25T22:59:08.775297+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:08.775297+0000","last_undegraded":"2024-04-25T22:59:08.775297+0000","last_fullsized":"2024-04-25T22:59:08.775297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783426+0000","last_change":"2024-04-25T22:59:05.773462+0000","last_active":"2024-04-25T22:59:07.783426+0000","last_peered":"2024-04-25T22:59:07.783426+0000","last_clean":"2024-04-25T22:59:07.783426+0000","last_became_active":"2024-04-25T22:59:05.772642+0000","last_became_peered":"2024-04-25T22:59:05.772642+0000","last_unstale":"2024-04-25T22:59:07.783426+0000","last_undegraded":"2024-04-25T22:59:07.783426+0000","last_fullsized":"2024-04-25T22:59:07.783426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774660+0000","last_change":"2024-04-25T22:59:06.801333+0000","last_active":"2024-04-25T22:59:08.774660+0000","last_peered":"2024-04-25T22:59:08.774660+0000","last_clean":"2024-04-25T22:59:08.774660+0000","last_became_active":"2024-04-25T22:59:06.793589+0000","last_became_peered":"2024-04-25T22:59:06.793589+0000","last_unstale":"2024-04-25T22:59:08.774660+0000","last_undegraded":"2024-04-25T22:59:08.774660+0000","last_fullsized":"2024-04-25T22:59:08.774660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:21.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772753+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:08.772753+0000","last_peered":"2024-04-25T22:59:08.772753+0000","last_clean":"2024-04-25T22:59:08.772753+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:08.772753+0000","last_undegraded":"2024-04-25T22:59:08.772753+0000","last_fullsized":"2024-04-25T22:59:08.772753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784166+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T22:59:07.784166+0000","last_peered":"2024-04-25T22:59:07.784166+0000","last_clean":"2024-04-25T22:59:07.784166+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T22:59:07.784166+0000","last_undegraded":"2024-04-25T22:59:07.784166+0000","last_fullsized":"2024-04-25T22:59:07.784166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786948+0000","last_change":"2024-04-25T22:59:06.802609+0000","last_active":"2024-04-25T22:59:07.786948+0000","last_peered":"2024-04-25T22:59:07.786948+0000","last_clean":"2024-04-25T22:59:07.786948+0000","last_became_active":"2024-04-25T22:59:06.801566+0000","last_became_peered":"2024-04-25T22:59:06.801566+0000","last_unstale":"2024-04-25T22:59:07.786948+0000","last_undegraded":"2024-04-25T22:59:07.786948+0000","last_fullsized":"2024-04-25T22:59:07.786948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784614+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:07.784614+0000","last_peered":"2024-04-25T22:59:07.784614+0000","last_clean":"2024-04-25T22:59:07.784614+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:07.784614+0000","last_undegraded":"2024-04-25T22:59:07.784614+0000","last_fullsized":"2024-04-25T22:59:07.784614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784434+0000","last_change":"2024-04-25T22:59:05.785151+0000","last_active":"2024-04-25T22:59:07.784434+0000","last_peered":"2024-04-25T22:59:07.784434+0000","last_clean":"2024-04-25T22:59:07.784434+0000","last_became_active":"2024-04-25T22:59:05.784380+0000","last_became_peered":"2024-04-25T22:59:05.784380+0000","last_unstale":"2024-04-25T22:59:07.784434+0000","last_undegraded":"2024-04-25T22:59:07.784434+0000","last_fullsized":"2024-04-25T22:59:07.784434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784554+0000","last_change":"2024-04-25T22:59:06.795334+0000","last_active":"2024-04-25T22:59:07.784554+0000","last_peered":"2024-04-25T22:59:07.784554+0000","last_clean":"2024-04-25T22:59:07.784554+0000","last_became_active":"2024-04-25T22:59:06.790600+0000","last_became_peered":"2024-04-25T22:59:06.790600+0000","last_unstale":"2024-04-25T22:59:07.784554+0000","last_undegraded":"2024-04-25T22:59:07.784554+0000","last_fullsized":"2024-04-25T22:59:07.784554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773619+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:08.773619+0000","last_peered":"2024-04-25T22:59:08.773619+0000","last_clean":"2024-04-25T22:59:08.773619+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:08.773619+0000","last_undegraded":"2024-04-25T22:59:08.773619+0000","last_fullsized":"2024-04-25T22:59:08.773619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774622+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T22:59:08.774622+0000","last_peered":"2024-04-25T22:59:08.774622+0000","last_clean":"2024-04-25T22:59:08.774622+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T22:59:08.774622+0000","last_undegraded":"2024-04-25T22:59:08.774622+0000","last_fullsized":"2024-04-25T22:59:08.774622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784919+0000","last_change":"2024-04-25T22:59:06.792116+0000","last_active":"2024-04-25T22:59:07.784919+0000","last_peered":"2024-04-25T22:59:07.784919+0000","last_clean":"2024-04-25T22:59:07.784919+0000","last_became_active":"2024-04-25T22:59:06.788815+0000","last_became_peered":"2024-04-25T22:59:06.788815+0000","last_unstale":"2024-04-25T22:59:07.784919+0000","last_undegraded":"2024-04-25T22:59:07.784919+0000","last_fullsized":"2024-04-25T22:59:07.784919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775231+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T22:59:08.775231+0000","last_peered":"2024-04-25T22:59:08.775231+0000","last_clean":"2024-04-25T22:59:08.775231+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T22:59:08.775231+0000","last_undegraded":"2024-04-25T22:59:08.775231+0000","last_fullsized":"2024-04-25T22:59:08.775231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784998+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:07.784998+0000","last_peered":"2024-04-25T22:59:07.784998+0000","last_clean":"2024-04-25T22:59:07.784998+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:07.784998+0000","last_undegraded":"2024-04-25T22:59:07.784998+0000","last_fullsized":"2024-04-25T22:59:07.784998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785045+0000","last_change":"2024-04-25T22:59:06.796493+0000","last_active":"2024-04-25T22:59:07.785045+0000","last_peered":"2024-04-25T22:59:07.785045+0000","last_clean":"2024-04-25T22:59:07.785045+0000","last_became_active":"2024-04-25T22:59:06.794987+0000","last_became_peered":"2024-04-25T22:59:06.794987+0000","last_unstale":"2024-04-25T22:59:07.785045+0000","last_undegraded":"2024-04-25T22:59:07.785045+0000","last_fullsized":"2024-04-25T22:59:07.785045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784774+0000","last_change":"2024-04-25T22:59:05.774865+0000","last_active":"2024-04-25T22:59:07.784774+0000","last_peered":"2024-04-25T22:59:07.784774+0000","last_clean":"2024-04-25T22:59:07.784774+0000","last_became_active":"2024-04-25T22:59:05.772893+0000","last_became_peered":"2024-04-25T22:59:05.772893+0000","last_unstale":"2024-04-25T22:59:07.784774+0000","last_undegraded":"2024-04-25T22:59:07.784774+0000","last_fullsized":"2024-04-25T22:59:07.784774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787305+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:07.787305+0000","last_peered":"2024-04-25T22:59:07.787305+0000","last_clean":"2024-04-25T22:59:07.787305+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:07.787305+0000","last_undegraded":"2024-04-25T22:59:07.787305+0000","last_fullsized":"2024-04-25T22:59:07.787305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785251+0000","last_change":"2024-04-25T22:59:06.805539+0000","last_active":"2024-04-25T22:59:07.785251+0000","last_peered":"2024-04-25T22:59:07.785251+0000","last_clean":"2024-04-25T22:59:07.785251+0000","last_became_active":"2024-04-25T22:59:06.804693+0000","last_became_peered":"2024-04-25T22:59:06.804693+0000","last_unstale":"2024-04-25T22:59:07.785251+0000","last_undegraded":"2024-04-25T22:59:07.785251+0000","last_fullsized":"2024-04-25T22:59:07.785251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785775+0000","last_change":"2024-04-25T22:59:05.774273+0000","last_active":"2024-04-25T22:59:07.785775+0000","last_peered":"2024-04-25T22:59:07.785775+0000","last_clean":"2024-04-25T22:59:07.785775+0000","last_became_active":"2024-04-25T22:59:05.773115+0000","last_became_peered":"2024-04-25T22:59:05.773115+0000","last_unstale":"2024-04-25T22:59:07.785775+0000","last_undegraded":"2024-04-25T22:59:07.785775+0000","last_fullsized":"2024-04-25T22:59:07.785775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785665+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:07.785665+0000","last_peered":"2024-04-25T22:59:07.785665+0000","last_clean":"2024-04-25T22:59:07.785665+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:07.785665+0000","last_undegraded":"2024-04-25T22:59:07.785665+0000","last_fullsized":"2024-04-25T22:59:07.785665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784045+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T22:59:07.784045+0000","last_peered":"2024-04-25T22:59:07.784045+0000","last_clean":"2024-04-25T22:59:07.784045+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T22:59:07.784045+0000","last_undegraded":"2024-04-25T22:59:07.784045+0000","last_fullsized":"2024-04-25T22:59:07.784045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785198+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T22:59:07.785198+0000","last_peered":"2024-04-25T22:59:07.785198+0000","last_clean":"2024-04-25T22:59:07.785198+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T22:59:07.785198+0000","last_undegraded":"2024-04-25T22:59:07.785198+0000","last_fullsized":"2024-04-25T22:59:07.785198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774258+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:08.774258+0000","last_peered":"2024-04-25T22:59:08.774258+0000","last_clean":"2024-04-25T22:59:08.774258+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:08.774258+0000","last_undegraded":"2024-04-25T22:59:08.774258+0000","last_fullsized":"2024-04-25T22:59:08.774258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785787+0000","last_change":"2024-04-25T22:59:06.805606+0000","last_active":"2024-04-25T22:59:07.785787+0000","last_peered":"2024-04-25T22:59:07.785787+0000","last_clean":"2024-04-25T22:59:07.785787+0000","last_became_active":"2024-04-25T22:59:06.804741+0000","last_became_peered":"2024-04-25T22:59:06.804741+0000","last_unstale":"2024-04-25T22:59:07.785787+0000","last_undegraded":"2024-04-25T22:59:07.785787+0000","last_fullsized":"2024-04-25T22:59:07.785787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774105+0000","last_change":"2024-04-25T22:59:06.792879+0000","last_active":"2024-04-25T22:59:08.774105+0000","last_peered":"2024-04-25T22:59:08.774105+0000","last_clean":"2024-04-25T22:59:08.774105+0000","last_became_active":"2024-04-25T22:59:06.791896+0000","last_became_peered":"2024-04-25T22:59:06.791896+0000","last_unstale":"2024-04-25T22:59:08.774105+0000","last_undegraded":"2024-04-25T22:59:08.774105+0000","last_fullsized":"2024-04-25T22:59:08.774105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775335+0000","last_change":"2024-04-25T22:59:05.777961+0000","last_active":"2024-04-25T22:59:08.775335+0000","last_peered":"2024-04-25T22:59:08.775335+0000","last_clean":"2024-04-25T22:59:08.775335+0000","last_became_active":"2024-04-25T22:59:05.776419+0000","last_became_peered":"2024-04-25T22:59:05.776419+0000","last_unstale":"2024-04-25T22:59:08.775335+0000","last_undegraded":"2024-04-25T22:59:08.775335+0000","last_fullsized":"2024-04-25T22:59:08.775335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782994+0000","last_change":"2024-04-25T22:59:06.795064+0000","last_active":"2024-04-25T22:59:07.782994+0000","last_peered":"2024-04-25T22:59:07.782994+0000","last_clean":"2024-04-25T22:59:07.782994+0000","last_became_active":"2024-04-25T22:59:06.794164+0000","last_became_peered":"2024-04-25T22:59:06.794164+0000","last_unstale":"2024-04-25T22:59:07.782994+0000","last_undegraded":"2024-04-25T22:59:07.782994+0000","last_fullsized":"2024-04-25T22:59:07.782994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787019+0000","last_change":"2024-04-25T22:59:05.784604+0000","last_active":"2024-04-25T22:59:07.787019+0000","last_peered":"2024-04-25T22:59:07.787019+0000","last_clean":"2024-04-25T22:59:07.787019+0000","last_became_active":"2024-04-25T22:59:05.783730+0000","last_became_peered":"2024-04-25T22:59:05.783730+0000","last_unstale":"2024-04-25T22:59:07.787019+0000","last_undegraded":"2024-04-25T22:59:07.787019+0000","last_fullsized":"2024-04-25T22:59:07.787019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:50.670011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775348+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T22:59:08.775348+0000","last_peered":"2024-04-25T22:59:08.775348+0000","last_clean":"2024-04-25T22:59:08.775348+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T22:59:08.775348+0000","last_undegraded":"2024-04-25T22:59:08.775348+0000","last_fullsized":"2024-04-25T22:59:08.775348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782947+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T22:59:07.782947+0000","last_peered":"2024-04-25T22:59:07.782947+0000","last_clean":"2024-04-25T22:59:07.782947+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T22:59:07.782947+0000","last_undegraded":"2024-04-25T22:59:07.782947+0000","last_fullsized":"2024-04-25T22:59:07.782947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785122+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T22:59:07.785122+0000","last_peered":"2024-04-25T22:59:07.785122+0000","last_clean":"2024-04-25T22:59:07.785122+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T22:59:07.785122+0000","last_undegraded":"2024-04-25T22:59:07.785122+0000","last_fullsized":"2024-04-25T22:59:07.785122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783404+0000","last_change":"2024-04-25T22:59:06.790297+0000","last_active":"2024-04-25T22:59:07.783404+0000","last_peered":"2024-04-25T22:59:07.783404+0000","last_clean":"2024-04-25T22:59:07.783404+0000","last_became_active":"2024-04-25T22:59:06.789200+0000","last_became_peered":"2024-04-25T22:59:06.789200+0000","last_unstale":"2024-04-25T22:59:07.783404+0000","last_undegraded":"2024-04-25T22:59:07.783404+0000","last_fullsized":"2024-04-25T22:59:07.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787179+0000","last_change":"2024-04-25T22:59:06.803808+0000","last_active":"2024-04-25T22:59:07.787179+0000","last_peered":"2024-04-25T22:59:07.787179+0000","last_clean":"2024-04-25T22:59:07.787179+0000","last_became_active":"2024-04-25T22:59:06.803285+0000","last_became_peered":"2024-04-25T22:59:06.803285+0000","last_unstale":"2024-04-25T22:59:07.787179+0000","last_undegraded":"2024-04-25T22:59:07.787179+0000","last_fullsized":"2024-04-25T22:59:07.787179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783578+0000","last_change":"2024-04-25T22:59:05.773898+0000","last_active":"2024-04-25T22:59:07.783578+0000","last_peered":"2024-04-25T22:59:07.783578+0000","last_clean":"2024-04-25T22:59:07.783578+0000","last_became_active":"2024-04-25T22:59:05.773068+0000","last_became_peered":"2024-04-25T22:59:05.773068+0000","last_unstale":"2024-04-25T22:59:07.783578+0000","last_undegraded":"2024-04-25T22:59:07.783578+0000","last_fullsized":"2024-04-25T22:59:07.783578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784179+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T22:59:07.784179+0000","last_peered":"2024-04-25T22:59:07.784179+0000","last_clean":"2024-04-25T22:59:07.784179+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T22:59:07.784179+0000","last_undegraded":"2024-04-25T22:59:07.784179+0000","last_fullsized":"2024-04-25T22:59:07.784179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783103+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T22:59:07.783103+0000","last_peered":"2024-04-25T22:59:07.783103+0000","last_clean":"2024-04-25T22:59:07.783103+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T22:59:07.783103+0000","last_undegraded":"2024-04-25T22:59:07.783103+0000","last_fullsized":"2024-04-25T22:59:07.783103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786627+0000","last_change":"2024-04-25T22:59:06.804422+0000","last_active":"2024-04-25T22:59:07.786627+0000","last_peered":"2024-04-25T22:59:07.786627+0000","last_clean":"2024-04-25T22:59:07.786627+0000","last_became_active":"2024-04-25T22:59:06.803684+0000","last_became_peered":"2024-04-25T22:59:06.803684+0000","last_unstale":"2024-04-25T22:59:07.786627+0000","last_undegraded":"2024-04-25T22:59:07.786627+0000","last_fullsized":"2024-04-25T22:59:07.786627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785200+0000","last_change":"2024-04-25T22:59:05.778693+0000","last_active":"2024-04-25T22:59:07.785200+0000","last_peered":"2024-04-25T22:59:07.785200+0000","last_clean":"2024-04-25T22:59:07.785200+0000","last_became_active":"2024-04-25T22:59:05.777959+0000","last_became_peered":"2024-04-25T22:59:05.777959+0000","last_unstale":"2024-04-25T22:59:07.785200+0000","last_undegraded":"2024-04-25T22:59:07.785200+0000","last_fullsized":"2024-04-25T22:59:07.785200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.955918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785912+0000","last_change":"2024-04-25T22:59:06.802535+0000","last_active":"2024-04-25T22:59:07.785912+0000","last_peered":"2024-04-25T22:59:07.785912+0000","last_clean":"2024-04-25T22:59:07.785912+0000","last_became_active":"2024-04-25T22:59:06.801753+0000","last_became_peered":"2024-04-25T22:59:06.801753+0000","last_unstale":"2024-04-25T22:59:07.785912+0000","last_undegraded":"2024-04-25T22:59:07.785912+0000","last_fullsized":"2024-04-25T22:59:07.785912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785421+0000","last_change":"2024-04-25T22:59:05.784336+0000","last_active":"2024-04-25T22:59:07.785421+0000","last_peered":"2024-04-25T22:59:07.785421+0000","last_clean":"2024-04-25T22:59:07.785421+0000","last_became_active":"2024-04-25T22:59:05.783677+0000","last_became_peered":"2024-04-25T22:59:05.783677+0000","last_unstale":"2024-04-25T22:59:07.785421+0000","last_undegraded":"2024-04-25T22:59:07.785421+0000","last_fullsized":"2024-04-25T22:59:07.785421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:16.113762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773869+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.773869+0000","last_peered":"2024-04-25T22:59:08.773869+0000","last_clean":"2024-04-25T22:59:08.773869+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T22:59:08.773869+0000","last_undegraded":"2024-04-25T22:59:08.773869+0000","last_fullsized":"2024-04-25T22:59:08.773869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775261+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T22:59:08.775261+0000","last_peered":"2024-04-25T22:59:08.775261+0000","last_clean":"2024-04-25T22:59:08.775261+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T22:59:08.775261+0000","last_undegraded":"2024-04-25T22:59:08.775261+0000","last_fullsized":"2024-04-25T22:59:08.775261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773439+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T22:59:08.773439+0000","last_peered":"2024-04-25T22:59:08.773439+0000","last_clean":"2024-04-25T22:59:08.773439+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T22:59:08.773439+0000","last_undegraded":"2024-04-25T22:59:08.773439+0000","last_fullsized":"2024-04-25T22:59:08.773439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786795+0000","last_change":"2024-04-25T22:59:05.784872+0000","last_active":"2024-04-25T22:59:07.786795+0000","last_peered":"2024-04-25T22:59:07.786795+0000","last_clean":"2024-04-25T22:59:07.786795+0000","last_became_active":"2024-04-25T22:59:05.782768+0000","last_became_peered":"2024-04-25T22:59:05.782768+0000","last_unstale":"2024-04-25T22:59:07.786795+0000","last_undegraded":"2024-04-25T22:59:07.786795+0000","last_fullsized":"2024-04-25T22:59:07.786795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:31.688776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786229+0000","last_change":"2024-04-25T22:59:06.803221+0000","last_active":"2024-04-25T22:59:07.786229+0000","last_peered":"2024-04-25T22:59:07.786229+0000","last_clean":"2024-04-25T22:59:07.786229+0000","last_became_active":"2024-04-25T22:59:06.802203+0000","last_became_peered":"2024-04-25T22:59:06.802203+0000","last_unstale":"2024-04-25T22:59:07.786229+0000","last_undegraded":"2024-04-25T22:59:07.786229+0000","last_fullsized":"2024-04-25T22:59:07.786229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784817+0000","last_change":"2024-04-25T22:59:05.773997+0000","last_active":"2024-04-25T22:59:07.784817+0000","last_peered":"2024-04-25T22:59:07.784817+0000","last_clean":"2024-04-25T22:59:07.784817+0000","last_became_active":"2024-04-25T22:59:05.772933+0000","last_became_peered":"2024-04-25T22:59:05.772933+0000","last_unstale":"2024-04-25T22:59:07.784817+0000","last_undegraded":"2024-04-25T22:59:07.784817+0000","last_fullsized":"2024-04-25T22:59:07.784817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772813+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T22:59:08.772813+0000","last_peered":"2024-04-25T22:59:08.772813+0000","last_clean":"2024-04-25T22:59:08.772813+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T22:59:08.772813+0000","last_undegraded":"2024-04-25T22:59:08.772813+0000","last_fullsized":"2024-04-25T22:59:08.772813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784853+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T22:59:07.784853+0000","last_peered":"2024-04-25T22:59:07.784853+0000","last_clean":"2024-04-25T22:59:07.784853+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T22:59:07.784853+0000","last_undegraded":"2024-04-25T22:59:07.784853+0000","last_fullsized":"2024-04-25T22:59:07.784853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:28.110 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:28.463 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:28.464 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:28.479 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T22:59:26.512646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95260,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020260,"statfs":{"total":289910292480,"available":289812746240,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003131"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786579+0000","last_change":"2024-04-25T22:59:06.803693+0000","last_active":"2024-04-25T22:59:07.786579+0000","last_peered":"2024-04-25T22:59:07.786579+0000","last_clean":"2024-04-25T22:59:07.786579+0000","last_became_active":"2024-04-25T22:59:06.802949+0000","last_became_peered":"2024-04-25T22:59:06.802949+0000","last_unstale":"2024-04-25T22:59:07.786579+0000","last_undegraded":"2024-04-25T22:59:07.786579+0000","last_fullsized":"2024-04-25T22:59:07.786579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786674+0000","last_change":"2024-04-25T22:59:06.798862+0000","last_active":"2024-04-25T22:59:07.786674+0000","last_peered":"2024-04-25T22:59:07.786674+0000","last_clean":"2024-04-25T22:59:07.786674+0000","last_became_active":"2024-04-25T22:59:06.798150+0000","last_became_peered":"2024-04-25T22:59:06.798150+0000","last_unstale":"2024-04-25T22:59:07.786674+0000","last_undegraded":"2024-04-25T22:59:07.786674+0000","last_fullsized":"2024-04-25T22:59:07.786674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773768+0000","last_change":"2024-04-25T22:59:06.801047+0000","last_active":"2024-04-25T22:59:08.773768+0000","last_peered":"2024-04-25T22:59:08.773768+0000","last_clean":"2024-04-25T22:59:08.773768+0000","last_became_active":"2024-04-25T22:59:06.797208+0000","last_became_peered":"2024-04-25T22:59:06.797208+0000","last_unstale":"2024-04-25T22:59:08.773768+0000","last_undegraded":"2024-04-25T22:59:08.773768+0000","last_fullsized":"2024-04-25T22:59:08.773768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773795+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T22:59:08.773795+0000","last_peered":"2024-04-25T22:59:08.773795+0000","last_clean":"2024-04-25T22:59:08.773795+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T22:59:08.773795+0000","last_undegraded":"2024-04-25T22:59:08.773795+0000","last_fullsized":"2024-04-25T22:59:08.773795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785508+0000","last_change":"2024-04-25T22:59:06.802597+0000","last_active":"2024-04-25T22:59:07.785508+0000","last_peered":"2024-04-25T22:59:07.785508+0000","last_clean":"2024-04-25T22:59:07.785508+0000","last_became_active":"2024-04-25T22:59:06.801813+0000","last_became_peered":"2024-04-25T22:59:06.801813+0000","last_unstale":"2024-04-25T22:59:07.785508+0000","last_undegraded":"2024-04-25T22:59:07.785508+0000","last_fullsized":"2024-04-25T22:59:07.785508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772797+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T22:59:08.772797+0000","last_peered":"2024-04-25T22:59:08.772797+0000","last_clean":"2024-04-25T22:59:08.772797+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T22:59:08.772797+0000","last_undegraded":"2024-04-25T22:59:08.772797+0000","last_fullsized":"2024-04-25T22:59:08.772797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772307+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T22:59:08.772307+0000","last_peered":"2024-04-25T22:59:08.772307+0000","last_clean":"2024-04-25T22:59:08.772307+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T22:59:08.772307+0000","last_undegraded":"2024-04-25T22:59:08.772307+0000","last_fullsized":"2024-04-25T22:59:08.772307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772095+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T22:59:08.772095+0000","last_peered":"2024-04-25T22:59:08.772095+0000","last_clean":"2024-04-25T22:59:08.772095+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T22:59:08.772095+0000","last_undegraded":"2024-04-25T22:59:08.772095+0000","last_fullsized":"2024-04-25T22:59:08.772095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783702+0000","last_change":"2024-04-25T22:59:06.797839+0000","last_active":"2024-04-25T22:59:07.783702+0000","last_peered":"2024-04-25T22:59:07.783702+0000","last_clean":"2024-04-25T22:59:07.783702+0000","last_became_active":"2024-04-25T22:59:06.793135+0000","last_became_peered":"2024-04-25T22:59:06.793135+0000","last_unstale":"2024-04-25T22:59:07.783702+0000","last_undegraded":"2024-04-25T22:59:07.783702+0000","last_fullsized":"2024-04-25T22:59:07.783702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786282+0000","last_change":"2024-04-25T22:59:06.798833+0000","last_active":"2024-04-25T22:59:07.786282+0000","last_peered":"2024-04-25T22:59:07.786282+0000","last_clean":"2024-04-25T22:59:07.786282+0000","last_became_active":"2024-04-25T22:59:06.798100+0000","last_became_peered":"2024-04-25T22:59:06.798100+0000","last_unstale":"2024-04-25T22:59:07.786282+0000","last_undegraded":"2024-04-25T22:59:07.786282+0000","last_fullsized":"2024-04-25T22:59:07.786282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773891+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T22:59:08.773891+0000","last_peered":"2024-04-25T22:59:08.773891+0000","last_clean":"2024-04-25T22:59:08.773891+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T22:59:08.773891+0000","last_undegraded":"2024-04-25T22:59:08.773891+0000","last_fullsized":"2024-04-25T22:59:08.773891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785565+0000","last_change":"2024-04-25T22:59:06.814696+0000","last_active":"2024-04-25T22:59:07.785565+0000","last_peered":"2024-04-25T22:59:07.785565+0000","last_clean":"2024-04-25T22:59:07.785565+0000","last_became_active":"2024-04-25T22:59:06.813961+0000","last_became_peered":"2024-04-25T22:59:06.813961+0000","last_unstale":"2024-04-25T22:59:07.785565+0000","last_undegraded":"2024-04-25T22:59:07.785565+0000","last_fullsized":"2024-04-25T22:59:07.785565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785037+0000","last_change":"2024-04-25T22:59:06.782280+0000","last_active":"2024-04-25T22:59:07.785037+0000","last_peered":"2024-04-25T22:59:07.785037+0000","last_clean":"2024-04-25T22:59:07.785037+0000","last_became_active":"2024-04-25T22:59:06.781484+0000","last_became_peered":"2024-04-25T22:59:06.781484+0000","last_unstale":"2024-04-25T22:59:07.785037+0000","last_undegraded":"2024-04-25T22:59:07.785037+0000","last_fullsized":"2024-04-25T22:59:07.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772933+0000","last_change":"2024-04-25T22:59:06.791816+0000","last_active":"2024-04-25T22:59:08.772933+0000","last_peered":"2024-04-25T22:59:08.772933+0000","last_clean":"2024-04-25T22:59:08.772933+0000","last_became_active":"2024-04-25T22:59:06.789994+0000","last_became_peered":"2024-04-25T22:59:06.789994+0000","last_unstale":"2024-04-25T22:59:08.772933+0000","last_undegraded":"2024-04-25T22:59:08.772933+0000","last_fullsized":"2024-04-25T22:59:08.772933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772628+0000","last_change":"2024-04-25T22:59:06.790804+0000","last_active":"2024-04-25T22:59:08.772628+0000","last_peered":"2024-04-25T22:59:08.772628+0000","last_clean":"2024-04-25T22:59:08.772628+0000","last_became_active":"2024-04-25T22:59:06.789720+0000","last_became_peered":"2024-04-25T22:59:06.789720+0000","last_unstale":"2024-04-25T22:59:08.772628+0000","last_undegraded":"2024-04-25T22:59:08.772628+0000","last_fullsized":"2024-04-25T22:59:08.772628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772244+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T22:59:08.772244+0000","last_peered":"2024-04-25T22:59:08.772244+0000","last_clean":"2024-04-25T22:59:08.772244+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T22:59:08.772244+0000","last_undegraded":"2024-04-25T22:59:08.772244+0000","last_fullsized":"2024-04-25T22:59:08.772244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785932+0000","last_change":"2024-04-25T22:59:06.797073+0000","last_active":"2024-04-25T22:59:07.785932+0000","last_peered":"2024-04-25T22:59:07.785932+0000","last_clean":"2024-04-25T22:59:07.785932+0000","last_became_active":"2024-04-25T22:59:06.791141+0000","last_became_peered":"2024-04-25T22:59:06.791141+0000","last_unstale":"2024-04-25T22:59:07.785932+0000","last_undegraded":"2024-04-25T22:59:07.785932+0000","last_fullsized":"2024-04-25T22:59:07.785932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786658+0000","last_change":"2024-04-25T22:59:06.804912+0000","last_active":"2024-04-25T22:59:07.786658+0000","last_peered":"2024-04-25T22:59:07.786658+0000","last_clean":"2024-04-25T22:59:07.786658+0000","last_became_active":"2024-04-25T22:59:06.804100+0000","last_became_peered":"2024-04-25T22:59:06.804100+0000","last_unstale":"2024-04-25T22:59:07.786658+0000","last_undegraded":"2024-04-25T22:59:07.786658+0000","last_fullsized":"2024-04-25T22:59:07.786658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783693+0000","last_change":"2024-04-25T22:59:06.791947+0000","last_active":"2024-04-25T22:59:07.783693+0000","last_peered":"2024-04-25T22:59:07.783693+0000","last_clean":"2024-04-25T22:59:07.783693+0000","last_became_active":"2024-04-25T22:59:06.791064+0000","last_became_peered":"2024-04-25T22:59:06.791064+0000","last_unstale":"2024-04-25T22:59:07.783693+0000","last_undegraded":"2024-04-25T22:59:07.783693+0000","last_fullsized":"2024-04-25T22:59:07.783693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774184+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T22:59:08.774184+0000","last_peered":"2024-04-25T22:59:08.774184+0000","last_clean":"2024-04-25T22:59:08.774184+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T22:59:08.774184+0000","last_undegraded":"2024-04-25T22:59:08.774184+0000","last_fullsized":"2024-04-25T22:59:08.774184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774337+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T22:59:08.774337+0000","last_peered":"2024-04-25T22:59:08.774337+0000","last_clean":"2024-04-25T22:59:08.774337+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T22:59:08.774337+0000","last_undegraded":"2024-04-25T22:59:08.774337+0000","last_fullsized":"2024-04-25T22:59:08.774337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784814+0000","last_change":"2024-04-25T22:59:06.795909+0000","last_active":"2024-04-25T22:59:07.784814+0000","last_peered":"2024-04-25T22:59:07.784814+0000","last_clean":"2024-04-25T22:59:07.784814+0000","last_became_active":"2024-04-25T22:59:06.794998+0000","last_became_peered":"2024-04-25T22:59:06.794998+0000","last_unstale":"2024-04-25T22:59:07.784814+0000","last_undegraded":"2024-04-25T22:59:07.784814+0000","last_fullsized":"2024-04-25T22:59:07.784814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:17.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782504+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T22:59:07.782504+0000","last_peered":"2024-04-25T22:59:07.782504+0000","last_clean":"2024-04-25T22:59:07.782504+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T22:59:07.782504+0000","last_undegraded":"2024-04-25T22:59:07.782504+0000","last_fullsized":"2024-04-25T22:59:07.782504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784098+0000","last_change":"2024-04-25T22:59:06.783226+0000","last_active":"2024-04-25T22:59:07.784098+0000","last_peered":"2024-04-25T22:59:07.784098+0000","last_clean":"2024-04-25T22:59:07.784098+0000","last_became_active":"2024-04-25T22:59:06.781774+0000","last_became_peered":"2024-04-25T22:59:06.781774+0000","last_unstale":"2024-04-25T22:59:07.784098+0000","last_undegraded":"2024-04-25T22:59:07.784098+0000","last_fullsized":"2024-04-25T22:59:07.784098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:03.122921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787216+0000","last_change":"2024-04-25T22:59:06.795806+0000","last_active":"2024-04-25T22:59:07.787216+0000","last_peered":"2024-04-25T22:59:07.787216+0000","last_clean":"2024-04-25T22:59:07.787216+0000","last_became_active":"2024-04-25T22:59:06.794632+0000","last_became_peered":"2024-04-25T22:59:06.794632+0000","last_unstale":"2024-04-25T22:59:07.787216+0000","last_undegraded":"2024-04-25T22:59:07.787216+0000","last_fullsized":"2024-04-25T22:59:07.787216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784343+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T22:59:07.784343+0000","last_peered":"2024-04-25T22:59:07.784343+0000","last_clean":"2024-04-25T22:59:07.784343+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T22:59:07.784343+0000","last_undegraded":"2024-04-25T22:59:07.784343+0000","last_fullsized":"2024-04-25T22:59:07.784343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774180+0000","last_change":"2024-04-25T22:59:06.800124+0000","last_active":"2024-04-25T22:59:08.774180+0000","last_peered":"2024-04-25T22:59:08.774180+0000","last_clean":"2024-04-25T22:59:08.774180+0000","last_became_active":"2024-04-25T22:59:06.794619+0000","last_became_peered":"2024-04-25T22:59:06.794619+0000","last_unstale":"2024-04-25T22:59:08.774180+0000","last_undegraded":"2024-04-25T22:59:08.774180+0000","last_fullsized":"2024-04-25T22:59:08.774180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:46.277348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786991+0000","last_change":"2024-04-25T22:59:06.814869+0000","last_active":"2024-04-25T22:59:07.786991+0000","last_peered":"2024-04-25T22:59:07.786991+0000","last_clean":"2024-04-25T22:59:07.786991+0000","last_became_active":"2024-04-25T22:59:06.813986+0000","last_became_peered":"2024-04-25T22:59:06.813986+0000","last_unstale":"2024-04-25T22:59:07.786991+0000","last_undegraded":"2024-04-25T22:59:07.786991+0000","last_fullsized":"2024-04-25T22:59:07.786991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783735+0000","last_change":"2024-04-25T22:59:06.791151+0000","last_active":"2024-04-25T22:59:07.783735+0000","last_peered":"2024-04-25T22:59:07.783735+0000","last_clean":"2024-04-25T22:59:07.783735+0000","last_became_active":"2024-04-25T22:59:06.790017+0000","last_became_peered":"2024-04-25T22:59:06.790017+0000","last_unstale":"2024-04-25T22:59:07.783735+0000","last_undegraded":"2024-04-25T22:59:07.783735+0000","last_fullsized":"2024-04-25T22:59:07.783735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785653+0000","last_change":"2024-04-25T22:59:06.796874+0000","last_active":"2024-04-25T22:59:07.785653+0000","last_peered":"2024-04-25T22:59:07.785653+0000","last_clean":"2024-04-25T22:59:07.785653+0000","last_became_active":"2024-04-25T22:59:06.796100+0000","last_became_peered":"2024-04-25T22:59:06.796100+0000","last_unstale":"2024-04-25T22:59:07.785653+0000","last_undegraded":"2024-04-25T22:59:07.785653+0000","last_fullsized":"2024-04-25T22:59:07.785653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782734+0000","last_change":"2024-04-25T22:59:06.794741+0000","last_active":"2024-04-25T22:59:07.782734+0000","last_peered":"2024-04-25T22:59:07.782734+0000","last_clean":"2024-04-25T22:59:07.782734+0000","last_became_active":"2024-04-25T22:59:06.793264+0000","last_became_peered":"2024-04-25T22:59:06.793264+0000","last_unstale":"2024-04-25T22:59:07.782734+0000","last_undegraded":"2024-04-25T22:59:07.782734+0000","last_fullsized":"2024-04-25T22:59:07.782734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:03.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772605+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T22:59:08.772605+0000","last_peered":"2024-04-25T22:59:08.772605+0000","last_clean":"2024-04-25T22:59:08.772605+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T22:59:08.772605+0000","last_undegraded":"2024-04-25T22:59:08.772605+0000","last_fullsized":"2024-04-25T22:59:08.772605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786119+0000","last_change":"2024-04-25T22:59:06.802067+0000","last_active":"2024-04-25T22:59:07.786119+0000","last_peered":"2024-04-25T22:59:07.786119+0000","last_clean":"2024-04-25T22:59:07.786119+0000","last_became_active":"2024-04-25T22:59:06.801322+0000","last_became_peered":"2024-04-25T22:59:06.801322+0000","last_unstale":"2024-04-25T22:59:07.786119+0000","last_undegraded":"2024-04-25T22:59:07.786119+0000","last_fullsized":"2024-04-25T22:59:07.786119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774524+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T22:59:08.774524+0000","last_peered":"2024-04-25T22:59:08.774524+0000","last_clean":"2024-04-25T22:59:08.774524+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T22:59:08.774524+0000","last_undegraded":"2024-04-25T22:59:08.774524+0000","last_fullsized":"2024-04-25T22:59:08.774524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786655+0000","last_change":"2024-04-25T22:59:06.798452+0000","last_active":"2024-04-25T22:59:07.786655+0000","last_peered":"2024-04-25T22:59:07.786655+0000","last_clean":"2024-04-25T22:59:07.786655+0000","last_became_active":"2024-04-25T22:59:06.797421+0000","last_became_peered":"2024-04-25T22:59:06.797421+0000","last_unstale":"2024-04-25T22:59:07.786655+0000","last_undegraded":"2024-04-25T22:59:07.786655+0000","last_fullsized":"2024-04-25T22:59:07.786655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783153+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T22:59:07.783153+0000","last_peered":"2024-04-25T22:59:07.783153+0000","last_clean":"2024-04-25T22:59:07.783153+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T22:59:07.783153+0000","last_undegraded":"2024-04-25T22:59:07.783153+0000","last_fullsized":"2024-04-25T22:59:07.783153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785193+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T22:59:07.785193+0000","last_peered":"2024-04-25T22:59:07.785193+0000","last_clean":"2024-04-25T22:59:07.785193+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T22:59:07.785193+0000","last_undegraded":"2024-04-25T22:59:07.785193+0000","last_fullsized":"2024-04-25T22:59:07.785193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784937+0000","last_change":"2024-04-25T22:59:05.782753+0000","last_active":"2024-04-25T22:59:07.784937+0000","last_peered":"2024-04-25T22:59:07.784937+0000","last_clean":"2024-04-25T22:59:07.784937+0000","last_became_active":"2024-04-25T22:59:05.782002+0000","last_became_peered":"2024-04-25T22:59:05.782002+0000","last_unstale":"2024-04-25T22:59:07.784937+0000","last_undegraded":"2024-04-25T22:59:07.784937+0000","last_fullsized":"2024-04-25T22:59:07.784937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:49.136410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784128+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T22:59:07.784128+0000","last_peered":"2024-04-25T22:59:07.784128+0000","last_clean":"2024-04-25T22:59:07.784128+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T22:59:07.784128+0000","last_undegraded":"2024-04-25T22:59:07.784128+0000","last_fullsized":"2024-04-25T22:59:07.784128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772345+0000","last_change":"2024-04-25T22:59:05.781315+0000","last_active":"2024-04-25T22:59:08.772345+0000","last_peered":"2024-04-25T22:59:08.772345+0000","last_clean":"2024-04-25T22:59:08.772345+0000","last_became_active":"2024-04-25T22:59:05.780508+0000","last_became_peered":"2024-04-25T22:59:05.780508+0000","last_unstale":"2024-04-25T22:59:08.772345+0000","last_undegraded":"2024-04-25T22:59:08.772345+0000","last_fullsized":"2024-04-25T22:59:08.772345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774108+0000","last_change":"2024-04-25T22:59:05.781365+0000","last_active":"2024-04-25T22:59:08.774108+0000","last_peered":"2024-04-25T22:59:08.774108+0000","last_clean":"2024-04-25T22:59:08.774108+0000","last_became_active":"2024-04-25T22:59:05.779706+0000","last_became_peered":"2024-04-25T22:59:05.779706+0000","last_unstale":"2024-04-25T22:59:08.774108+0000","last_undegraded":"2024-04-25T22:59:08.774108+0000","last_fullsized":"2024-04-25T22:59:08.774108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784266+0000","last_change":"2024-04-25T22:59:06.814657+0000","last_active":"2024-04-25T22:59:07.784266+0000","last_peered":"2024-04-25T22:59:07.784266+0000","last_clean":"2024-04-25T22:59:07.784266+0000","last_became_active":"2024-04-25T22:59:06.814089+0000","last_became_peered":"2024-04-25T22:59:06.814089+0000","last_unstale":"2024-04-25T22:59:07.784266+0000","last_undegraded":"2024-04-25T22:59:07.784266+0000","last_fullsized":"2024-04-25T22:59:07.784266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:04:21.292902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786825+0000","last_change":"2024-04-25T22:59:05.783434+0000","last_active":"2024-04-25T22:59:07.786825+0000","last_peered":"2024-04-25T22:59:07.786825+0000","last_clean":"2024-04-25T22:59:07.786825+0000","last_became_active":"2024-04-25T22:59:05.782707+0000","last_became_peered":"2024-04-25T22:59:05.782707+0000","last_unstale":"2024-04-25T22:59:07.786825+0000","last_undegraded":"2024-04-25T22:59:07.786825+0000","last_fullsized":"2024-04-25T22:59:07.786825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784791+0000","last_change":"2024-04-25T22:59:06.783092+0000","last_active":"2024-04-25T22:59:07.784791+0000","last_peered":"2024-04-25T22:59:07.784791+0000","last_clean":"2024-04-25T22:59:07.784791+0000","last_became_active":"2024-04-25T22:59:06.781597+0000","last_became_peered":"2024-04-25T22:59:06.781597+0000","last_unstale":"2024-04-25T22:59:07.784791+0000","last_undegraded":"2024-04-25T22:59:07.784791+0000","last_fullsized":"2024-04-25T22:59:07.784791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:04:26.144135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774685+0000","last_change":"2024-04-25T22:59:05.781889+0000","last_active":"2024-04-25T22:59:08.774685+0000","last_peered":"2024-04-25T22:59:08.774685+0000","last_clean":"2024-04-25T22:59:08.774685+0000","last_became_active":"2024-04-25T22:59:05.781215+0000","last_became_peered":"2024-04-25T22:59:05.781215+0000","last_unstale":"2024-04-25T22:59:08.774685+0000","last_undegraded":"2024-04-25T22:59:08.774685+0000","last_fullsized":"2024-04-25T22:59:08.774685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773227+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T22:59:08.773227+0000","last_peered":"2024-04-25T22:59:08.773227+0000","last_clean":"2024-04-25T22:59:08.773227+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T22:59:08.773227+0000","last_undegraded":"2024-04-25T22:59:08.773227+0000","last_fullsized":"2024-04-25T22:59:08.773227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775643+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T22:59:08.775643+0000","last_peered":"2024-04-25T22:59:08.775643+0000","last_clean":"2024-04-25T22:59:08.775643+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T22:59:08.775643+0000","last_undegraded":"2024-04-25T22:59:08.775643+0000","last_fullsized":"2024-04-25T22:59:08.775643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784373+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T22:59:07.784373+0000","last_peered":"2024-04-25T22:59:07.784373+0000","last_clean":"2024-04-25T22:59:07.784373+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T22:59:07.784373+0000","last_undegraded":"2024-04-25T22:59:07.784373+0000","last_fullsized":"2024-04-25T22:59:07.784373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784877+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T22:59:07.784877+0000","last_peered":"2024-04-25T22:59:07.784877+0000","last_clean":"2024-04-25T22:59:07.784877+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T22:59:07.784877+0000","last_undegraded":"2024-04-25T22:59:07.784877+0000","last_fullsized":"2024-04-25T22:59:07.784877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774655+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.774655+0000","last_peered":"2024-04-25T22:59:08.774655+0000","last_clean":"2024-04-25T22:59:08.774655+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T22:59:08.774655+0000","last_undegraded":"2024-04-25T22:59:08.774655+0000","last_fullsized":"2024-04-25T22:59:08.774655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773605+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T22:59:08.773605+0000","last_peered":"2024-04-25T22:59:08.773605+0000","last_clean":"2024-04-25T22:59:08.773605+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T22:59:08.773605+0000","last_undegraded":"2024-04-25T22:59:08.773605+0000","last_fullsized":"2024-04-25T22:59:08.773605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774537+0000","last_change":"2024-04-25T22:59:06.798000+0000","last_active":"2024-04-25T22:59:08.774537+0000","last_peered":"2024-04-25T22:59:08.774537+0000","last_clean":"2024-04-25T22:59:08.774537+0000","last_became_active":"2024-04-25T22:59:06.793483+0000","last_became_peered":"2024-04-25T22:59:06.793483+0000","last_unstale":"2024-04-25T22:59:08.774537+0000","last_undegraded":"2024-04-25T22:59:08.774537+0000","last_fullsized":"2024-04-25T22:59:08.774537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:19.520617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785194+0000","last_change":"2024-04-25T22:59:05.782797+0000","last_active":"2024-04-25T22:59:07.785194+0000","last_peered":"2024-04-25T22:59:07.785194+0000","last_clean":"2024-04-25T22:59:07.785194+0000","last_became_active":"2024-04-25T22:59:05.782123+0000","last_became_peered":"2024-04-25T22:59:05.782123+0000","last_unstale":"2024-04-25T22:59:07.785194+0000","last_undegraded":"2024-04-25T22:59:07.785194+0000","last_fullsized":"2024-04-25T22:59:07.785194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:05.108258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774720+0000","last_change":"2024-04-25T22:59:06.790685+0000","last_active":"2024-04-25T22:59:08.774720+0000","last_peered":"2024-04-25T22:59:08.774720+0000","last_clean":"2024-04-25T22:59:08.774720+0000","last_became_active":"2024-04-25T22:59:06.789885+0000","last_became_peered":"2024-04-25T22:59:06.789885+0000","last_unstale":"2024-04-25T22:59:08.774720+0000","last_undegraded":"2024-04-25T22:59:08.774720+0000","last_fullsized":"2024-04-25T22:59:08.774720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:53.136204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784183+0000","last_change":"2024-04-25T22:59:05.778598+0000","last_active":"2024-04-25T22:59:07.784183+0000","last_peered":"2024-04-25T22:59:07.784183+0000","last_clean":"2024-04-25T22:59:07.784183+0000","last_became_active":"2024-04-25T22:59:05.777930+0000","last_became_peered":"2024-04-25T22:59:05.777930+0000","last_unstale":"2024-04-25T22:59:07.784183+0000","last_undegraded":"2024-04-25T22:59:07.784183+0000","last_fullsized":"2024-04-25T22:59:07.784183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:51.519857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784585+0000","last_change":"2024-04-25T22:59:06.797741+0000","last_active":"2024-04-25T22:59:07.784585+0000","last_peered":"2024-04-25T22:59:07.784585+0000","last_clean":"2024-04-25T22:59:07.784585+0000","last_became_active":"2024-04-25T22:59:06.793110+0000","last_became_peered":"2024-04-25T22:59:06.793110+0000","last_unstale":"2024-04-25T22:59:07.784585+0000","last_undegraded":"2024-04-25T22:59:07.784585+0000","last_fullsized":"2024-04-25T22:59:07.784585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772959+0000","last_change":"2024-04-25T22:58:57.663545+0000","last_active":"2024-04-25T22:59:08.772959+0000","last_peered":"2024-04-25T22:59:08.772959+0000","last_clean":"2024-04-25T22:59:08.772959+0000","last_became_active":"2024-04-25T22:58:57.661454+0000","last_became_peered":"2024-04-25T22:58:57.661454+0000","last_unstale":"2024-04-25T22:59:08.772959+0000","last_undegraded":"2024-04-25T22:59:08.772959+0000","last_fullsized":"2024-04-25T22:59:08.772959+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:19.545490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775297+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:08.775297+0000","last_peered":"2024-04-25T22:59:08.775297+0000","last_clean":"2024-04-25T22:59:08.775297+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:08.775297+0000","last_undegraded":"2024-04-25T22:59:08.775297+0000","last_fullsized":"2024-04-25T22:59:08.775297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783426+0000","last_change":"2024-04-25T22:59:05.773462+0000","last_active":"2024-04-25T22:59:07.783426+0000","last_peered":"2024-04-25T22:59:07.783426+0000","last_clean":"2024-04-25T22:59:07.783426+0000","last_became_active":"2024-04-25T22:59:05.772642+0000","last_became_peered":"2024-04-25T22:59:05.772642+0000","last_unstale":"2024-04-25T22:59:07.783426+0000","last_undegraded":"2024-04-25T22:59:07.783426+0000","last_fullsized":"2024-04-25T22:59:07.783426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774660+0000","last_change":"2024-04-25T22:59:06.801333+0000","last_active":"2024-04-25T22:59:08.774660+0000","last_peered":"2024-04-25T22:59:08.774660+0000","last_clean":"2024-04-25T22:59:08.774660+0000","last_became_active":"2024-04-25T22:59:06.793589+0000","last_became_peered":"2024-04-25T22:59:06.793589+0000","last_unstale":"2024-04-25T22:59:08.774660+0000","last_undegraded":"2024-04-25T22:59:08.774660+0000","last_fullsized":"2024-04-25T22:59:08.774660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:21.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772753+0000","last_change":"2024-04-25T22:59:01.743842+0000","last_active":"2024-04-25T22:59:08.772753+0000","last_peered":"2024-04-25T22:59:08.772753+0000","last_clean":"2024-04-25T22:59:08.772753+0000","last_became_active":"2024-04-25T22:59:01.743200+0000","last_became_peered":"2024-04-25T22:59:01.743200+0000","last_unstale":"2024-04-25T22:59:08.772753+0000","last_undegraded":"2024-04-25T22:59:08.772753+0000","last_fullsized":"2024-04-25T22:59:08.772753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:13.089956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784166+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T22:59:07.784166+0000","last_peered":"2024-04-25T22:59:07.784166+0000","last_clean":"2024-04-25T22:59:07.784166+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T22:59:07.784166+0000","last_undegraded":"2024-04-25T22:59:07.784166+0000","last_fullsized":"2024-04-25T22:59:07.784166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786948+0000","last_change":"2024-04-25T22:59:06.802609+0000","last_active":"2024-04-25T22:59:07.786948+0000","last_peered":"2024-04-25T22:59:07.786948+0000","last_clean":"2024-04-25T22:59:07.786948+0000","last_became_active":"2024-04-25T22:59:06.801566+0000","last_became_peered":"2024-04-25T22:59:06.801566+0000","last_unstale":"2024-04-25T22:59:07.786948+0000","last_undegraded":"2024-04-25T22:59:07.786948+0000","last_fullsized":"2024-04-25T22:59:07.786948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784614+0000","last_change":"2024-04-25T22:59:01.742472+0000","last_active":"2024-04-25T22:59:07.784614+0000","last_peered":"2024-04-25T22:59:07.784614+0000","last_clean":"2024-04-25T22:59:07.784614+0000","last_became_active":"2024-04-25T22:59:01.741645+0000","last_became_peered":"2024-04-25T22:59:01.741645+0000","last_unstale":"2024-04-25T22:59:07.784614+0000","last_undegraded":"2024-04-25T22:59:07.784614+0000","last_fullsized":"2024-04-25T22:59:07.784614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:12.164333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784434+0000","last_change":"2024-04-25T22:59:05.785151+0000","last_active":"2024-04-25T22:59:07.784434+0000","last_peered":"2024-04-25T22:59:07.784434+0000","last_clean":"2024-04-25T22:59:07.784434+0000","last_became_active":"2024-04-25T22:59:05.784380+0000","last_became_peered":"2024-04-25T22:59:05.784380+0000","last_unstale":"2024-04-25T22:59:07.784434+0000","last_undegraded":"2024-04-25T22:59:07.784434+0000","last_fullsized":"2024-04-25T22:59:07.784434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784554+0000","last_change":"2024-04-25T22:59:06.795334+0000","last_active":"2024-04-25T22:59:07.784554+0000","last_peered":"2024-04-25T22:59:07.784554+0000","last_clean":"2024-04-25T22:59:07.784554+0000","last_became_active":"2024-04-25T22:59:06.790600+0000","last_became_peered":"2024-04-25T22:59:06.790600+0000","last_unstale":"2024-04-25T22:59:07.784554+0000","last_undegraded":"2024-04-25T22:59:07.784554+0000","last_fullsized":"2024-04-25T22:59:07.784554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773619+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:08.773619+0000","last_peered":"2024-04-25T22:59:08.773619+0000","last_clean":"2024-04-25T22:59:08.773619+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:08.773619+0000","last_undegraded":"2024-04-25T22:59:08.773619+0000","last_fullsized":"2024-04-25T22:59:08.773619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774622+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T22:59:08.774622+0000","last_peered":"2024-04-25T22:59:08.774622+0000","last_clean":"2024-04-25T22:59:08.774622+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T22:59:08.774622+0000","last_undegraded":"2024-04-25T22:59:08.774622+0000","last_fullsized":"2024-04-25T22:59:08.774622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784919+0000","last_change":"2024-04-25T22:59:06.792116+0000","last_active":"2024-04-25T22:59:07.784919+0000","last_peered":"2024-04-25T22:59:07.784919+0000","last_clean":"2024-04-25T22:59:07.784919+0000","last_became_active":"2024-04-25T22:59:06.788815+0000","last_became_peered":"2024-04-25T22:59:06.788815+0000","last_unstale":"2024-04-25T22:59:07.784919+0000","last_undegraded":"2024-04-25T22:59:07.784919+0000","last_fullsized":"2024-04-25T22:59:07.784919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:19.944556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775231+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T22:59:08.775231+0000","last_peered":"2024-04-25T22:59:08.775231+0000","last_clean":"2024-04-25T22:59:08.775231+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T22:59:08.775231+0000","last_undegraded":"2024-04-25T22:59:08.775231+0000","last_fullsized":"2024-04-25T22:59:08.775231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784998+0000","last_change":"2024-04-25T22:59:01.742585+0000","last_active":"2024-04-25T22:59:07.784998+0000","last_peered":"2024-04-25T22:59:07.784998+0000","last_clean":"2024-04-25T22:59:07.784998+0000","last_became_active":"2024-04-25T22:59:01.741762+0000","last_became_peered":"2024-04-25T22:59:01.741762+0000","last_unstale":"2024-04-25T22:59:07.784998+0000","last_undegraded":"2024-04-25T22:59:07.784998+0000","last_fullsized":"2024-04-25T22:59:07.784998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:11.626079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785045+0000","last_change":"2024-04-25T22:59:06.796493+0000","last_active":"2024-04-25T22:59:07.785045+0000","last_peered":"2024-04-25T22:59:07.785045+0000","last_clean":"2024-04-25T22:59:07.785045+0000","last_became_active":"2024-04-25T22:59:06.794987+0000","last_became_peered":"2024-04-25T22:59:06.794987+0000","last_unstale":"2024-04-25T22:59:07.785045+0000","last_undegraded":"2024-04-25T22:59:07.785045+0000","last_fullsized":"2024-04-25T22:59:07.785045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784774+0000","last_change":"2024-04-25T22:59:05.774865+0000","last_active":"2024-04-25T22:59:07.784774+0000","last_peered":"2024-04-25T22:59:07.784774+0000","last_clean":"2024-04-25T22:59:07.784774+0000","last_became_active":"2024-04-25T22:59:05.772893+0000","last_became_peered":"2024-04-25T22:59:05.772893+0000","last_unstale":"2024-04-25T22:59:07.784774+0000","last_undegraded":"2024-04-25T22:59:07.784774+0000","last_fullsized":"2024-04-25T22:59:07.784774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787305+0000","last_change":"2024-04-25T22:59:01.747799+0000","last_active":"2024-04-25T22:59:07.787305+0000","last_peered":"2024-04-25T22:59:07.787305+0000","last_clean":"2024-04-25T22:59:07.787305+0000","last_became_active":"2024-04-25T22:59:01.747246+0000","last_became_peered":"2024-04-25T22:59:01.747246+0000","last_unstale":"2024-04-25T22:59:07.787305+0000","last_undegraded":"2024-04-25T22:59:07.787305+0000","last_fullsized":"2024-04-25T22:59:07.787305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.419411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785251+0000","last_change":"2024-04-25T22:59:06.805539+0000","last_active":"2024-04-25T22:59:07.785251+0000","last_peered":"2024-04-25T22:59:07.785251+0000","last_clean":"2024-04-25T22:59:07.785251+0000","last_became_active":"2024-04-25T22:59:06.804693+0000","last_became_peered":"2024-04-25T22:59:06.804693+0000","last_unstale":"2024-04-25T22:59:07.785251+0000","last_undegraded":"2024-04-25T22:59:07.785251+0000","last_fullsized":"2024-04-25T22:59:07.785251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785775+0000","last_change":"2024-04-25T22:59:05.774273+0000","last_active":"2024-04-25T22:59:07.785775+0000","last_peered":"2024-04-25T22:59:07.785775+0000","last_clean":"2024-04-25T22:59:07.785775+0000","last_became_active":"2024-04-25T22:59:05.773115+0000","last_became_peered":"2024-04-25T22:59:05.773115+0000","last_unstale":"2024-04-25T22:59:07.785775+0000","last_undegraded":"2024-04-25T22:59:07.785775+0000","last_fullsized":"2024-04-25T22:59:07.785775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785665+0000","last_change":"2024-04-25T22:59:01.741442+0000","last_active":"2024-04-25T22:59:07.785665+0000","last_peered":"2024-04-25T22:59:07.785665+0000","last_clean":"2024-04-25T22:59:07.785665+0000","last_became_active":"2024-04-25T22:59:01.740704+0000","last_became_peered":"2024-04-25T22:59:01.740704+0000","last_unstale":"2024-04-25T22:59:07.785665+0000","last_undegraded":"2024-04-25T22:59:07.785665+0000","last_fullsized":"2024-04-25T22:59:07.785665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784045+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T22:59:07.784045+0000","last_peered":"2024-04-25T22:59:07.784045+0000","last_clean":"2024-04-25T22:59:07.784045+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T22:59:07.784045+0000","last_undegraded":"2024-04-25T22:59:07.784045+0000","last_fullsized":"2024-04-25T22:59:07.784045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785198+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T22:59:07.785198+0000","last_peered":"2024-04-25T22:59:07.785198+0000","last_clean":"2024-04-25T22:59:07.785198+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T22:59:07.785198+0000","last_undegraded":"2024-04-25T22:59:07.785198+0000","last_fullsized":"2024-04-25T22:59:07.785198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774258+0000","last_change":"2024-04-25T22:59:01.743861+0000","last_active":"2024-04-25T22:59:08.774258+0000","last_peered":"2024-04-25T22:59:08.774258+0000","last_clean":"2024-04-25T22:59:08.774258+0000","last_became_active":"2024-04-25T22:59:01.743185+0000","last_became_peered":"2024-04-25T22:59:01.743185+0000","last_unstale":"2024-04-25T22:59:08.774258+0000","last_undegraded":"2024-04-25T22:59:08.774258+0000","last_fullsized":"2024-04-25T22:59:08.774258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:36:32.749715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785787+0000","last_change":"2024-04-25T22:59:06.805606+0000","last_active":"2024-04-25T22:59:07.785787+0000","last_peered":"2024-04-25T22:59:07.785787+0000","last_clean":"2024-04-25T22:59:07.785787+0000","last_became_active":"2024-04-25T22:59:06.804741+0000","last_became_peered":"2024-04-25T22:59:06.804741+0000","last_unstale":"2024-04-25T22:59:07.785787+0000","last_undegraded":"2024-04-25T22:59:07.785787+0000","last_fullsized":"2024-04-25T22:59:07.785787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.774105+0000","last_change":"2024-04-25T22:59:06.792879+0000","last_active":"2024-04-25T22:59:08.774105+0000","last_peered":"2024-04-25T22:59:08.774105+0000","last_clean":"2024-04-25T22:59:08.774105+0000","last_became_active":"2024-04-25T22:59:06.791896+0000","last_became_peered":"2024-04-25T22:59:06.791896+0000","last_unstale":"2024-04-25T22:59:08.774105+0000","last_undegraded":"2024-04-25T22:59:08.774105+0000","last_fullsized":"2024-04-25T22:59:08.774105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:58.427980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775335+0000","last_change":"2024-04-25T22:59:05.777961+0000","last_active":"2024-04-25T22:59:08.775335+0000","last_peered":"2024-04-25T22:59:08.775335+0000","last_clean":"2024-04-25T22:59:08.775335+0000","last_became_active":"2024-04-25T22:59:05.776419+0000","last_became_peered":"2024-04-25T22:59:05.776419+0000","last_unstale":"2024-04-25T22:59:08.775335+0000","last_undegraded":"2024-04-25T22:59:08.775335+0000","last_fullsized":"2024-04-25T22:59:08.775335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782994+0000","last_change":"2024-04-25T22:59:06.795064+0000","last_active":"2024-04-25T22:59:07.782994+0000","last_peered":"2024-04-25T22:59:07.782994+0000","last_clean":"2024-04-25T22:59:07.782994+0000","last_became_active":"2024-04-25T22:59:06.794164+0000","last_became_peered":"2024-04-25T22:59:06.794164+0000","last_unstale":"2024-04-25T22:59:07.782994+0000","last_undegraded":"2024-04-25T22:59:07.782994+0000","last_fullsized":"2024-04-25T22:59:07.782994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.344650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787019+0000","last_change":"2024-04-25T22:59:05.784604+0000","last_active":"2024-04-25T22:59:07.787019+0000","last_peered":"2024-04-25T22:59:07.787019+0000","last_clean":"2024-04-25T22:59:07.787019+0000","last_became_active":"2024-04-25T22:59:05.783730+0000","last_became_peered":"2024-04-25T22:59:05.783730+0000","last_unstale":"2024-04-25T22:59:07.787019+0000","last_undegraded":"2024-04-25T22:59:07.787019+0000","last_fullsized":"2024-04-25T22:59:07.787019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:50.670011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775348+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T22:59:08.775348+0000","last_peered":"2024-04-25T22:59:08.775348+0000","last_clean":"2024-04-25T22:59:08.775348+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T22:59:08.775348+0000","last_undegraded":"2024-04-25T22:59:08.775348+0000","last_fullsized":"2024-04-25T22:59:08.775348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.782947+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T22:59:07.782947+0000","last_peered":"2024-04-25T22:59:07.782947+0000","last_clean":"2024-04-25T22:59:07.782947+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T22:59:07.782947+0000","last_undegraded":"2024-04-25T22:59:07.782947+0000","last_fullsized":"2024-04-25T22:59:07.782947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785122+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T22:59:07.785122+0000","last_peered":"2024-04-25T22:59:07.785122+0000","last_clean":"2024-04-25T22:59:07.785122+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T22:59:07.785122+0000","last_undegraded":"2024-04-25T22:59:07.785122+0000","last_fullsized":"2024-04-25T22:59:07.785122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783404+0000","last_change":"2024-04-25T22:59:06.790297+0000","last_active":"2024-04-25T22:59:07.783404+0000","last_peered":"2024-04-25T22:59:07.783404+0000","last_clean":"2024-04-25T22:59:07.783404+0000","last_became_active":"2024-04-25T22:59:06.789200+0000","last_became_peered":"2024-04-25T22:59:06.789200+0000","last_unstale":"2024-04-25T22:59:07.783404+0000","last_undegraded":"2024-04-25T22:59:07.783404+0000","last_fullsized":"2024-04-25T22:59:07.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:17.484022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.787179+0000","last_change":"2024-04-25T22:59:06.803808+0000","last_active":"2024-04-25T22:59:07.787179+0000","last_peered":"2024-04-25T22:59:07.787179+0000","last_clean":"2024-04-25T22:59:07.787179+0000","last_became_active":"2024-04-25T22:59:06.803285+0000","last_became_peered":"2024-04-25T22:59:06.803285+0000","last_unstale":"2024-04-25T22:59:07.787179+0000","last_undegraded":"2024-04-25T22:59:07.787179+0000","last_fullsized":"2024-04-25T22:59:07.787179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783578+0000","last_change":"2024-04-25T22:59:05.773898+0000","last_active":"2024-04-25T22:59:07.783578+0000","last_peered":"2024-04-25T22:59:07.783578+0000","last_clean":"2024-04-25T22:59:07.783578+0000","last_became_active":"2024-04-25T22:59:05.773068+0000","last_became_peered":"2024-04-25T22:59:05.773068+0000","last_unstale":"2024-04-25T22:59:07.783578+0000","last_undegraded":"2024-04-25T22:59:07.783578+0000","last_fullsized":"2024-04-25T22:59:07.783578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:42.008936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784179+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T22:59:07.784179+0000","last_peered":"2024-04-25T22:59:07.784179+0000","last_clean":"2024-04-25T22:59:07.784179+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T22:59:07.784179+0000","last_undegraded":"2024-04-25T22:59:07.784179+0000","last_fullsized":"2024-04-25T22:59:07.784179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.783103+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T22:59:07.783103+0000","last_peered":"2024-04-25T22:59:07.783103+0000","last_clean":"2024-04-25T22:59:07.783103+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T22:59:07.783103+0000","last_undegraded":"2024-04-25T22:59:07.783103+0000","last_fullsized":"2024-04-25T22:59:07.783103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786627+0000","last_change":"2024-04-25T22:59:06.804422+0000","last_active":"2024-04-25T22:59:07.786627+0000","last_peered":"2024-04-25T22:59:07.786627+0000","last_clean":"2024-04-25T22:59:07.786627+0000","last_became_active":"2024-04-25T22:59:06.803684+0000","last_became_peered":"2024-04-25T22:59:06.803684+0000","last_unstale":"2024-04-25T22:59:07.786627+0000","last_undegraded":"2024-04-25T22:59:07.786627+0000","last_fullsized":"2024-04-25T22:59:07.786627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785200+0000","last_change":"2024-04-25T22:59:05.778693+0000","last_active":"2024-04-25T22:59:07.785200+0000","last_peered":"2024-04-25T22:59:07.785200+0000","last_clean":"2024-04-25T22:59:07.785200+0000","last_became_active":"2024-04-25T22:59:05.777959+0000","last_became_peered":"2024-04-25T22:59:05.777959+0000","last_unstale":"2024-04-25T22:59:07.785200+0000","last_undegraded":"2024-04-25T22:59:07.785200+0000","last_fullsized":"2024-04-25T22:59:07.785200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:18.955918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785912+0000","last_change":"2024-04-25T22:59:06.802535+0000","last_active":"2024-04-25T22:59:07.785912+0000","last_peered":"2024-04-25T22:59:07.785912+0000","last_clean":"2024-04-25T22:59:07.785912+0000","last_became_active":"2024-04-25T22:59:06.801753+0000","last_became_peered":"2024-04-25T22:59:06.801753+0000","last_unstale":"2024-04-25T22:59:07.785912+0000","last_undegraded":"2024-04-25T22:59:07.785912+0000","last_fullsized":"2024-04-25T22:59:07.785912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.785421+0000","last_change":"2024-04-25T22:59:05.784336+0000","last_active":"2024-04-25T22:59:07.785421+0000","last_peered":"2024-04-25T22:59:07.785421+0000","last_clean":"2024-04-25T22:59:07.785421+0000","last_became_active":"2024-04-25T22:59:05.783677+0000","last_became_peered":"2024-04-25T22:59:05.783677+0000","last_unstale":"2024-04-25T22:59:07.785421+0000","last_undegraded":"2024-04-25T22:59:07.785421+0000","last_fullsized":"2024-04-25T22:59:07.785421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:16.113762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773869+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:08.773869+0000","last_peered":"2024-04-25T22:59:08.773869+0000","last_clean":"2024-04-25T22:59:08.773869+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T22:59:08.773869+0000","last_undegraded":"2024-04-25T22:59:08.773869+0000","last_fullsized":"2024-04-25T22:59:08.773869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.775261+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T22:59:08.775261+0000","last_peered":"2024-04-25T22:59:08.775261+0000","last_clean":"2024-04-25T22:59:08.775261+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T22:59:08.775261+0000","last_undegraded":"2024-04-25T22:59:08.775261+0000","last_fullsized":"2024-04-25T22:59:08.775261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.773439+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T22:59:08.773439+0000","last_peered":"2024-04-25T22:59:08.773439+0000","last_clean":"2024-04-25T22:59:08.773439+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T22:59:08.773439+0000","last_undegraded":"2024-04-25T22:59:08.773439+0000","last_fullsized":"2024-04-25T22:59:08.773439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786795+0000","last_change":"2024-04-25T22:59:05.784872+0000","last_active":"2024-04-25T22:59:07.786795+0000","last_peered":"2024-04-25T22:59:07.786795+0000","last_clean":"2024-04-25T22:59:07.786795+0000","last_became_active":"2024-04-25T22:59:05.782768+0000","last_became_peered":"2024-04-25T22:59:05.782768+0000","last_unstale":"2024-04-25T22:59:07.786795+0000","last_undegraded":"2024-04-25T22:59:07.786795+0000","last_fullsized":"2024-04-25T22:59:07.786795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:31.688776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.786229+0000","last_change":"2024-04-25T22:59:06.803221+0000","last_active":"2024-04-25T22:59:07.786229+0000","last_peered":"2024-04-25T22:59:07.786229+0000","last_clean":"2024-04-25T22:59:07.786229+0000","last_became_active":"2024-04-25T22:59:06.802203+0000","last_became_peered":"2024-04-25T22:59:06.802203+0000","last_unstale":"2024-04-25T22:59:07.786229+0000","last_undegraded":"2024-04-25T22:59:07.786229+0000","last_fullsized":"2024-04-25T22:59:07.786229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784817+0000","last_change":"2024-04-25T22:59:05.773997+0000","last_active":"2024-04-25T22:59:07.784817+0000","last_peered":"2024-04-25T22:59:07.784817+0000","last_clean":"2024-04-25T22:59:07.784817+0000","last_became_active":"2024-04-25T22:59:05.772933+0000","last_became_peered":"2024-04-25T22:59:05.772933+0000","last_unstale":"2024-04-25T22:59:07.784817+0000","last_undegraded":"2024-04-25T22:59:07.784817+0000","last_fullsized":"2024-04-25T22:59:07.784817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:29.952674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:08.772813+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T22:59:08.772813+0000","last_peered":"2024-04-25T22:59:08.772813+0000","last_clean":"2024-04-25T22:59:08.772813+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T22:59:08.772813+0000","last_undegraded":"2024-04-25T22:59:08.772813+0000","last_fullsized":"2024-04-25T22:59:08.772813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:59:07.784853+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T22:59:07.784853+0000","last_peered":"2024-04-25T22:59:07.784853+0000","last_clean":"2024-04-25T22:59:07.784853+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T22:59:07.784853+0000","last_undegraded":"2024-04-25T22:59:07.784853+0000","last_fullsized":"2024-04-25T22:59:07.784853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:28.484 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:59:28.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-25T22:59:28.823 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 19 2024-04-25T22:59:28.823 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 8d6ec37a-06d7-4d24-9516-19a660848874 2024-04-25T22:59:28.823 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-25T22:58:45.412350+0000 2024-04-25T22:59:28.823 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-04-25T22:59:07.768159+0000 2024-04-25T22:59:28.823 INFO:teuthology.orchestra.run.smithi043.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:crush_version 4 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:full_ratio 0.95 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:backfillfull_ratio 0.9 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:nearfull_ratio 0.85 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:require_min_compat_client luminous 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:min_compat_client jewel 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:require_osd_release squid 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:stretch_mode_enabled false 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:max_osd 3 2024-04-25T22:59:28.824 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/2867603478,v1:172.21.15.99:6801/2867603478] [v2:172.21.15.99:6802/2867603478,v1:172.21.15.99:6803/2867603478] exists,up 3af34823-d803-4ca7-8300-4935c4b3ba2f 2024-04-25T22:59:28.825 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6800/66914404,v1:172.21.15.165:6801/66914404] [v2:172.21.15.165:6802/66914404,v1:172.21.15.165:6803/66914404] exists,up 13349ae7-4074-4fe6-8cc5-f6e9a003ba23 2024-04-25T22:59:28.825 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/3449711934,v1:172.21.15.172:6801/3449711934] [v2:172.21.15.172:6802/3449711934,v1:172.21.15.172:6803/3449711934] exists,up 86c4b994-d0fe-4635-ae55-e8a4902029d3 2024-04-25T22:59:28.842 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/2867603478,v1:172.21.15.99:6801/2867603478] [v2:172.21.15.99:6802/2867603478,v1:172.21.15.99:6803/2867603478] exists,up 3af34823-d803-4ca7-8300-4935c4b3ba2f', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6800/66914404,v1:172.21.15.165:6801/66914404] [v2:172.21.15.165:6802/66914404,v1:172.21.15.165:6803/66914404] exists,up 13349ae7-4074-4fe6-8cc5-f6e9a003ba23', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/3449711934,v1:172.21.15.172:6801/3449711934] [v2:172.21.15.172:6802/3449711934,v1:172.21.15.172:6803/3449711934] exists,up 86c4b994-d0fe-4635-ae55-e8a4902029d3'] 2024-04-25T22:59:28.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-25T22:59:28.953 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T22:59:28.953 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mon.a", 2024-04-25T22:59:28.953 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster": "ceph", 2024-04-25T22:59:28.953 INFO:teuthology.orchestra.run.smithi043.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-25T22:59:28.953 INFO:teuthology.orchestra.run.smithi043.stdout: "admin_socket_mode": "", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_client_required": "cephx, none", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_cluster_required": "cephx", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_debug": "true", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_service_required": "cephx", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_supported": "cephx", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio": "true", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_poll_ms": "250", 2024-04-25T22:59:28.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_reap_max": "16", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_async_discard": "false", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_block_size": "4096", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio": "false", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_inflight_ios": "false", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_enable_discard": "false", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_flock_retry": "3", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_inject_crash": "0", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring": "false", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring_hipri": "false", 2024-04-25T22:59:28.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_type": "", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_alloc_size": "1048576", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_allocator": "hybrid", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_buffered_io": "true", 2024-04-25T22:59:28.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_for_zeros": "false", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_compact_log_sync": "false", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_max_log_runway": "4194304", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_max_prefetch": "1048576", 2024-04-25T22:59:28.957 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_min_flush_size": "524288", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_min_log_runway": "1048576", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_replay_recovery": "false", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_sync_write": "false", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_allocation_from_file": "true", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_allocator": "hybrid", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-25T22:59:28.958 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_create": "true", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_create": "false", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_path": "", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_size": "0", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_path": "", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_preallocate_file": "false", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_size": "107374182400", 2024-04-25T22:59:28.959 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_create": "false", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_path": "", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_size": "100663296", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs": "true", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_autotune": "true", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-25T22:59:28.960 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size": "0", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_type": "2q", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_clone_cow": "true", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-25T22:59:28.961 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_mode": "none", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_csum_type": "crc32c", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_freelist": "false", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-25T22:59:28.962 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_small_allocations": "0", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_default_buffered_read": "true", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_default_buffered_write": "false", 2024-04-25T22:59:28.963 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fail_eio": "false", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-25T22:59:28.964 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mount": "false", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_umount": "false", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-25T22:59:28.965 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_ignore_data_csum": "false", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_op_age": "5.000000", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_alloc_size": "0", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size": "0", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_deferred_txc": "32", 2024-04-25T22:59:28.966 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size": "0", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_nid_prealloc": "1024", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_retry_disk_reads": "3", 2024-04-25T22:59:28.967 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_cf": "true", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_mem": "512", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-25T22:59:28.968 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_tracing": "false", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_zero_block_detection": "false", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-25T22:59:28.969 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-25T22:59:28.970 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_cluster_require_signatures": "false", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_cluster_require_version": "2", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_require_signatures": "false", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_require_version": "2", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_service_require_signatures": "false", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_service_require_version": "2", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_sign_messages": "true", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "chdir": "", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "client_acl_type": "", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "client_asio_thread_count": "2", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "client_cache_mid": "0.750000", 2024-04-25T22:59:28.971 INFO:teuthology.orchestra.run.smithi043.stdout: "client_cache_size": "16384", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_caps_release_delay": "5", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_check_pool_perm": "true", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_force_sync_read": "false", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_getattr_caps": "false", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_inject_tick_delay": "0", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_die_on_failed_remount": "false", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_dirsize_rbytes": "true", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_force_lazyio": "false", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_fs": "", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_inject_release_failure": "false", 2024-04-25T22:59:28.972 INFO:teuthology.orchestra.run.smithi043.stdout: "client_max_inline_size": "4096", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mds_namespace": "", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_metadata": "", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_gid": "-1", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_timeout": "300", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_uid": "-1", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mountpoint": "/", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_notify_timeout": "10", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc": "true", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_dirty": "104857600", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_objects": "1000", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_size": "209715200", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_target_dirty": "8388608", 2024-04-25T22:59:28.973 INFO:teuthology.orchestra.run.smithi043.stdout: "client_permissions": "true", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_quota": "true", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_quota_df": "true", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_max_bytes": "0", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_max_periods": "4", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_min": "131072", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_reconnect_stale": "false", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_shutdown_timeout": "30", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_snapdir": ".snap", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_tick_interval": "1", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_trace": "", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_try_dentry_invalidate": "false", 2024-04-25T22:59:28.974 INFO:teuthology.orchestra.run.smithi043.stdout: "client_use_faked_inos": "false", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "client_use_random_mds": "false", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog": "false", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog_port": "12201", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_monitors": "default=true", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog": "false", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog_level": "info", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "-", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_network": "", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_network_interface": "", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_isal": "false", 2024-04-25T22:59:28.975 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_level": "5", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_winsize": "-15", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zstd_level": "1", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_alien_op_num_threads": "6", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_seastar_cpu_cores": "", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location_hook": "", 2024-04-25T22:59:28.976 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location_hook_timeout": "10", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "daemonize": "false", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "daos_pool": "tank", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_alienstore": "0/5", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_allow_any_pool_priority": "false", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asok": "1/5", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asok_assert_abort": "false", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asserts_on_shutdown": "true", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_auth": "20/20", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bdev": "1/3", 2024-04-25T22:59:28.977 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bluefs": "1/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bluestore": "1/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_buffer": "0/1", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_ceph_exporter": "1/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cephfs_mirror": "0/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cephsqlite": "0/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_client": "0/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_compressor": "1/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_context": "0/1", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crimson_interrupt": "0/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crush": "1/1", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crypto": "1/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cyanstore": "0/5", 2024-04-25T22:59:28.978 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_deliberately_leak_memory": "false", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_disable_randomized_ping": "false", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_dpdk": "1/5", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_eventtrace": "1/5", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_filer": "0/1", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_filestore": "1/3", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_finisher": "1/1", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_fuse": "1/5", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_heartbeat_testing_span": "0", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_heartbeatmap": "1/5", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_javaclient": "1/5", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_journal": "1/3", 2024-04-25T22:59:28.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_journaler": "0/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_kstore": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_lockdep": "0/1", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mclock": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_balancer": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_locker": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_log": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_log_expire": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_migrator": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_quiesce": "3/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_memstore": "1/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mgr": "2/5", 2024-04-25T22:59:28.980 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mgrc": "1/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mon": "20/20", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_monc": "0/10", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_ms": "1/1", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_none": "0/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objclass": "0/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objectcacher": "0/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objecter": "0/1", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_optracker": "0/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_osd": "1/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_paxos": "20/20", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_perfcounter": "1/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_prioritycache": "1/5", 2024-04-25T22:59:28.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rados": "0/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd": "0/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_mirror": "0/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_pwl": "0/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_replay": "0/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_refs": "0/0", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_reserver": "1/1", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw": "1/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_access": "1/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_datacache": "1/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_dbstore": "1/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_flight": "1/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-25T22:59:28.982 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_sync": "1/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rocksdb": "4/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_backref": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_cache": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_cleaner": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_device": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_epm": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_journal": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_lba": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_odata": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_omap": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_onode": "0/5", 2024-04-25T22:59:28.983 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_t": "0/5", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_tm": "0/5", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_striper": "0/1", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_test": "0/5", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_throttle": "1/1", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_timer": "0/1", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_tp": "0/5", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_trace": "1/5", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "device_failure_prediction_mode": "none", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_graylog": "false", 2024-04-25T22:59:28.984 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_journald": "false", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_stderr": "true", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_syslog": "false", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "event_tracing": "false", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_addr": "0.0.0.0", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_http_port": "9926", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_prio_limit": "5", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_sort_metrics": "true", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_stats_period": "5", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "fake_statfs_for_testing": "0", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "fatal_signal_handlers": "true", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "filer_max_purge_ops": "10", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "filer_max_truncate_ops": "128", 2024-04-25T22:59:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_apply_finisher_threads": "1", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_blackhole": "false", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_btrfs_clone_range": "true", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_btrfs_snap": "true", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_caller_concurrency": "10", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_collect_device_partition_information": "true", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_commit_timeout": "600.000000", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_inject_read_err": "false", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_omap_check": "false", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_verify_split": "false", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_dump_file": "", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-25T22:59:28.986 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fadvise": "true", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fail_eio": "true", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fd_cache_shards": "16", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fd_cache_size": "128", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fiemap": "false", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fiemap_threshold": "4096", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_inject_stall": "0", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_parallel": "false", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_trailing": "false", 2024-04-25T22:59:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_writeahead": "false", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_kill_at": "0", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs": "0", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size": "0", 2024-04-25T22:59:28.988 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_merge_threshold": "-10", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_odsync_write": "false", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_backend": "rocksdb", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_backend_path": "", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_thread_timeout": "60", 2024-04-25T22:59:28.989 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_threads": "2", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_punch_hole": "false", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-25T22:59:28.990 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_ops": "50", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_seek_data_hole": "false", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_sloppy_crc": "false", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_splice": "false", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_split_multiple": "2", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_split_rand_factor": "20", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_update_to": "1000", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-25T22:59:28.991 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_enable": "true", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_xfs_extsize": "false", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_zfs_snap": "false", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "fio_dir": "/tmp/fio", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "8d6ec37a-06d7-4d24-9516-19a660848874", 2024-04-25T22:59:28.992 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_allow_other": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_atomic_o_trunc": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_big_writes": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_debug": "false", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_default_permissions": "false", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_disable_pagecache": "false", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_max_write": "0", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_multithreaded": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_require_active_mds": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_set_user_groups": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_move": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_read": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_write": "true", 2024-04-25T22:59:28.993 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_use_invalidate_cb": "true", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "gss_target_name": "ceph", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_file": "", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_inject_failure": "0", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_interval": "5", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "host": "smithi043", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-25T22:59:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "inject_early_sigterm": "false", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "jaeger_agent_port": "6799", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "jaeger_tracing_enable": "false", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_aio": "true", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_align_min_size": "65536", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_block_align": "true", 2024-04-25T22:59:28.995 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_block_size": "4096", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_dio": "true", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_discard": "false", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_force_aio": "false", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_ignore_corruption": "false", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_max_write_bytes": "10485760", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_max_write_entries": "100", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_replay_from": "0", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_write_header_frequency": "0", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_zero_on_create": "false", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_prefetch_periods": "10", 2024-04-25T22:59:28.996 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_prezero_periods": "5", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_write_head_interval": "15", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "keyfile": "", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_backend": "rocksdb", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_default_stripe_size": "65536", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_fsck_on_mount": "false", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_max_bytes": "67108864", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_max_ops": "512", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_nid_prealloc": "1024", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_onode_map_size": "1024", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-25T22:59:28.997 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_sync_submit_transaction": "false", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_sync_transaction": "false", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "librados_thread_count": "2", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "lockdep": "false", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "lockdep_force_backtrace": "false", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_coarse_timestamps": "true", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_flush_on_exit": "false", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_graylog_host": "127.0.0.1", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_graylog_port": "12201", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_max_new": "1000", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_max_recent": "10000", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_stderr_prefix": "", 2024-04-25T22:59:28.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_stop_at_utilization": "0.970000", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": "true", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_graylog": "false", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_journald": "false", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_stderr": "false", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_syslog": "false", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max_rotating_auth_attempts": "10", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_action_on_write_error": "1", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_alternate_name_max": "8192", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_asio_thread_count": "2", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_export_pin": "true", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_dirs": "true", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-25T22:59:28.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_interval": "5", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_interval": "10", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_max": "-1", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_max_until": "-1", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_merge_size": "50", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_midchunk": "0.300000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_min_start": "0.200000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_minchunk": "0.001000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_mode": "0", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_need_max": "1.200000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_need_min": "0.800000", 2024-04-25T22:59:29.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_overload_epochs": "2", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_bits": "3", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_size": "10000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_target_decay": "10.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_grace": "15.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_interval": "4.000000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_mid": "0.700000", 2024-04-25T22:59:29.001 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_delay": "0", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_release_free_interval": "10", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_reservation": "0.050000", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_interval": "1", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_threshold": "262144", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_prealloc_inos": "1000", 2024-04-25T22:59:29.002 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_connect_bootstrapping": "false", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_damage_table_max_entries": "10000", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_auth_pins": "false", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_frag": "false", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_scatterstat": "false", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_subtrees": "false", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_decay_halflife": "5.000000", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_default_dir_hash": "2", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_defer_session_stale": "true", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_deny_all_reconnect": "false", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_keys_per_op": "16384", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_max_commit_size": "10", 2024-04-25T22:59:29.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_max_entries": "0", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_prefetch": "true", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_on_map": "false", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_early_reply": "true", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_enable_op_tracker": "true", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_enforce_unique_name": "true", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_random": "true", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-25T22:59:29.004 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_health_summarize_threshold": "10", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_health_dummy": "false", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_migrator_session_race": "false", 2024-04-25T22:59:29.005 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_join_fs": "", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_journal_format": "1", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_create_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_export_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_import_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_expire_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_replay_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_link_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_mdstable_at": "0", 2024-04-25T22:59:29.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_openc_at": "0", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_rename_at": "0", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_shutdown_at": "0", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_event_large_threshold": "524288", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_events_per_segment": "1024", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_max_events": "-1", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_max_segments": "128", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_pause": "false", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_segment_size": "0", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-25T22:59:29.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_trim_threshold": "128", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_warn_factor": "2.000000", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_caps_per_client": "1048576", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_completed_flushes": "100000", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_completed_requests": "100000", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_export_size": "20971520", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_file_recover": "32", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_files": "64", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_ops": "8192", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-25T22:59:29.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_snaps_per_dir": "100", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_metrics_update_interval": "2", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_min_caps_per_client": "100", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_min_caps_working_set": "10000", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_numa_node": "-1", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_complaint_time": "30.000000", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_duration": "600", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_size": "20", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_slow_op_size": "20", 2024-04-25T22:59:29.009 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_log_threshold": "5", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_ping_grace": "15", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_ping_interval": "5", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_caps": "30000", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_warning_threshold": "262144", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_replay_interval": "1.000000", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-25T22:59:29.010 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_root_ino_gid": "0", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_root_ino_uid": "0", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-25T22:59:29.011 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_shutdown_check": "0", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_skip_ino": "0", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_max_uid": "4294967294", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_min_uid": "0", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_rstat": "false", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_standby_replay_damaged": "false", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_symlink_recovery": "true", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_thrash_exports": "0", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_thrash_fragments": "0", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_tick_interval": "5.000000", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_valgrind_exit": "false", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_verify_backtrace": "1", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_verify_scatter": "false", 2024-04-25T22:59:29.012 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_wipe_sessions": "false", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool_debug": "false", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_device_bytes": "1073741824", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_page_set": "false", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_page_size": "65536", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_bytes": "134217728", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_messages": "512", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_disabled_modules": "", 2024-04-25T22:59:29.013 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_max_pg_num_change": "128", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mds_bytes": "134217728", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mds_messages": "128", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mon_bytes": "134217728", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mon_messages": "128", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_osd_bytes": "536870912", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_osd_messages": "8192", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_pool": "true", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_standby_modules": "true", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_stats_period": "5", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_stats_threshold": "5", 2024-04-25T22:59:29.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_tick_period": "2", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_allow_pool_delete": "true", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_allow_pool_size_one": "true", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_auth_validate_all_caps": "true", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_bytes": "104857600", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_directed_command_retry": "2", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_parallel": "3", 2024-04-25T22:59:29.015 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_log_interval": "1.000000", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_ping_interval": "10.000000", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_target_rank": "-1", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_file_level": "debug", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_file": "true", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_journald": "false", 2024-04-25T22:59:29.016 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_bootstrap": "false", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_start": "false", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_trim": "true", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cpu_threads": "4", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_crush_min_required_version": "hammer", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_daemon_bytes": "419430400", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-25T22:59:29.017 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_avail_crit": "5", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_avail_warn": "5", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_size_warn": "16106127360", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_json": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_transactions": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_extra_checks": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_reef": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_squid": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-25T22:59:29.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_down_mkfs_grace": "120", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_down_uptime_grace": "60", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_election_default_strategy": "1", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_election_timeout": "5.000000", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ping_divisor": "2", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_enable_op_tracker": "true", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_fake_pool_delete": "false", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_force_quorum_join": "false", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_globalid_prealloc": "10000", 2024-04-25T22:59:29.019 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_detail_to_clog": "false", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_log_update_period": "5", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_max_detail": "50", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog": "true", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog_interval": "600", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_host": "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_host_override": "", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_initial_members": "", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-25T22:59:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease": "5.000000", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_full_interval": "50", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_max": "10000", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_max_summary": "50", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_log_epochs": "500", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_osd": "10000", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_pg_per_osd": "10000", 2024-04-25T22:59:29.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_pool_pg_num": "65536", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_force_trim_to": "0", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_skip_sanity": "false", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_memory_autotune": "true", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_memory_target": "2147483648", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_beacon_grace": "30", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_digest_period": "5", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_inactive_grace": "60", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-25T22:59:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_min_osdmap_epochs": "500", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_complaint_time": "30", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_duration": "600", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_size": "20", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_slow_op_size": "20", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_log_threshold": "5", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_in": "false", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-25T22:59:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_cache_size": "500", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_down_out_interval": "600", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_force_trim_to": "0", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-25T22:59:29.024 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_down_reporters": "2", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_report_timeout": "900", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-25T22:59:29.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_stuck_threshold": "60", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_probe_timeout": "2.000000", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_max_change": "0.050000", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_max_osds": "4", 2024-04-25T22:59:29.026 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_interval": "86400", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_max_keys": "100", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_timeout": "300", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_session_timeout": "300", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_smart_report_timeout": "5", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stat_smooth_intervals": "6", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_pool_min_size": "2", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_pool_size": "4", 2024-04-25T22:59:29.027 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_debug": "false", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_provider_kill_at": "0", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_requester_kill_at": "0", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_timeout": "60.000000", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_target_pg_per_osd": "100", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_tick_interval": "5", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_timecheck_interval": "300.000000", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_use_min_delay_socket": "false", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_older_version_delay": "604800", 2024-04-25T22:59:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_misplaced": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_older_version": "true", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-25T22:59:29.029 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": "", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-25T22:59:29.030 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_tracing_enabled": "false", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_op_threads": "3", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_cm": "false", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_device_name": "", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_dscp": "96", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_local_gid": "", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_port_num": "1", 2024-04-25T22:59:29.031 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_sl": "3", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_support_srq": "true", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_type": "ib", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_reap_threshold": "5", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_before_connect": "false", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_ipv4": "true", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_ipv6": "false", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_msgr1": "true", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_msgr2": "true", 2024-04-25T22:59:29.032 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_port_max": "7568", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_port_min": "6800", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_retry_count": "3", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_retry_delay": "5", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_client": "false", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mds": "false", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mgr": "false", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mon": "false", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_osd": "false", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_client_mode": "crc secure", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_cluster_mode": "crc secure", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_cluster_type": "", 2024-04-25T22:59:29.033 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_compress_secure": "false", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_connection_idle_timeout": "900", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_connection_ready_timeout": "10", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_crc_data": "true", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_crc_header": "true", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_bad_msg": "false", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_bug": "true", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_old_message": "true", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_skipped_message": "false", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_coremask": "0xF", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-25T22:59:29.034 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_enable_tso": "true", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hugepages": "", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_lro": "true", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_memory_channel": "4", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_pmd": "", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_port_id": "0", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-25T22:59:29.035 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dump_on_send": "false", 2024-04-25T22:59:29.036 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_initial_backoff": "0.200000", 2024-04-25T22:59:29.036 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_max": "1.000000", 2024-04-25T22:59:29.036 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-25T22:59:29.036 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_type": "", 2024-04-25T22:59:29.037 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-25T22:59:29.037 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_network_congestion": "0", 2024-04-25T22:59:29.037 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_socket_failures": "0", 2024-04-25T22:59:29.037 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_learn_addr_from_peer": "true", 2024-04-25T22:59:29.037 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_max_accept_failures": "4", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_max_backoff": "15.000000", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_client_mode": "secure crc", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_service_mode": "secure crc", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compress_min_size": "1024", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compress_mode": "none", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_pq_min_cost": "65536", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_public_type": "", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_service_mode": "crc secure", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_listen_backlog": "512", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_nodelay": "true", 2024-04-25T22:59:29.038 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_rcvbuf": "0", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_type": "async+posix", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "no_config_file": "false", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_completion_locks_per_session": "32", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inflight_ops": "1024", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_tick_interval": "5.000000", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_timeout": "10.000000", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objectstore_blackhole": "false", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-25T22:59:29.039 INFO:teuthology.orchestra.run.smithi043.stdout: "openssl_engine_opts": "", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_delay_time": "5.000000", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_hist_halflife": "1000", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_max_low_ops": "2", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_max_ops": "4", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_slop": "0.020000", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_asio_thread_count": "2", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_async_recovery_min_cost": "100", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_scan_max": "512", 2024-04-25T22:59:29.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_scan_min": "64", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_degraded": "false", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_peering": "false", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_unfound": "true", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_beacon_report_interval": "300", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_duration": "30", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_max_block_size": "67108864", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_blkin_trace_all": "false", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-25T22:59:29.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_check_for_log_corruption": "false", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_update_on_start": "true", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_message_cap": "256", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_message_size_cap": "524288000", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_op_priority": "63", 2024-04-25T22:59:29.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_watch_timeout": "30", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_command_max_records": "256", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_compact_on_start": "false", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_update_on_start": "true", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_update_weight_set": "true", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_feed_pullee": "-1", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-25T22:59:29.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_misdirected_ops": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_no_acting_change": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_no_purge_strays": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_op_order": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_shutdown": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_trim_objects": "false", 2024-04-25T22:59:29.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_snaps": "false", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_keys": "1024", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_stride": "524288", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_default_notify_timeout": "30", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep": "0.000000", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-25T22:59:29.045 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_discard_disconnected_ops": "true", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_enable_op_tracker": "true", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_info": "true", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown": "true", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-25T22:59:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_function_tracing": "false", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_grace": "20", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_interval": "6", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_peers": "10", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_size": "2000", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_stale": "600", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_max_size": "100000", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_min_size": "1000", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-25T22:59:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal_size": "5120", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_kill_backfill_at": "0", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_cache_size": "50", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_dedup": "true", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_message_max": "40", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_share_max_epochs": "40", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_attr_name_len": "100", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_attr_size": "0", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_backfills": "1", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_markdown_count": "5", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_markdown_period": "600", 2024-04-25T22:59:29.048 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_name_len": "2048", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_namespace_len": "256", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_size": "134217728", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_blocked_by": "16", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_log_entries": "10000", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pgls": "1024", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_push_cost": "8388608", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_push_objects": "10", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_scrubs": "3", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_trimming_pgs": "2", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_write_op_reply_len": "64", 2024-04-25T22:59:29.049 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_write_size": "90", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_profile": "balanced", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-25T22:59:29.050 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_base": "805306368", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_cache_min": "134217728", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target": "4294967296", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target_autotune": "false", 2024-04-25T22:59:29.051 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_min_pg_log_entries": "250", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_min_recovery_priority": "0", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_report_interval": "5", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_num_cache_shards": "32", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_num_op_tracker_shard": "32", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_auto_affinity": "true", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_node": "-1", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_prefer_iface": "true", 2024-04-25T22:59:29.052 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objecter_finishers": "1", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore": "bluestore", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore_fuse": "false", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore_tracing": "false", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_complaint_time": "30.000000", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_duration": "600", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_size": "20", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_slow_op_size": "20", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_log_threshold": "5", 2024-04-25T22:59:29.053 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards": "0", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards_hdd": "5", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards_ssd": "8", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_pq_min_cost": "65536", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_queue_cut_off": "high", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_thread_timeout": "15", 2024-04-25T22:59:29.054 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_open_classes_on_start": "true", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_os_flags": "0", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_peering_op_priority": "255", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_delete_cost": "1048576", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_delete_priority": "5", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_trim_max": "10000", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_trim_min": "100", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-25T22:59:29.055 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_crimson": "false", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-25T22:59:29.056 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flags": "0", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_min_size": "0", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pg_num": "32", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pgp_num": "0", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_read_ratio": "70", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_size": "2", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_type": "replicated", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_push_per_object_cost": "1000", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-25T22:59:29.057 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recover_clone_overlap": "true", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_cost": "20971520", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active": "0", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_single_start": "1", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_op_priority": "3", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_priority": "5", 2024-04-25T22:59:29.058 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep": "0.000000", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_repair_during_recovery": "false", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_requested_scrub_priority": "120", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_auto_repair": "false", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_begin_hour": "0", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_begin_week_day": "0", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_chunk_max": "25", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_chunk_min": "5", 2024-04-25T22:59:29.059 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_cost": "52428800", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_during_recovery": "false", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_end_hour": "0", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_end_week_day": "0", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_event_cost": "4096", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_invalid_stats": "true", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_max_preemptions": "5", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_priority": "5", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-25T22:59:29.060 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_sleep": "0.000000", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_skip_data_digest": "false", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_smart_report_timeout": "5", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_cost": "1048576", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_priority": "5", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-25T22:59:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_target_transaction_size": "30", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-25T22:59:29.062 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tracing": "false", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_use_stale_snap": "false", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "osdc_blkin_trace_all": "false", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_kill_at": "0", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_max_join_drift": "10", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_min": "500", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_min_wait": "0.050000", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_propose_interval": "1.000000", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_max": "500", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_min": "250", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_stash_full_interval": "25", 2024-04-25T22:59:29.063 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_trim_max": "500", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_trim_min": "250", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "perf": "true", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "-", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrv": "", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "public_bind_addr": "-", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "public_network": "", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "public_network_interface": "", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "qat_compressor_enabled": "false", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "qat_compressor_session_max_number": "256", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_mon_op_timeout": "0", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_osd_op_timeout": "0", 2024-04-25T22:59:29.064 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_tracing": "false", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_atime_update_interval": "60", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_balance_parent_reads": "false", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_balance_snap_reads": "false", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blkin_trace_all": "false", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache": "true", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_policy": "writearound", 2024-04-25T22:59:29.065 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_size": "33554432", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_clone_copy_on_read": "false", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_compression_hint": "none", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_concurrent_management_ops": "10", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_clone_format": "auto", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_data_pool": "", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_features": "61", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_format": "2", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_map_options": "", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_order": "22", 2024-04-25T22:59:29.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_pool": "rbd", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_stripe_count": "0", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_stripe_unit": "0", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_enable_alloc_hint": "true", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_io_scheduler": "simple", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-25T22:59:29.067 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_order": "24", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_pool": "", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_splay_width": "4", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_localize_parent_reads": "false", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_localize_snap_reads": "false", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-25T22:59:29.068 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-25T22:59:29.069 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mtime_update_interval": "60", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_non_blocking_aio": "true", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_op_thread_timeout": "60", 2024-04-25T22:59:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_op_threads": "1", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_parent_cache_enabled": "false", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_plugins": "", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_burst": "0", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_limit": "0", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_exclude_ops": "0", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_burst": "0", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_limit": "0", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-25T22:59:29.071 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_read_from_replica_policy": "default", 2024-04-25T22:59:29.072 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_skip_partial_discard": "true", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_tracing": "false", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_validate_names": "true", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_validate_pool": "true", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "restapi_base_url": "", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "restapi_log_level": "", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_acl_grants_max_num": "100", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_admin_entry": "admin", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_backend_store": "rados", 2024-04-25T22:59:29.073 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_barbican_url": "", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_beast_enable_async": "true", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_counters_cache": "false", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_enabled": "true", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_expiry_interval": "900", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_lru_size": "10000", 2024-04-25T22:59:29.074 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_config_store": "rados", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_content_length_compat": "false", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_copy_obj_progress": "true", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cors_rules_max_num": "100", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cross_domain_policy": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_addr": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_password": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_username": "", 2024-04-25T22:59:29.075 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_require_ssl": "true", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-25T22:59:29.076 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_addr": "", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_auth": "token", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_namespace": "", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_prefix": "", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_token_file": "", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_buffersize": "524288", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_low_speed_time": "300", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-25T22:59:29.077 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d4n_port": "6379", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_changes_size": "1000", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_num_shards": "128", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-25T22:59:29.078 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_window": "30", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-25T22:59:29.079 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dns_name": "", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dns_s3website_name": "", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dynamic_resharding": "true", 2024-04-25T22:59:29.080 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_gc_threads": "true", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_lc_threads": "true", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_ops_log": "false", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_quota_threads": "true", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_static_website": "false", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_usage_log": "false", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enforce_swift_acls": "true", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_exit_timeout_secs": "120", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_expose_bucket": "false", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_extended_http_attrs": "", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_filter": "none", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-25T22:59:29.081 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_frontends": "beast port=7480", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_deferred": "50", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_objs": "32", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_processor_period": "3600", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-25T22:59:29.082 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_init_timeout": "300", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_kafka_connection_idle": "300", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_domain": "", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_password": "", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_password_path": "", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_project": "", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_tenant": "", 2024-04-25T22:59:29.083 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_token": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_token_path": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_user": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_api_version": "2", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_domain": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_password": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_project": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_user": "", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-25T22:59:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_url": "", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_debug_interval": "-1", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_lock_max_time": "90", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_objs": "32", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_rules": "1000", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_worker": "3", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_thread_delay": "0", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_dnattr": "uid", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_searchfilter": "", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-25T22:59:29.085 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_uri": "", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_http_headers": "", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_object_name_utc": "false", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attr_name_len": "0", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attr_size": "0", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_chunk_size": "4194304", 2024-04-25T22:59:29.086 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_listing_results": "1000", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_notify_retries": "10", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_put_param_size": "1048576", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_put_size": "5368709120", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_slo_entries": "1000", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_md_log_max_shards": "64", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-25T22:59:29.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_mp_lock_max_time": "600", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_max_gc": "300", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-25T22:59:29.088 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_num_async_rados_threads": "32", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_num_control_oids": "8", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_numa_node": "-1", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_chunk_size": "100", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_gc_interval": "600", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-25T22:59:29.089 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_thread_timeout": "600", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_tracing": "false", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_token": "", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_url": "", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_verify_ssl": "true", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_rados": "false", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_socket_path": "", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-25T22:59:29.090 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_push_interval": "2.000000", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_lanes": "3", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_cache_partitions": "3", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_print_continue": "true", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-25T22:59:29.091 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_tracing": "false", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm": "", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm_id": "", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_region": "", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_request_uri": "", 2024-04-25T22:59:29.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_batch_size": "64", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_max_aio": "128", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_num_logs": "16", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_thread_interval": "600", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_resolve_cname": "false", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_run_sync_thread": "true", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-25T22:59:29.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_scheduler_type": "throttler", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_script_uri": "", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_service_provider_name": "", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_client_id": "", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_client_secret": "", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_entry": "sts", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_key": "sts", 2024-04-25T22:59:29.094 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_min_session_duration": "900", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_token_introspection_url": "", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_account_in_url": "false", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_auth_entry": "auth", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_auth_url": "", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_custom_header": "", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_need_stats": "true", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_tenant_name": "", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_token_expiration": "86400", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_url": "", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_url_prefix": "swift", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-25T22:59:29.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_lease_period": "120", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-25T22:59:29.096 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_thread_pool_size": "512", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_comment": "", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_createby": "", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_encoding": "", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_flag": "false", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_origin": "", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_tracker": "", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_trust_forwarded_https": "false", 2024-04-25T22:59:29.097 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_max_shards": "32", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_max_user_shards": "1", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_use_opa_authz": "false", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_counters_cache": "false", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_max_buckets": "1000", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_policies_max_num": "100", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-25T22:59:29.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_unique_email": "true", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_verify_ssl": "true", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone": "", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone_id": "", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup": "", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup_id": "", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgwlc_auto_session_clear": "true", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_block_size": "4096", 2024-04-25T22:59:29.099 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_size": "536870912", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-25T22:59:29.100 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_index_type": "binary_search", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_partition_filters": "false", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_perf": "false", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "run_dir": "/var/run/ceph", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_block_create": "true", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_cache_lru_size": "67108864", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-25T22:59:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_default_max_object_size": "16777216", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_device_size": "53687091200", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_capacity": "16", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_main_device_type": "SSD", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-25T22:59:29.102 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_segment_size": "67108864", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "set_keepcaps": "false", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "setgroup": "", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "setuser": "", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "setuser_match_path": "", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "thp": "false", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "threadpool_default_timeout": "60", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout: "throttler_perf_counter": "true" 2024-04-25T22:59:29.103 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T22:59:29.105 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-25T22:59:29.244 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a: {} 2024-04-25T22:59:29.245 INFO:teuthology.orchestra.run.smithi043.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:59:29.253 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b: {} 2024-04-25T22:59:29.253 INFO:teuthology.orchestra.run.smithi043.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:59:29.264 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c: {} 2024-04-25T22:59:29.264 INFO:teuthology.orchestra.run.smithi043.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:59:29.281 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-25T22:59:29.282 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T22:59:29.308 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T22:59:29.308 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T22:59:29.308 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T22:59:29.308 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T22:59:29.308 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:29.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:29.308 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T22:59:29.309 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-25T22:59:29.309 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:59:29.309 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:59:29.309 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-04-25T22:59:29.309 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T22:59:29.309 INFO:teuthology.orchestra.console.smithi172:Power off 2024-04-25T22:59:29.309 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:59:29.318 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-25T22:59:29.319 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-25T22:59:29.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:59:29.320 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-25T22:59:29.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:29.321 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-25T22:59:29.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:59:29.323 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:29.320+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:29.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:29.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-25T22:59:29.335 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-04-25T22:59:29.335 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:59:29.358 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-25T22:59:29.379 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-04-25T22:59:29.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:59:29.380 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T22:59:29.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T22:59:29.422 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:29.420+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:29.453 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:29.453 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:29.453 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:29.453 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:29.468 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:29.468 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:29.470 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:29.487 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:29.488 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:29.509 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-25T22:59:29.509 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:59:29.522 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:29.520+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:29.592 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:29.592 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:29.605 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:29.649 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:29.648+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:29.724 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:29.720+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:29.759 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T22:59:29.771 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:29.771 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T22:59:29.776 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:59:29.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:29.777 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:59:29.782 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42471sec preferred_lft 42471sec 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:59:29.783 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:59:29.784 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-25T22:59:29.784 INFO:teuthology.orchestra.run.smithi043.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T22:59:29.784 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 02:42:44:b3:60:28 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:59:29.784 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T22:59:29.784 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:59:29.784 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T22:59:29.784 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:59:29.784 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T22:59:29.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-04-25T22:59:29.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-04-25T22:59:29.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-04-25T22:59:29.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T22:59:29.785 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T22:59:29.786 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:29.828 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:29.828+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:29.867 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T22:59:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:59:29.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:59:29.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:29.905 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T22:59:29.919 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:29.919 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:29.926 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:29.920+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:29.934 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:29.956 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-25T22:59:29.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:29.957 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-25T22:59:30.027 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:30.024+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:30.049 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-25T22:59:30.049 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T22:59:30.049 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T22:59:30.049 INFO:teuthology.orchestra.run.smithi043.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T22:59:30.049 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T22:59:30.049 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T22:59:30.050 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:59:30.050 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T22:59:30.050 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T22:59:30.050 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T22:59:30.050 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T22:59:30.050 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T22:59:30.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:59:30.100 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:30.101 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:59:30.114 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:30.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:30.119 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T22:59:30.128 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:30.128+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:30.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:30.165 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-25T22:59:30.212 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:59:30.213 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T22:59:30.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:59:30.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T22:59:30.213 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T22:59:30.229 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:30.224+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:30.284 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:30.284 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:30.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:30.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:59:30.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:59:30.329 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T22:59:30.329 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:59:30.329 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T22:59:30.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T22:59:30.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T22:59:30.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T22:59:30.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T22:59:30.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T22:59:30.330 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T22:59:30.345 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:30.344+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:30.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:59:30.432 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:30.428+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:30.434 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:30.434 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:30.450 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:30.532 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:30.532+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:30.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:59:30.564 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:59:30.564 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T22:59:30.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-25T22:59:30.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T22:59:30.564 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T22:59:30.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:59:30.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:59:30.616 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:30.617 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:30.623 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T22:59:30.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:59:30.623 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:30.630 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:30.633 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:30.632+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:30.669 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:59:30.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:59:30.669 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:30.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T22:59:30.734 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:30.732+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:30.752 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:30.752 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:30.766 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:30.770 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:59:30.817 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T22:59:30.818 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:59:30.819 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:59:30.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:30.821 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T22:59:30.835 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:30.832+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:30.868 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T22:59:30.869 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T22:59:30.900 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:30.900 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:30.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T22:59:30.916 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:30.928 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:59:30.936 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:30.936+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:30.982 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T22:59:30.982 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T22:59:30.982 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T22:59:30.982 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T22:59:30.982 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T22:59:30.982 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T22:59:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T22:59:30.984 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:59:30.984 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-25T22:59:30.984 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T22:59:30.984 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T22:59:30.984 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T22:59:30.984 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:59:30.984 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:59:30.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:30.985 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T22:59:31.036 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:31.032+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:31.036 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:31.037 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:31.050 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:31.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:2024-04-25T22:59:31.082+0000 7ff134a4f580 -1 init, newargv = 0x55ed82517af0 newargc=15 2024-04-25T22:59:31.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[22872]: starting ceph client 2024-04-25T22:59:31.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[22872]: starting fuse 2024-04-25T22:59:31.138 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:31.136+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:31.219 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:31.219 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:31.234 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:31.238 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:31.236+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:31.339 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:31.336+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:31.369 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:31.369 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:31.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:31.440 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:31.440+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:31.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:59:31.541 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:31.536+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:31.548 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:31.549 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:31.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:31.642 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:31.640+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:31.687 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:31.688 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:31.692 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:31.692 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:31.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:31.692 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:31.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.162457883000002, 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:31.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:31.698 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.162397937000001, 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:31.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.162257431, 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.162223320999999, 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.162188645000001, 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.162061606000002, 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918981556999999, 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918914417, 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918767402, 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918697422000001, 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:31.749 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918635846000001, 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:31.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918533443000001, 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:31.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:31.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:31.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918469733999999, 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:31.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:31.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:31.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:31.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918410551000001, 2024-04-25T22:59:31.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:31.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:31.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:31.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918347057999998, 2024-04-25T22:59:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:31.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:31.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:31.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918288782000001, 2024-04-25T22:59:31.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:31.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:31.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:31.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918184968999999, 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:31.783 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:31.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:31.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:31.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.918033699999999, 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:31.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:31.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.917967494999999, 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:31.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:31.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:31.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.917788466000001, 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:31.802 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:31.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:31.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:31.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:31.806 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:31.807 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:31.808 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:31.808 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:31.809 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-25T22:59:31.809 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:31.810 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:31.804+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:31.810 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:59:31.889 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:59:31.909 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:31.908+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:31.943 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:31.943 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:31.943 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:31.943 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:31.957 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:32.009 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:32.004+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:32.076 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:32.077 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:32.077 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:32.077 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:32.077 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:32.090 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:32.111 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.108+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.138 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T22:59:32.154 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:59:32.201 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T22:59:32.202 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T22:59:32.203 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T22:59:32.204 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:59:32.204 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:59:32.204 INFO:teuthology.orchestra.run.smithi043.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:32.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:32.205 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T22:59:32.211 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.212+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.253 INFO:teuthology.orchestra.run.smithi043.stdout:45 2024-04-25T22:59:32.253 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T22:59:32.253 DEBUG:teuthology.orchestra.run.smithi043:> sudo stdin-killer -- python3 -c ' 2024-04-25T22:59:32.253 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2024-04-25T22:59:32.253 DEBUG:teuthology.orchestra.run.smithi043:> import re 2024-04-25T22:59:32.253 DEBUG:teuthology.orchestra.run.smithi043:> import os 2024-04-25T22:59:32.253 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2024-04-25T22:59:32.253 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T22:59:32.254 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T22:59:32.255 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2024-04-25T22:59:32.255 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2024-04-25T22:59:32.255 DEBUG:teuthology.orchestra.run.smithi043:> return f 2024-04-25T22:59:32.255 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T22:59:32.255 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T22:59:32.255 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.0")) 2024-04-25T22:59:32.255 DEBUG:teuthology.orchestra.run.smithi043:> ' 2024-04-25T22:59:32.258 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:32.258 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.486248386, 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.259 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.260 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.263 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:32.264 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.486111696999998, 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.265 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.266 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:32.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:32.268 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:32.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.48603572, 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.271 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.272 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:32.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:32.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.276 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:32.277 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.485935607999998, 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:32.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:32.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.281 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:32.283 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.485849611999999, 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.284 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.285 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.286 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:32.287 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:32.288 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.485782125, 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.290 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.291 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:32.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:32.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.485481095000001, 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.297 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.485100098, 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.303 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.485003975000001, 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.305 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:32.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:32.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.309 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.471814724000001, 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.310 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.311 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.312 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.313 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.314 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.470196413, 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.315 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.468008996999998, 2024-04-25T22:59:32.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:32.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:32.321 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.322 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.467867183999999, 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.323 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:32.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:32.326 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.465381347000001, 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:32.327 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:32.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.331 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.465311200999999, 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.333 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:32.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.335 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.464715169000002, 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.336 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:32.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.464188856, 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:32.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.446717231000001, 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00075113399999999998, 2024-04-25T22:59:32.344 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.345 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.6599999999999996e-07 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809131+0000", 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3870000000000003e-06 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809146+0000", 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5656000000000001e-05 2024-04-25T22:59:32.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809158+0000", 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1564e-05 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809527+0000", 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036958 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809544+0000", 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7053000000000001e-05 2024-04-25T22:59:32.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809876+0000", 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033132799999999998 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.446578462000002, 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.348 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:32.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.351 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 23.490133274000002, 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:32.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:32.354 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:32.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:32.356 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:32.357 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:32.357 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.357 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.357 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.357 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:32.357 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:32.357 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:32.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:32.360 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.360+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.443 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.0.22872.asok 2024-04-25T22:59:32.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T22:59:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:59:32.455 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22872.asok 2024-04-25T22:59:32.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:32.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22872.asok status 2024-04-25T22:59:32.458 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.456+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.494 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:32.495 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:32.510 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:32.597 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.596+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "0", 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "22872", 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/" 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4556, 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2024-04-25T22:59:32.613 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 4556 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2081772121 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2081772121 2024-04-25T22:59:32.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.4556 192.168.0.1:0/2081772121", 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/2081772121", 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 1, 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 6, 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 20, 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2024-04-25T22:59:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T22:59:32.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:32.626 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2024-04-25T22:59:32.626 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2024-04-25T22:59:32.633 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:32.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:59:32.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:32.661 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.660+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.675 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:32.676 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:32.689 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T22:59:32.702 INFO:tasks.workunit:Pulling workunits from ref b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:59:32.703 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T22:59:32.703 INFO:tasks.workunit:timeout=3h 2024-04-25T22:59:32.703 INFO:tasks.workunit:cleanup=True 2024-04-25T22:59:32.703 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:32.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 22:59:06.761259610 +0000 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 22:59:32.687176412 +0000 2024-04-25T22:59:32.738 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-04-25T22:59:32.738 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T22:59:32.738 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T22:59:32.793 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.792+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.798 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:59:32.846 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T22:59:32.863 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:32.860+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:32.877 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.348396379999997, 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.348336433999997, 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:32.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:32.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:32.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.348195928000003, 2024-04-25T22:59:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:32.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.348161818000001, 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:32.895 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:32.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:32.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.348127142000003, 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.901 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:32.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:32.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.348000102999997, 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:32.907 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:32.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.912 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104920054000001, 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104852913999999, 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:32.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:32.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104705898999999, 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.924 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104635919, 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.930 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.931 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.931 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:32.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104574342999999, 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:32.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.10447194, 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.943 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:32.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104408231000001, 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:32.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:32.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:32.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104349048, 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104285555000001, 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:32.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:32.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104227279, 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:32.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.104123466000001, 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.972 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:32.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:32.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.978 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.103972197000001, 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:32.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.984 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.103905992000001, 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.990 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.103726963, 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:32.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:32.995 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:32.997 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T22:59:32.997 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:32.998 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:32.996+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:33.098 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:33.092+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:33.128 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:33.128 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:33.128 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:33.128 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:33.143 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:33.198 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:33.200+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:33.301 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:33.300+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:33.312 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:33.312 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:33.312 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:33.312 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:33.312 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:33.326 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:33.359 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:59:33.402 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:33.400+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:33.445 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:33.445 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:33.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.673231464000001, 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:33.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:33.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:33.452 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.673094774999999, 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:33.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:33.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.673018798000001, 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:33.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.672918685999999, 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.465 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:33.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:33.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:33.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.67283269, 2024-04-25T22:59:33.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:33.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:33.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.672765203000001, 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.477 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:33.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:33.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.672464173000002, 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:33.486 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.672083176000001, 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:33.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:33.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:33.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.671987052999999, 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:33.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:33.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.658797801999999, 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.496 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:33.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:33.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:33.500 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.657179491000001, 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.654992074999999, 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:33.504 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:33.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.654850262, 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:33.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:33.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:33.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.652364425000002, 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:33.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:33.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.652294278999999, 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.517 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:33.520 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.651698246999999, 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:33.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:33.524 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.651171934000001, 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:33.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:33.528 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.633700308999998, 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00075113399999999998, 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:33.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809125+0000", 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.6599999999999996e-07 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809131+0000", 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3870000000000003e-06 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809146+0000", 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5656000000000001e-05 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809158+0000", 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1564e-05 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809527+0000", 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036958 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809544+0000", 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7053000000000001e-05 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809876+0000", 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033132799999999998 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.532 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.633561539999999, 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:33.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:33.536 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 24.677116351999999, 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:33.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:33.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:33.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:33.542 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.542 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.542 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.542 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:33.542 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:33.542 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:33.544 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:33.544+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:33.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:33.545 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-25T22:59:33.645 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:33.644+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:33.676 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:33.677 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:33.677 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:33.677 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:33.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:33.746 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:33.740+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:33.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:59:33.847 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:33.844+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:33.853 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:33.853 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:33.867 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:33.948 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:33.944+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:33.976 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:33.976 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:33.988 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:33.988 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:33.997 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:33.997 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:33.998 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:34.002 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:34.002 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:34.003 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:34.049 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:34.044+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:34.133 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:34.133 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:34.147 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:34.149 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:34.148+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:34.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-25T22:59:34.250 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:34.248+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:34.315 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:34.315 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:34.329 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:34.371 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:34.368+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:34.453 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:34.448+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:34.494 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:34.494 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:34.509 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:34.554 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:34.552+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:34.642 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:34.642 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:34.654 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:34.652+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:34.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:34.755 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:34.752+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:34.821 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:34.821 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:34.836 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:34.856 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:34.856+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:34.957 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:34.956+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:34.958 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:34.958 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:34.975 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:34.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:59:35.058 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:35.056+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:35.105 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:35.105 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:35.120 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:35.163 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:35.160+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:35.259 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:35.260+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:35.284 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:35.284 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:35.298 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:35.360 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:35.360+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:35.421 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:35.421 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:35.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:35.485 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:35.484+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:35.562 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:35.560+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:35.569 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:35.569 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:35.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:35.669 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:35.668+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:35.741 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:35.741 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:35.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:35.764 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:35.760+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:35.864 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:35.864+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T22:59:35.922 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:35.922 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:35.936 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:35.987 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:35.984+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:36.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:59:36.066 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:36.064+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:36.067 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:36.068 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:36.081 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:36.163 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:36.166 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:36.164+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:36.181 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:36.184 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:36.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:36.245 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:36.245 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:36.245 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:36.245 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:36.245 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:36.261 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:36.267 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:36.268+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:36.368 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:36.364+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:36.389 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:36.389 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:36.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.617388799, 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:36.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.617252109999999, 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.396 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:36.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:36.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:36.402 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.617176133000001, 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:36.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:36.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.617076020999999, 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:36.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:36.412 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:36.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.616990025, 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:36.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:36.417 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.616922538000001, 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.421 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.422 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:36.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.616621508000001, 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:36.427 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:36.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.616240511000001, 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:36.431 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:36.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:36.435 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.616144387999999, 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:36.440 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.602955136999999, 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:36.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:36.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.601336826000001, 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:36.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.448 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.599149409999999, 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.452 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.599007597, 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:36.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.596521760000002, 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:36.457 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:36.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:36.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:36.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.596451613999999, 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:36.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:36.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.595855581999999, 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.468 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.595329269, 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.472 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.577718874999999, 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:36.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.621273686999999, 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:36.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:36.481 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.6189939459999998, 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:36.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:36.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:36.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:36.487 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:36.489 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:36.484+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:36.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:36.589 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:36.588+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:36.622 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:36.622 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:36.622 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:36.622 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:36.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:36.690 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:36.688+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:36.752 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:36.752 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:36.752 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:36.753 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:36.753 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:36.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:36.791 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:36.788+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.357019627, 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.887 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.892 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.356959680999999, 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:36.893 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.898 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.356819174999998, 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:36.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:36.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:36.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.356785064999997, 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:36.904 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:36.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:36.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:36.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.356750388999998, 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:36.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:36.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.915 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.35662335, 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.113543301, 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:36.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:36.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:36.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.113476161000001, 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.927 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:36.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.933 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.113329146000002, 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.939 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.113259165999999, 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.944 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.113197589999999, 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.113095186999999, 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.950 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:36.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:36.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.113031478, 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:36.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:36.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.112972294999999, 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:36.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:36.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.966 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.112908802, 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:36.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.112850525999999, 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:36.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:36.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.112746713, 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:36.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:36.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:36.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.112595444, 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:36.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:36.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:36.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:36.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.112529239000001, 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:36.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:36.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:36.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.112350209999999, 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:36.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:37.001 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:37.003 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:37.003 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:37.000+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:37.104 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:37.100+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:37.135 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:37.135 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:37.136 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:37.136 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:37.149 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:37.235 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:37.232+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:37.305 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:37.304+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:37.316 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:37.316 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:37.316 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:37.316 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:37.316 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:37.331 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:37.406 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:37.408+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:37.500 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:37.500 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:37.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:37.500 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:37.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.500 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.500 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.729712274000001, 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:37.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:37.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.729575584999999, 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:37.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:37.512 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.729499608000001, 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:37.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:37.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:37.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.729399495999999, 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.519 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:37.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:37.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.7293135, 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:37.525 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:37.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:37.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:37.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:37.531 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.729246013000001, 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:37.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:37.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:37.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:37.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:37.537 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.728944983000002, 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:37.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:37.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:37.541 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.728563986000001, 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:37.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:37.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.728467862999999, 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:37.546 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:37.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.550 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.715278611999999, 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:37.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.713660301000001, 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.555 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.558 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.711472884999999, 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:37.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.711331072, 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.563 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:37.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.567 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.708845234999998, 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:37.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.571 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.708775089, 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.575 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.708179056999999, 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:37.579 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.707652744000001, 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.583 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.690042349999999, 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 28.733597161999999, 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:37.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:37.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:37.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.731317421, 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:37.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:37.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:37.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:37.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:37.599 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.599 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.599 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.599 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:37.599 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:37.599 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:37.599 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:59:37.610 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:37.596+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:37.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:37.701 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:37.700+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:37.711 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-25T22:59:37.742 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:37.742 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:37.742 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:37.742 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:37.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:37.803 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:37.800+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:37.811 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-04-25T22:59:37.872 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:37.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:37.872 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:37.872 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:37.872 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:37.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:37.904 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:37.904+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:37.937 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:59:38.005 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.004+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.007 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:38.007 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:38.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:38.007 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:38.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.007 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.477243856999998, 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:38.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:38.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.477183910999997, 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:38.014 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:38.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.477043405000003, 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:38.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:38.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:38.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.477009295000002, 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:38.026 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:38.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:38.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.476974619000003, 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:38.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:38.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:38.037 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.476847579999998, 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.038 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:38.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.044 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233767531000002, 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:38.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:38.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:38.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233700390999999, 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.050 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:38.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:38.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:38.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:38.056 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233553376, 2024-04-25T22:59:38.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:38.057 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.057 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.057 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:38.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:38.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233483396, 2024-04-25T22:59:38.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:38.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:38.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.23342182, 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:38.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:38.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:38.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233319417000001, 2024-04-25T22:59:38.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:38.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233255708000002, 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233196525, 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.085 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:38.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233133032000001, 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:38.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:38.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.233074756000001, 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:38.097 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:38.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:38.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:38.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:38.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.103 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.232970943000002, 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.109 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.232819674000002, 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:38.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:38.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.232753468999999, 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.23257444, 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:38.126 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:38.128 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:38.128 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.128+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:59:38.228 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.224+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.259 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:38.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:38.260 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:38.260 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:38.273 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:38.338 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:38.339 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:38.356 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:38.357 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:38.357 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:38.358 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.356+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.359 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:38.360 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:38.430 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.424+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.435 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:38.435 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:38.449 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:38.539 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.536+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.617 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:38.617 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:38.631 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:38.631+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:38.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:38.733 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:38.731+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:38.762 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:38.763 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:38.777 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:38.834 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.832+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.928 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T22:59:38.938 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:38.932+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:38.942 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:38.942 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:38.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:39.036 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:39.036+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:39.077 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:39.078 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:39.091 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:39.139 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:39.136+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:39.222 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:39.222 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:39.236 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:39.279 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:39.276+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:39.338 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:39.332+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:39.400 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:39.400 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:39.414 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:39.455 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:39.452+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:39.539 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:39.539+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:39.576 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:39.576 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:39.591 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:39.640 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:39.635+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:39.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:39.741 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:39.740+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:39.842 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:39.839+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:39.904 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:39.905 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:39.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:39.943 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:39.944+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.044 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:40.044+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-04-25T22:59:40.087 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:40.087 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:40.103 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:40.147 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:40.144+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.233 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:40.233 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:40.245 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:40.243+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:40.247 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:40.347 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:40.347+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:40.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:59:40.407 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:40.408 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:40.423 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:40.448 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:40.443+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:40.524 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:40.524 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:40.544 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:40.548 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:40.548 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:40.549 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:40.544+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.778161011999998, 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:40.550 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:40.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:40.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:40.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:40.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:40.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:40.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.778024322999997, 2024-04-25T22:59:40.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:40.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:40.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.777948346000002, 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:40.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:40.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.569 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.777848233999997, 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:40.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:40.575 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.777762238000001, 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:40.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.777694750999999, 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:40.582 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:40.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:40.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:40.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.777393721000003, 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:40.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:40.592 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.777012724000002, 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:40.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:40.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.776916601000003, 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:40.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:40.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.763727350000003, 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:40.603 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.606 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:40.607 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.762109039000002, 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:40.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:40.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.759921622999997, 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.611 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:40.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:40.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.759779809999998, 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:40.615 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:40.619 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.757293973000003, 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:40.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.757223826999997, 2024-04-25T22:59:40.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:40.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.756627795, 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.630 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.756101481999998, 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:40.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:40.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:40.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 33.738491088000004, 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:40.635 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:40.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:40.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.7820459, 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.643 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 6.7797661590000002, 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:40.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:40.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:40.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:40.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:40.648 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.649 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.649 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.649 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:40.649 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:40.649 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:40.650 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:40.648+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:40.751 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:40.748+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.780 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:40.780 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:40.780 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:40.780 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:40.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:40.851 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:40.848+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.915 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:40.915 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:40.915 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:40.915 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:40.916 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:40.930 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:40.952 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:40.952+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:40.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.521145693000001, 2024-04-25T22:59:41.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:41.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:41.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.521085747000001, 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:41.057 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.062 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.520945241, 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.520911130999998, 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:41.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.520876455, 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.520749416000001, 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:41.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277669367000001, 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:41.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:41.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:41.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:41.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277602227000003, 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:41.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:41.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277455212, 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:41.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:41.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.101 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277385232, 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277323656, 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.107 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:41.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277221253, 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277157543999998, 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:41.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277098361, 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.123 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:41.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:41.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:41.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:41.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:41.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.277034868000001, 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:41.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:41.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.276976591999997, 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.276872779000001, 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:41.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:41.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.276721510000002, 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:41.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:41.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:41.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:41.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.276655304999998, 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:41.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:41.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:41.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.158 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.276476275999997, 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:41.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:41.163 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:41.165 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:41.165 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:41.160+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:41.265 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:41.260+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:41.298 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:41.298 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:41.298 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:41.298 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:41.314 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:41.366 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:41.367+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:41.467 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:41.464+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:41.476 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:41.476 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:41.476 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:41.476 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:41.476 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:41.490 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:41.568 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:41.567+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:41.655 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.884880705999997, 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:41.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:41.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.884744017000003, 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.662 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:41.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:41.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:41.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:41.668 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.668 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.668 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.884668040000001, 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.669 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.884567928000003, 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.675 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.884481932, 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:41.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:41.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.884414444999997, 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.687 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:41.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:41.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:41.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:41.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:41.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:41.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.884113415000002, 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.695 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:41.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.883732418000001, 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:41.699 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:41.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:41.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.703 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.883636295000002, 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:41.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:41.708 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.870447044000002, 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:41.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:41.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:41.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.868828733000001, 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:41.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.866641317000003, 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.716 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:41.720 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.866499503999997, 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:41.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:41.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.724 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.864013667000002, 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:41.728 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.863943521000003, 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.863347488999999, 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.732 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.862821175999997, 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:41.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:41.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.845210782000002, 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:41.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:41.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.888765593999999, 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 7.8864858529999999, 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:41.749 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:41.754 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:41.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:41.756 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:41.755+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:41.857 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:41.855+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:41.888 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:41.888 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:41.888 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:41.888 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:41.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:41.946 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T22:59:41.989 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:41.987+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:42.059 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:42.055+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:42.060 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:42.060 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:42.060 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:42.060 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:42.060 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:42.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:42.159 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:42.160+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:42.242 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:42.242 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:42.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.713963016999998, 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:42.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:42.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.713903070999997, 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:42.249 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:42.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.713762565000003, 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:42.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.713728455000002, 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.713693779000003, 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:42.271 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.713566739999997, 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.470486690999998, 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:42.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:42.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.470419550999999, 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:42.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:42.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.470272536000003, 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:42.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:42.295 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.470202555999997, 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:42.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:42.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.300 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.470140979999996, 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.470038576999997, 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:42.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:42.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:42.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.469974868000001, 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.469915684999997, 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:42.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:42.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:42.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:42.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:42.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.469852191999998, 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:42.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:42.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:42.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.469793916, 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:42.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:42.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:42.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.469690102999998, 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:42.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:42.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.469538833999998, 2024-04-25T22:59:42.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:42.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:42.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.469472629000002, 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:42.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.4692936, 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:42.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:42.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:42.359 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:42.361 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:42.361 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:42.356+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:42.462 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:42.456+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:42.494 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:42.494 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:42.494 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:42.494 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:42.509 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:42.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:59:42.595 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:42.592+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:42.664 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:42.660+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:42.670 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:42.670 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:42.670 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:42.670 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:42.670 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:42.684 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:42.711 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:42.711 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:42.730 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:42.734 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:42.735 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:42.764 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:42.759+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:42.849 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:42.849 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:42.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:42.864 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:42.863+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:42.913 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-25T22:59:42.913 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:59:42.913 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T22:59:42.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T22:59:42.965 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:42.963+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:42.994 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:42.995 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:43.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:43.091 INFO:teuthology.orchestra.run.smithi043.stderr:no valid command found; 10 closest matches: 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:0 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:1 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:2 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:abort 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:assert 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:bench [] [] [] [] 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs debug_inject_read_zeros 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs files list 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs stats 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:bluestore allocator dump block 2024-04-25T22:59:43.092 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: invalid command 2024-04-25T22:59:43.094 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:59:43.095 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T22:59:43.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T22:59:43.097 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.095+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:43.167 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.163+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:43.178 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:43.178 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:43.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:43.255 INFO:teuthology.orchestra.run.smithi043.stderr:no valid command found; 10 closest matches: 2024-04-25T22:59:43.255 INFO:teuthology.orchestra.run.smithi043.stderr:0 2024-04-25T22:59:43.255 INFO:teuthology.orchestra.run.smithi043.stderr:1 2024-04-25T22:59:43.255 INFO:teuthology.orchestra.run.smithi043.stderr:2 2024-04-25T22:59:43.255 INFO:teuthology.orchestra.run.smithi043.stderr:abort 2024-04-25T22:59:43.256 INFO:teuthology.orchestra.run.smithi043.stderr:assert 2024-04-25T22:59:43.256 INFO:teuthology.orchestra.run.smithi043.stderr:bench [] [] [] [] 2024-04-25T22:59:43.256 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs debug_inject_read_zeros 2024-04-25T22:59:43.256 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs files list 2024-04-25T22:59:43.256 INFO:teuthology.orchestra.run.smithi043.stderr:bluefs stats 2024-04-25T22:59:43.256 INFO:teuthology.orchestra.run.smithi043.stderr:bluestore allocator dump block 2024-04-25T22:59:43.256 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: invalid command 2024-04-25T22:59:43.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:59:43.259 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T22:59:43.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T22:59:43.281 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.279+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:43.361 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:43.362 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:43.368 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.363+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:43.377 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:43.381 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:43.384 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:43.384 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T22:59:43.470 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:43.464+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:43.508 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:43.508 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:43.522 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:43.571 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.571+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:43.672 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:43.668+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:43.687 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:43.687 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:43.702 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:43.774 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.775+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:43.866 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:43.866 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:43.875 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.875+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:43.881 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:43.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:59:43.976 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:43.971+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:44.011 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:44.012 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:44.026 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:44.077 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:44.076+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:44.177 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:44.175+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:44.195 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:44.195 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:44.211 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:44.279 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:44.276+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:44.378 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:44.378 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:44.379 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:44.380+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:44.392 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:44.480 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:44.476+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:44.523 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:44.523 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:44.537 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:44.581 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:44.579+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:44.682 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:44.676+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:44.700 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:44.700 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:44.714 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:44.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:59:44.783 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:44.779+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:44.884 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:44.880+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:44.884 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:44.885 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:44.896 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:44.897 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:44.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:44.916 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:44.917 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:44.917 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:44.920 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:44.920 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:44.953 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T22:59:44.985 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:44.980+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:45.032 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:45.032 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:45.032 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:45.032 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:45.046 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:45.089 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:45.087+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:45.166 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:45.167 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:45.167 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:45.167 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:45.167 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:45.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:45.222 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:45.219+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:45.287 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:45.283+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.816048021, 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:45.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:45.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.815988075, 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.350 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:45.355 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.815847568999999, 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:45.356 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:45.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.815813458999997, 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:45.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.815778782999999, 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:45.368 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:45.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:45.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:45.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.815651744, 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:45.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:45.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:45.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572571695000001, 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572504555000002, 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.385 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572357539999999, 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.391 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:45.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572287559999999, 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:45.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:45.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572225983999999, 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:45.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:45.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572123581, 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:45.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.413 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572059871999997, 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.418 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.572000688999999, 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.571937196, 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:45.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:45.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.571878920000003, 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.431 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:45.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.571775107000001, 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:45.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:45.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.571623838000001, 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:45.445 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:45.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.571557632999998, 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:45.451 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:45.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.571378604000003, 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:45.457 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:45.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:45.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:45.462 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:45.462 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:45.463 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:45.464 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:45.463+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:45.564 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:45.560+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:45.595 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:45.596 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:45.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:45.596 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:45.610 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:45.665 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:45.659+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:45.766 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:45.760+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:45.774 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:45.774 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:45.774 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:45.774 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:45.774 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:45.789 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:45.867 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:45.863+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184829735999998, 2024-04-25T22:59:45.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:45.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.963 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184693047000003, 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:45.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.969 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184617070000002, 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:45.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.975 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184516958000003, 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:45.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.981 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184430962, 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:45.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:45.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:45.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184363474999998, 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:45.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:45.993 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184062445000002, 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:45.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.997 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.183681448000002, 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:45.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:45.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:46.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.001 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.183585325000003, 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:46.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:46.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:46.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.170396074000003, 2024-04-25T22:59:46.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:46.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.010 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.168777763000001, 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:46.014 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.166590347000003, 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:46.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:46.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.166448533999997, 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:46.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:46.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:46.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.163962697000002, 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:46.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.163892551000004, 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:46.027 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:46.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.163296518999999, 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:46.034 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.162770205999998, 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.145159812000003, 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:46.039 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:46.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.042 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 37.188714623999999, 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.186434883, 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:46.048 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:46.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:46.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:46.055 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.055 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.055 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.055 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:46.055 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:46.055 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:46.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-04-25T22:59:46.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:46.057 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:46.055+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:46.157 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:46.152+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:46.186 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:46.186 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:46.186 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:46.186 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:46.200 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:46.258 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:46.252+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:46.322 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:46.322 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:46.322 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:46.322 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:46.322 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:46.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:46.381 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:46.379+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:46.458 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:46.458 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:46.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:46.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.927787610999999, 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.459 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:46.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:46.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:46.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.927727664999999, 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:46.465 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:46.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:46.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:46.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.927587158999998, 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:46.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:46.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:46.476 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.927553048999997, 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:46.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:46.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:46.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:46.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.927518372999998, 2024-04-25T22:59:46.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:46.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:46.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.927391333999999, 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:46.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.684311285, 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:46.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.684244145000001, 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:46.499 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:46.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:46.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.684097129999998, 2024-04-25T22:59:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:46.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:46.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.684027149999999, 2024-04-25T22:59:46.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:46.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683965573999998, 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:46.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683863170999999, 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.522 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:46.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:46.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:46.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:46.527 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683799462000003, 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:46.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683740278999998, 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:46.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:46.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:46.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683676785999999, 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:46.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:46.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683618510000002, 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:46.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683514697, 2024-04-25T22:59:46.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:46.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683363428, 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:46.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683297222999997, 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:46.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.683118194000002, 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:46.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:46.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:46.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:46.575 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:46.576 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:46.577 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:46.576+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:46.677 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:46.671+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:46.708 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:46.708 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:46.708 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:46.708 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:46.722 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:46.811 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:46.807+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:46.878 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:46.875+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:46.890 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:46.890 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:46.905 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:46.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:59:46.974 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:59:46.980 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:46.979+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:47.069 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:47.069 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:47.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:47.069 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:47.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.069 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.295637704999997, 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:47.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:47.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:47.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.295501016000003, 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:47.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.082 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.295425039000001, 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:47.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:47.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:47.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.295324927000003, 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.089 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:47.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:47.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:47.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:47.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.295238931, 2024-04-25T22:59:47.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:47.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:47.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.295171443999998, 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:47.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:47.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:47.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.294870414000002, 2024-04-25T22:59:47.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:47.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.294489417000001, 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:47.111 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:47.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:47.115 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.294393294000002, 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.281204043000002, 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:47.124 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.279585732000001, 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.125 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:47.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.128 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.277398316000003, 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:47.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:47.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:47.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.277256502999997, 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.133 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:47.137 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.274770666000002, 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.274700520000003, 2024-04-25T22:59:47.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:47.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:47.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.274104487999999, 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:47.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:47.148 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.273578174999997, 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:47.153 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.255967781000003, 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 38.299522592999999, 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.157 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:47.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:47.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 13.297242852, 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:47.163 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:47.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:47.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:47.168 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:47.169 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:47.171 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:47.172 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:47.167+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:47.172 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:47.173 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:47.174 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:47.174 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:47.174 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:47.271 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:47.271+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:47.306 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:47.306 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:47.321 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:47.372 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:47.367+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:47.443 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:47.444 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:47.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:47.473 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:47.467+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:47.574 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:47.571+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:47.625 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:47.625 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:47.639 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:47.687 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:47.683+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:47.771 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:47.772 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:47.776 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:47.771+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:47.786 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:47.877 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:47.871+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:47.948 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:47.949 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:47.962 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T22:59:47.964 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:48.007 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:48.003+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:48.079 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:48.079+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:48.124 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:48.124 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:48.139 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:48.185 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:48.183+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:48.272 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:48.273 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:48.280 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:48.279+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:48.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:48.381 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:48.375+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:48.385 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-25T22:59:48.385 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:59:48.385 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:59:48.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:59:48.449 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:48.449 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:48.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:48.510 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:48.507+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:48.582 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:48.579+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:48.585 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:48.586 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:48.600 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:48.684 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:48.679+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:48.742 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:48.742 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 28, 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "8d6ec37a-06d7-4d24-9516-19a660848874", 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-25T22:58:45.412350+0000", 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-25T22:59:47.951946+0000", 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-25T22:59:33.885587+0000", 2024-04-25T22:59:48.743 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-25T22:58:46.328330+0000", 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5804032, 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "nodeep-scrub", 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:59:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 4, 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "jewel", 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "squid", 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-25T22:59:48.745 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-25T22:58:56.581519+0000", 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-25T22:59:48.746 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "12", 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:59:48.747 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-25T22:59:48.748 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-25T22:59:48.749 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-25T22:59:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 3.0299999713897705, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 3.0299999713897705, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.33000001311302185, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-25T22:59:00.664462+0000", 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:59:48.752 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-25T22:59:48.753 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-25T22:59:48.754 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-25T22:59:48.755 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-25T22:59:48.756 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.4900000095367432, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.4900000095367432, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:59:48.757 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-25T22:59:04.692579+0000", 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-25T22:59:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-25T22:59:48.759 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-25T22:59:48.760 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-25T22:59:48.761 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-25T22:59:48.762 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-25T22:59:48.763 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.690000057220459, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.690000057220459, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-25T22:59:48.764 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-25T22:59:05.120185+0000", 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-25T22:59:48.765 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "19", 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-25T22:59:48.766 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-25T22:59:48.767 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-25T22:59:48.768 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.769 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "score_type": "Fair distribution", 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5399999618530273, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5399999618530273, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-25T22:59:48.770 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "3af34823-d803-4ca7-8300-4935c4b3ba2f", 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-25T22:59:48.771 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 22, 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6800", 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6801", 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6802", 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6803", 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.773 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6806", 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6807", 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6804", 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.99:6805", 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2867603478 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.99:6801/2867603478", 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.99:6803/2867603478", 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.99:6807/2867603478", 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.99:6805/2867603478", 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-25T22:59:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "13349ae7-4074-4fe6-8cc5-f6e9a003ba23", 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 22, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6800", 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6801", 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6802", 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6803", 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6806", 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6807", 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-25T22:59:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6804", 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.165:6805", 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 66914404 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.165:6801/66914404", 2024-04-25T22:59:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.165:6803/66914404", 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.165:6807/66914404", 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.165:6805/66914404", 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "86c4b994-d0fe-4635-ae55-e8a4902029d3", 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 0, 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-25T22:59:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 17, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 22, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6800", 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6801", 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6802", 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6803", 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6806", 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6807", 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6804", 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.172:6805", 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3449711934 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.172:6801/3449711934", 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.172:6803/3449711934", 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.172:6807/3449711934", 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.172:6805/3449711934", 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: "exists" 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540701547738038271, 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-25T22:58:51.751434+0000", 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-25T22:59:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540701547738038271, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-25T22:58:51.708543+0000", 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540701547738038271, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-25T22:58:51.809063+0000", 2024-04-25T22:59:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 21 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [], 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-25T22:59:48.790 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:59:48.791 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-25T22:59:48.792 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T22:59:48.792 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T22:59:48.792 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '8d6ec37a-06d7-4d24-9516-19a660848874', 'created': '2024-04-25T22:58:45.412350+0000', 'modified': '2024-04-25T22:59:47.951946+0000', 'last_up_change': '2024-04-25T22:59:33.885587+0000', 'last_in_change': '2024-04-25T22:58:46.328330+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:58:56.581519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:59:00.664462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:59:04.692579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:59:05.120185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '3af34823-d803-4ca7-8300-4935c4b3ba2f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6800', 'nonce': 2867603478}, {'type': 'v1', 'addr': '172.21.15.99:6801', 'nonce': 2867603478}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6802', 'nonce': 2867603478}, {'type': 'v1', 'addr': '172.21.15.99:6803', 'nonce': 2867603478}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6806', 'nonce': 2867603478}, {'type': 'v1', 'addr': '172.21.15.99:6807', 'nonce': 2867603478}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6804', 'nonce': 2867603478}, {'type': 'v1', 'addr': '172.21.15.99:6805', 'nonce': 2867603478}]}, 'public_addr': '172.21.15.99:6801/2867603478', 'cluster_addr': '172.21.15.99:6803/2867603478', 'heartbeat_back_addr': '172.21.15.99:6807/2867603478', 'heartbeat_front_addr': '172.21.15.99:6805/2867603478', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '13349ae7-4074-4fe6-8cc5-f6e9a003ba23', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6800', 'nonce': 66914404}, {'type': 'v1', 'addr': '172.21.15.165:6801', 'nonce': 66914404}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6802', 'nonce': 66914404}, {'type': 'v1', 'addr': '172.21.15.165:6803', 'nonce': 66914404}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6806', 'nonce': 66914404}, {'type': 'v1', 'addr': '172.21.15.165:6807', 'nonce': 66914404}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6804', 'nonce': 66914404}, {'type': 'v1', 'addr': '172.21.15.165:6805', 'nonce': 66914404}]}, 'public_addr': '172.21.15.165:6801/66914404', 'cluster_addr': '172.21.15.165:6803/66914404', 'heartbeat_back_addr': '172.21.15.165:6807/66914404', 'heartbeat_front_addr': '172.21.15.165:6805/66914404', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '86c4b994-d0fe-4635-ae55-e8a4902029d3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6800', 'nonce': 3449711934}, {'type': 'v1', 'addr': '172.21.15.172:6801', 'nonce': 3449711934}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6802', 'nonce': 3449711934}, {'type': 'v1', 'addr': '172.21.15.172:6803', 'nonce': 3449711934}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6806', 'nonce': 3449711934}, {'type': 'v1', 'addr': '172.21.15.172:6807', 'nonce': 3449711934}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6804', 'nonce': 3449711934}, {'type': 'v1', 'addr': '172.21.15.172:6805', 'nonce': 3449711934}]}, 'public_addr': '172.21.15.172:6801/3449711934', 'cluster_addr': '172.21.15.172:6803/3449711934', 'heartbeat_back_addr': '172.21.15.172:6807/3449711934', 'heartbeat_front_addr': '172.21.15.172:6805/3449711934', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:58:51.751434+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:58:51.708543+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:58:51.809063+0000', 'dead_epoch': 21}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:59:48.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:59:48.794 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:48.794 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:48.787+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:48.895 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:48.895+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:48.960 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:48.960 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:48.974 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:49.023 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:49.019+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:49.090 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:49.090 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:49.096 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:49.091+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:49.104 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:49.114 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T22:59:49.116 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T22:59:49.131 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-04-25T22:59:48.520209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":143,"acting":143,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95368,"kb_used_data":1820,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020152,"statfs":{"total":289910292480,"available":289812635648,"internally_reserved":0,"allocated":1863680,"data_stored":1425626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.579881"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.956217+0000","last_change":"2024-04-25T22:59:34.918291+0000","last_active":"2024-04-25T22:59:44.956217+0000","last_peered":"2024-04-25T22:59:44.956217+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.918291+0000","last_became_peered":"2024-04-25T22:59:34.918291+0000","last_unstale":"2024-04-25T22:59:44.956217+0000","last_undegraded":"2024-04-25T22:59:44.956217+0000","last_fullsized":"2024-04-25T22:59:34.907195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:34.928005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954847+0000","last_change":"2024-04-25T22:59:34.914681+0000","last_active":"2024-04-25T22:59:44.954847+0000","last_peered":"2024-04-25T22:59:44.954847+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.914681+0000","last_became_peered":"2024-04-25T22:59:34.914681+0000","last_unstale":"2024-04-25T22:59:44.954847+0000","last_undegraded":"2024-04-25T22:59:44.954847+0000","last_fullsized":"2024-04-25T22:59:34.905413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:53.227706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954697+0000","last_change":"2024-04-25T22:59:34.909776+0000","last_active":"2024-04-25T22:59:44.954697+0000","last_peered":"2024-04-25T22:59:44.954697+0000","last_clean":"2024-04-25T22:59:33.271539+0000","last_became_active":"2024-04-25T22:59:34.909776+0000","last_became_peered":"2024-04-25T22:59:34.909776+0000","last_unstale":"2024-04-25T22:59:44.954697+0000","last_undegraded":"2024-04-25T22:59:44.954697+0000","last_fullsized":"2024-04-25T22:59:34.904789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:18.667079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954786+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T22:59:44.954786+0000","last_peered":"2024-04-25T22:59:44.954786+0000","last_clean":"2024-04-25T22:59:44.954786+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T22:59:44.954786+0000","last_undegraded":"2024-04-25T22:59:44.954786+0000","last_fullsized":"2024-04-25T22:59:44.954786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953080+0000","last_change":"2024-04-25T22:59:34.907948+0000","last_active":"2024-04-25T22:59:44.953080+0000","last_peered":"2024-04-25T22:59:44.953080+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.907948+0000","last_became_peered":"2024-04-25T22:59:34.907948+0000","last_unstale":"2024-04-25T22:59:44.953080+0000","last_undegraded":"2024-04-25T22:59:44.953080+0000","last_fullsized":"2024-04-25T22:59:34.902293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953900+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T22:59:44.953900+0000","last_peered":"2024-04-25T22:59:44.953900+0000","last_clean":"2024-04-25T22:59:44.953900+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T22:59:44.953900+0000","last_undegraded":"2024-04-25T22:59:44.953900+0000","last_fullsized":"2024-04-25T22:59:44.953900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953568+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T22:59:44.953568+0000","last_peered":"2024-04-25T22:59:44.953568+0000","last_clean":"2024-04-25T22:59:44.953568+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T22:59:44.953568+0000","last_undegraded":"2024-04-25T22:59:44.953568+0000","last_fullsized":"2024-04-25T22:59:44.953568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953498+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T22:59:44.953498+0000","last_peered":"2024-04-25T22:59:44.953498+0000","last_clean":"2024-04-25T22:59:44.953498+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T22:59:44.953498+0000","last_undegraded":"2024-04-25T22:59:44.953498+0000","last_fullsized":"2024-04-25T22:59:44.953498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955745+0000","last_change":"2024-04-25T22:59:34.914930+0000","last_active":"2024-04-25T22:59:44.955745+0000","last_peered":"2024-04-25T22:59:44.955745+0000","last_clean":"2024-04-25T22:59:32.892759+0000","last_became_active":"2024-04-25T22:59:34.914930+0000","last_became_peered":"2024-04-25T22:59:34.914930+0000","last_unstale":"2024-04-25T22:59:44.955745+0000","last_undegraded":"2024-04-25T22:59:44.955745+0000","last_fullsized":"2024-04-25T22:59:34.904661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:02.744801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954690+0000","last_change":"2024-04-25T22:59:34.915110+0000","last_active":"2024-04-25T22:59:44.954690+0000","last_peered":"2024-04-25T22:59:44.954690+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.915110+0000","last_became_peered":"2024-04-25T22:59:34.915110+0000","last_unstale":"2024-04-25T22:59:44.954690+0000","last_undegraded":"2024-04-25T22:59:44.954690+0000","last_fullsized":"2024-04-25T22:59:34.905267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:33.760444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954964+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T22:59:44.954964+0000","last_peered":"2024-04-25T22:59:44.954964+0000","last_clean":"2024-04-25T22:59:44.954964+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T22:59:44.954964+0000","last_undegraded":"2024-04-25T22:59:44.954964+0000","last_fullsized":"2024-04-25T22:59:44.954964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954309+0000","last_change":"2024-04-25T22:59:34.907919+0000","last_active":"2024-04-25T22:59:44.954309+0000","last_peered":"2024-04-25T22:59:44.954309+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.907919+0000","last_became_peered":"2024-04-25T22:59:34.907919+0000","last_unstale":"2024-04-25T22:59:44.954309+0000","last_undegraded":"2024-04-25T22:59:44.954309+0000","last_fullsized":"2024-04-25T22:59:34.904363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:02.744801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953170+0000","last_change":"2024-04-25T22:59:34.912406+0000","last_active":"2024-04-25T22:59:44.953170+0000","last_peered":"2024-04-25T22:59:44.953170+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.912406+0000","last_became_peered":"2024-04-25T22:59:34.912406+0000","last_unstale":"2024-04-25T22:59:44.953170+0000","last_undegraded":"2024-04-25T22:59:44.953170+0000","last_fullsized":"2024-04-25T22:59:34.904109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:40:19.955353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954042+0000","last_change":"2024-04-25T22:59:34.907557+0000","last_active":"2024-04-25T22:59:44.954042+0000","last_peered":"2024-04-25T22:59:44.954042+0000","last_clean":"2024-04-25T22:59:33.271289+0000","last_became_active":"2024-04-25T22:59:34.907557+0000","last_became_peered":"2024-04-25T22:59:34.907557+0000","last_unstale":"2024-04-25T22:59:44.954042+0000","last_undegraded":"2024-04-25T22:59:44.954042+0000","last_fullsized":"2024-04-25T22:59:34.903779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:10.061452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953713+0000","last_change":"2024-04-25T22:59:34.906136+0000","last_active":"2024-04-25T22:59:44.953713+0000","last_peered":"2024-04-25T22:59:44.953713+0000","last_clean":"2024-04-25T22:59:33.270643+0000","last_became_active":"2024-04-25T22:59:34.906136+0000","last_became_peered":"2024-04-25T22:59:34.906136+0000","last_unstale":"2024-04-25T22:59:44.953713+0000","last_undegraded":"2024-04-25T22:59:44.953713+0000","last_fullsized":"2024-04-25T22:59:34.902955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:51:43.145232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953618+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T22:59:44.953618+0000","last_peered":"2024-04-25T22:59:44.953618+0000","last_clean":"2024-04-25T22:59:44.953618+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T22:59:44.953618+0000","last_undegraded":"2024-04-25T22:59:44.953618+0000","last_fullsized":"2024-04-25T22:59:44.953618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.956429+0000","last_change":"2024-04-25T22:59:34.919292+0000","last_active":"2024-04-25T22:59:44.956429+0000","last_peered":"2024-04-25T22:59:44.956429+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T22:59:34.919292+0000","last_became_peered":"2024-04-25T22:59:34.919292+0000","last_unstale":"2024-04-25T22:59:44.956429+0000","last_undegraded":"2024-04-25T22:59:44.956429+0000","last_fullsized":"2024-04-25T22:59:34.908436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:36.729929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955302+0000","last_change":"2024-04-25T22:59:34.915796+0000","last_active":"2024-04-25T22:59:44.955302+0000","last_peered":"2024-04-25T22:59:44.955302+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.915796+0000","last_became_peered":"2024-04-25T22:59:34.915796+0000","last_unstale":"2024-04-25T22:59:44.955302+0000","last_undegraded":"2024-04-25T22:59:44.955302+0000","last_fullsized":"2024-04-25T22:59:34.906874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:15.198131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954770+0000","last_change":"2024-04-25T22:59:34.912421+0000","last_active":"2024-04-25T22:59:44.954770+0000","last_peered":"2024-04-25T22:59:44.954770+0000","last_clean":"2024-04-25T22:59:32.892274+0000","last_became_active":"2024-04-25T22:59:34.912421+0000","last_became_peered":"2024-04-25T22:59:34.912421+0000","last_unstale":"2024-04-25T22:59:44.954770+0000","last_undegraded":"2024-04-25T22:59:44.954770+0000","last_fullsized":"2024-04-25T22:59:34.905064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:52.570077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954906+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T22:59:44.954906+0000","last_peered":"2024-04-25T22:59:44.954906+0000","last_clean":"2024-04-25T22:59:44.954906+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T22:59:44.954906+0000","last_undegraded":"2024-04-25T22:59:44.954906+0000","last_fullsized":"2024-04-25T22:59:44.954906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954949+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T22:59:44.954949+0000","last_peered":"2024-04-25T22:59:44.954949+0000","last_clean":"2024-04-25T22:59:44.954949+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T22:59:44.954949+0000","last_undegraded":"2024-04-25T22:59:44.954949+0000","last_fullsized":"2024-04-25T22:59:44.954949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953568+0000","last_change":"2024-04-25T22:59:34.907442+0000","last_active":"2024-04-25T22:59:44.953568+0000","last_peered":"2024-04-25T22:59:44.953568+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.907442+0000","last_became_peered":"2024-04-25T22:59:34.907442+0000","last_unstale":"2024-04-25T22:59:44.953568+0000","last_undegraded":"2024-04-25T22:59:44.953568+0000","last_fullsized":"2024-04-25T22:59:34.903406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:53.227706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.952524+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T22:59:44.952524+0000","last_peered":"2024-04-25T22:59:44.952524+0000","last_clean":"2024-04-25T22:59:44.952524+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T22:59:44.952524+0000","last_undegraded":"2024-04-25T22:59:44.952524+0000","last_fullsized":"2024-04-25T22:59:44.952524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.952557+0000","last_change":"2024-04-25T22:59:34.907937+0000","last_active":"2024-04-25T22:59:44.952557+0000","last_peered":"2024-04-25T22:59:44.952557+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.907937+0000","last_became_peered":"2024-04-25T22:59:34.907937+0000","last_unstale":"2024-04-25T22:59:44.952557+0000","last_undegraded":"2024-04-25T22:59:44.952557+0000","last_fullsized":"2024-04-25T22:59:34.901964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:19.295855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955048+0000","last_change":"2024-04-25T22:59:34.909695+0000","last_active":"2024-04-25T22:59:44.955048+0000","last_peered":"2024-04-25T22:59:44.955048+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.909695+0000","last_became_peered":"2024-04-25T22:59:34.909695+0000","last_unstale":"2024-04-25T22:59:44.955048+0000","last_undegraded":"2024-04-25T22:59:44.955048+0000","last_fullsized":"2024-04-25T22:59:34.905166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:31.821890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955166+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T22:59:44.955166+0000","last_peered":"2024-04-25T22:59:44.955166+0000","last_clean":"2024-04-25T22:59:44.955166+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T22:59:44.955166+0000","last_undegraded":"2024-04-25T22:59:44.955166+0000","last_fullsized":"2024-04-25T22:59:44.955166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955137+0000","last_change":"2024-04-25T22:59:34.909873+0000","last_active":"2024-04-25T22:59:44.955137+0000","last_peered":"2024-04-25T22:59:44.955137+0000","last_clean":"2024-04-25T22:59:33.272585+0000","last_became_active":"2024-04-25T22:59:34.909873+0000","last_became_peered":"2024-04-25T22:59:34.909873+0000","last_unstale":"2024-04-25T22:59:44.955137+0000","last_undegraded":"2024-04-25T22:59:44.955137+0000","last_fullsized":"2024-04-25T22:59:34.905069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:44:36.729929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954048+0000","last_change":"2024-04-25T22:59:34.906245+0000","last_active":"2024-04-25T22:59:44.954048+0000","last_peered":"2024-04-25T22:59:44.954048+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.906245+0000","last_became_peered":"2024-04-25T22:59:34.906245+0000","last_unstale":"2024-04-25T22:59:44.954048+0000","last_undegraded":"2024-04-25T22:59:44.954048+0000","last_fullsized":"2024-04-25T22:59:34.903675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:00.387333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953442+0000","last_change":"2024-04-25T22:59:34.912988+0000","last_active":"2024-04-25T22:59:44.953442+0000","last_peered":"2024-04-25T22:59:44.953442+0000","last_clean":"2024-04-25T22:59:32.891845+0000","last_became_active":"2024-04-25T22:59:34.912988+0000","last_became_peered":"2024-04-25T22:59:34.912988+0000","last_unstale":"2024-04-25T22:59:44.953442+0000","last_undegraded":"2024-04-25T22:59:44.953442+0000","last_fullsized":"2024-04-25T22:59:34.903346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:46.659870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953473+0000","last_change":"2024-04-25T22:59:34.907065+0000","last_active":"2024-04-25T22:59:44.953473+0000","last_peered":"2024-04-25T22:59:44.953473+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.907065+0000","last_became_peered":"2024-04-25T22:59:34.907065+0000","last_unstale":"2024-04-25T22:59:44.953473+0000","last_undegraded":"2024-04-25T22:59:44.953473+0000","last_fullsized":"2024-04-25T22:59:34.902724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:46.659870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.952605+0000","last_change":"2024-04-25T22:59:34.907995+0000","last_active":"2024-04-25T22:59:44.952605+0000","last_peered":"2024-04-25T22:59:44.952605+0000","last_clean":"2024-04-25T22:59:32.890722+0000","last_became_active":"2024-04-25T22:59:34.907995+0000","last_became_peered":"2024-04-25T22:59:34.907995+0000","last_unstale":"2024-04-25T22:59:44.952605+0000","last_undegraded":"2024-04-25T22:59:44.952605+0000","last_fullsized":"2024-04-25T22:59:34.902018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:28:11.208189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953752+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T22:59:44.953752+0000","last_peered":"2024-04-25T22:59:44.953752+0000","last_clean":"2024-04-25T22:59:44.953752+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T22:59:44.953752+0000","last_undegraded":"2024-04-25T22:59:44.953752+0000","last_fullsized":"2024-04-25T22:59:44.953752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953944+0000","last_change":"2024-04-25T22:59:34.908105+0000","last_active":"2024-04-25T22:59:44.953944+0000","last_peered":"2024-04-25T22:59:44.953944+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.908105+0000","last_became_peered":"2024-04-25T22:59:34.908105+0000","last_unstale":"2024-04-25T22:59:44.953944+0000","last_undegraded":"2024-04-25T22:59:44.953944+0000","last_fullsized":"2024-04-25T22:59:34.903065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:30.779853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955294+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T22:59:44.955294+0000","last_peered":"2024-04-25T22:59:44.955294+0000","last_clean":"2024-04-25T22:59:44.955294+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T22:59:44.955294+0000","last_undegraded":"2024-04-25T22:59:44.955294+0000","last_fullsized":"2024-04-25T22:59:44.955294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954193+0000","last_change":"2024-04-25T22:59:34.912829+0000","last_active":"2024-04-25T22:59:44.954193+0000","last_peered":"2024-04-25T22:59:44.954193+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.912829+0000","last_became_peered":"2024-04-25T22:59:34.912829+0000","last_unstale":"2024-04-25T22:59:44.954193+0000","last_undegraded":"2024-04-25T22:59:44.954193+0000","last_fullsized":"2024-04-25T22:59:34.904343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:23.624054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953168+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T22:59:44.953168+0000","last_peered":"2024-04-25T22:59:44.953168+0000","last_clean":"2024-04-25T22:59:44.953168+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T22:59:44.953168+0000","last_undegraded":"2024-04-25T22:59:44.953168+0000","last_fullsized":"2024-04-25T22:59:44.953168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955448+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T22:59:44.955448+0000","last_peered":"2024-04-25T22:59:44.955448+0000","last_clean":"2024-04-25T22:59:44.955448+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T22:59:44.955448+0000","last_undegraded":"2024-04-25T22:59:44.955448+0000","last_fullsized":"2024-04-25T22:59:44.955448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954042+0000","last_change":"2024-04-25T22:59:34.907365+0000","last_active":"2024-04-25T22:59:44.954042+0000","last_peered":"2024-04-25T22:59:44.954042+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"2024-04-25T22:59:34.907365+0000","last_became_peered":"2024-04-25T22:59:34.907365+0000","last_unstale":"2024-04-25T22:59:44.954042+0000","last_undegraded":"2024-04-25T22:59:44.954042+0000","last_fullsized":"2024-04-25T22:59:34.903410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:59.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955755+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T22:59:44.955755+0000","last_peered":"2024-04-25T22:59:44.955755+0000","last_clean":"2024-04-25T22:59:44.955755+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T22:59:44.955755+0000","last_undegraded":"2024-04-25T22:59:44.955755+0000","last_fullsized":"2024-04-25T22:59:44.955755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":40,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.953793+0000","last_change":"2024-04-25T22:59:34.906257+0000","last_active":"2024-04-25T22:59:44.953793+0000","last_peered":"2024-04-25T22:59:44.953793+0000","last_clean":"2024-04-25T22:59:33.270594+0000","last_became_active":"2024-04-25T22:59:34.906257+0000","last_became_peered":"2024-04-25T22:59:34.906257+0000","last_unstale":"2024-04-25T22:59:44.953793+0000","last_undegraded":"2024-04-25T22:59:34.903485+0000","last_fullsized":"2024-04-25T22:59:34.903379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:08.141629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":33,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.955806+0000","last_change":"2024-04-25T22:59:34.910250+0000","last_active":"2024-04-25T22:59:44.955806+0000","last_peered":"2024-04-25T22:59:44.955806+0000","last_clean":"2024-04-25T22:59:33.272357+0000","last_became_active":"2024-04-25T22:59:34.910250+0000","last_became_peered":"2024-04-25T22:59:34.910250+0000","last_unstale":"2024-04-25T22:59:44.955806+0000","last_undegraded":"2024-04-25T22:59:34.907036+0000","last_fullsized":"2024-04-25T22:59:34.905510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:41.710353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953362+0000","last_change":"2024-04-25T22:59:34.905648+0000","last_active":"2024-04-25T22:59:44.953362+0000","last_peered":"2024-04-25T22:59:44.953362+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.905648+0000","last_became_peered":"2024-04-25T22:59:34.905648+0000","last_unstale":"2024-04-25T22:59:44.953362+0000","last_undegraded":"2024-04-25T22:59:44.953362+0000","last_fullsized":"2024-04-25T22:59:34.902585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:16.655937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":27,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.954282+0000","last_change":"2024-04-25T22:59:34.908592+0000","last_active":"2024-04-25T22:59:44.954282+0000","last_peered":"2024-04-25T22:59:44.954282+0000","last_clean":"2024-04-25T22:59:06.773637+0000","last_became_active":"2024-04-25T22:59:34.908592+0000","last_became_peered":"2024-04-25T22:59:34.908592+0000","last_unstale":"2024-04-25T22:59:44.954282+0000","last_undegraded":"2024-04-25T22:59:34.904971+0000","last_fullsized":"2024-04-25T22:59:34.904887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:46.527720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.952875+0000","last_change":"2024-04-25T22:59:34.909525+0000","last_active":"2024-04-25T22:59:44.952875+0000","last_peered":"2024-04-25T22:59:44.952875+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.909525+0000","last_became_peered":"2024-04-25T22:59:34.909525+0000","last_unstale":"2024-04-25T22:59:44.952875+0000","last_undegraded":"2024-04-25T22:59:44.952875+0000","last_fullsized":"2024-04-25T22:59:34.902863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:20.417769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.956066+0000","last_change":"2024-04-25T22:59:34.910895+0000","last_active":"2024-04-25T22:59:44.956066+0000","last_peered":"2024-04-25T22:59:44.956066+0000","last_clean":"2024-04-25T22:59:33.272914+0000","last_became_active":"2024-04-25T22:59:34.910895+0000","last_became_peered":"2024-04-25T22:59:34.910895+0000","last_unstale":"2024-04-25T22:59:44.956066+0000","last_undegraded":"2024-04-25T22:59:34.906126+0000","last_fullsized":"2024-04-25T22:59:34.906038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:00.183771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954146+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T22:59:44.954146+0000","last_peered":"2024-04-25T22:59:44.954146+0000","last_clean":"2024-04-25T22:59:44.954146+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T22:59:44.954146+0000","last_undegraded":"2024-04-25T22:59:44.954146+0000","last_fullsized":"2024-04-25T22:59:44.954146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955383+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T22:59:44.955383+0000","last_peered":"2024-04-25T22:59:44.955383+0000","last_clean":"2024-04-25T22:59:44.955383+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T22:59:44.955383+0000","last_undegraded":"2024-04-25T22:59:44.955383+0000","last_fullsized":"2024-04-25T22:59:44.955383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953864+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T22:59:44.953864+0000","last_peered":"2024-04-25T22:59:44.953864+0000","last_clean":"2024-04-25T22:59:44.953864+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T22:59:44.953864+0000","last_undegraded":"2024-04-25T22:59:44.953864+0000","last_fullsized":"2024-04-25T22:59:44.953864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954146+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T22:59:44.954146+0000","last_peered":"2024-04-25T22:59:44.954146+0000","last_clean":"2024-04-25T22:59:44.954146+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T22:59:44.954146+0000","last_undegraded":"2024-04-25T22:59:44.954146+0000","last_fullsized":"2024-04-25T22:59:44.954146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955174+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:44.955174+0000","last_peered":"2024-04-25T22:59:44.955174+0000","last_clean":"2024-04-25T22:59:44.955174+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T22:59:44.955174+0000","last_undegraded":"2024-04-25T22:59:44.955174+0000","last_fullsized":"2024-04-25T22:59:44.955174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954547+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T22:59:44.954547+0000","last_peered":"2024-04-25T22:59:44.954547+0000","last_clean":"2024-04-25T22:59:44.954547+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T22:59:44.954547+0000","last_undegraded":"2024-04-25T22:59:44.954547+0000","last_fullsized":"2024-04-25T22:59:44.954547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955583+0000","last_change":"2024-04-25T22:59:34.910450+0000","last_active":"2024-04-25T22:59:44.955583+0000","last_peered":"2024-04-25T22:59:44.955583+0000","last_clean":"2024-04-25T22:59:33.272608+0000","last_became_active":"2024-04-25T22:59:34.910450+0000","last_became_peered":"2024-04-25T22:59:34.910450+0000","last_unstale":"2024-04-25T22:59:44.955583+0000","last_undegraded":"2024-04-25T22:59:44.955583+0000","last_fullsized":"2024-04-25T22:59:34.905740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:17.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953388+0000","last_change":"2024-04-25T22:59:34.905813+0000","last_active":"2024-04-25T22:59:44.953388+0000","last_peered":"2024-04-25T22:59:44.953388+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"2024-04-25T22:59:34.905813+0000","last_became_peered":"2024-04-25T22:59:34.905813+0000","last_unstale":"2024-04-25T22:59:44.953388+0000","last_undegraded":"2024-04-25T22:59:44.953388+0000","last_fullsized":"2024-04-25T22:59:34.902626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:58.894995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954421+0000","last_change":"2024-04-25T22:59:34.908603+0000","last_active":"2024-04-25T22:59:44.954421+0000","last_peered":"2024-04-25T22:59:44.954421+0000","last_clean":"2024-04-25T22:59:33.272500+0000","last_became_active":"2024-04-25T22:59:34.908603+0000","last_became_peered":"2024-04-25T22:59:34.908603+0000","last_unstale":"2024-04-25T22:59:44.954421+0000","last_undegraded":"2024-04-25T22:59:44.954421+0000","last_fullsized":"2024-04-25T22:59:34.905047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:58.257732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.952525+0000","last_change":"2024-04-25T22:59:34.909678+0000","last_active":"2024-04-25T22:59:44.952525+0000","last_peered":"2024-04-25T22:59:44.952525+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"2024-04-25T22:59:34.909678+0000","last_became_peered":"2024-04-25T22:59:34.909678+0000","last_unstale":"2024-04-25T22:59:44.952525+0000","last_undegraded":"2024-04-25T22:59:44.952525+0000","last_fullsized":"2024-04-25T22:59:34.902005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:15.647247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955922+0000","last_change":"2024-04-25T22:59:34.915860+0000","last_active":"2024-04-25T22:59:44.955922+0000","last_peered":"2024-04-25T22:59:44.955922+0000","last_clean":"2024-04-25T22:59:32.892903+0000","last_became_active":"2024-04-25T22:59:34.915860+0000","last_became_peered":"2024-04-25T22:59:34.915860+0000","last_unstale":"2024-04-25T22:59:44.955922+0000","last_undegraded":"2024-04-25T22:59:44.955922+0000","last_fullsized":"2024-04-25T22:59:34.905838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:47.536411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":240,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.955060+0000","last_change":"2024-04-25T22:59:34.907906+0000","last_active":"2024-04-25T22:59:44.955060+0000","last_peered":"2024-04-25T22:59:44.955060+0000","last_clean":"2024-04-25T22:59:33.271164+0000","last_became_active":"2024-04-25T22:59:34.907906+0000","last_became_peered":"2024-04-25T22:59:34.907906+0000","last_unstale":"2024-04-25T22:59:44.955060+0000","last_undegraded":"2024-04-25T22:59:34.903857+0000","last_fullsized":"2024-04-25T22:59:34.903753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:02.581219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955639+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T22:59:44.955639+0000","last_peered":"2024-04-25T22:59:44.955639+0000","last_clean":"2024-04-25T22:59:44.955639+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T22:59:44.955639+0000","last_undegraded":"2024-04-25T22:59:44.955639+0000","last_fullsized":"2024-04-25T22:59:44.955639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953370+0000","last_change":"2024-04-25T22:59:34.911190+0000","last_active":"2024-04-25T22:59:44.953370+0000","last_peered":"2024-04-25T22:59:44.953370+0000","last_clean":"2024-04-25T22:59:32.892054+0000","last_became_active":"2024-04-25T22:59:34.911190+0000","last_became_peered":"2024-04-25T22:59:34.911190+0000","last_unstale":"2024-04-25T22:59:44.953370+0000","last_undegraded":"2024-04-25T22:59:44.953370+0000","last_fullsized":"2024-04-25T22:59:34.903469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:58.894995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955967+0000","last_change":"2024-04-25T22:59:34.910800+0000","last_active":"2024-04-25T22:59:44.955967+0000","last_peered":"2024-04-25T22:59:44.955967+0000","last_clean":"2024-04-25T22:59:33.272809+0000","last_became_active":"2024-04-25T22:59:34.910800+0000","last_became_peered":"2024-04-25T22:59:34.910800+0000","last_unstale":"2024-04-25T22:59:44.955967+0000","last_undegraded":"2024-04-25T22:59:44.955967+0000","last_fullsized":"2024-04-25T22:59:34.905937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:41:05.385532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953986+0000","last_change":"2024-04-25T22:59:34.907065+0000","last_active":"2024-04-25T22:59:44.953986+0000","last_peered":"2024-04-25T22:59:44.953986+0000","last_clean":"2024-04-25T22:59:33.270980+0000","last_became_active":"2024-04-25T22:59:34.907065+0000","last_became_peered":"2024-04-25T22:59:34.907065+0000","last_unstale":"2024-04-25T22:59:44.953986+0000","last_undegraded":"2024-04-25T22:59:44.953986+0000","last_fullsized":"2024-04-25T22:59:34.903452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:18.590009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953287+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T22:59:44.953287+0000","last_peered":"2024-04-25T22:59:44.953287+0000","last_clean":"2024-04-25T22:59:44.953287+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T22:59:44.953287+0000","last_undegraded":"2024-04-25T22:59:44.953287+0000","last_fullsized":"2024-04-25T22:59:44.953287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953983+0000","last_change":"2024-04-25T22:59:34.912524+0000","last_active":"2024-04-25T22:59:44.953983+0000","last_peered":"2024-04-25T22:59:44.953983+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.912524+0000","last_became_peered":"2024-04-25T22:59:34.912524+0000","last_unstale":"2024-04-25T22:59:44.953983+0000","last_undegraded":"2024-04-25T22:59:44.953983+0000","last_fullsized":"2024-04-25T22:59:34.904660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:51:43.145232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953540+0000","last_change":"2024-04-25T22:59:34.912555+0000","last_active":"2024-04-25T22:59:44.953540+0000","last_peered":"2024-04-25T22:59:44.953540+0000","last_clean":"2024-04-25T22:59:32.891860+0000","last_became_active":"2024-04-25T22:59:34.912555+0000","last_became_peered":"2024-04-25T22:59:34.912555+0000","last_unstale":"2024-04-25T22:59:44.953540+0000","last_undegraded":"2024-04-25T22:59:44.953540+0000","last_fullsized":"2024-04-25T22:59:34.903906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:55.353288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953265+0000","last_change":"2024-04-25T22:59:34.904352+0000","last_active":"2024-04-25T22:59:44.953265+0000","last_peered":"2024-04-25T22:59:44.953265+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"2024-04-25T22:59:34.904352+0000","last_became_peered":"2024-04-25T22:59:34.904352+0000","last_unstale":"2024-04-25T22:59:44.953265+0000","last_undegraded":"2024-04-25T22:59:44.953265+0000","last_fullsized":"2024-04-25T22:59:34.902521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:21.938890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.956005+0000","last_change":"2024-04-25T22:59:34.915987+0000","last_active":"2024-04-25T22:59:44.956005+0000","last_peered":"2024-04-25T22:59:44.956005+0000","last_clean":"2024-04-25T22:59:32.893156+0000","last_became_active":"2024-04-25T22:59:34.915987+0000","last_became_peered":"2024-04-25T22:59:34.915987+0000","last_unstale":"2024-04-25T22:59:44.956005+0000","last_undegraded":"2024-04-25T22:59:44.956005+0000","last_fullsized":"2024-04-25T22:59:34.906763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:58.257732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954706+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T22:59:44.954706+0000","last_peered":"2024-04-25T22:59:44.954706+0000","last_clean":"2024-04-25T22:59:44.954706+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T22:59:44.954706+0000","last_undegraded":"2024-04-25T22:59:44.954706+0000","last_fullsized":"2024-04-25T22:59:44.954706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955468+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T22:59:44.955468+0000","last_peered":"2024-04-25T22:59:44.955468+0000","last_clean":"2024-04-25T22:59:44.955468+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T22:59:44.955468+0000","last_undegraded":"2024-04-25T22:59:44.955468+0000","last_fullsized":"2024-04-25T22:59:44.955468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954406+0000","last_change":"2024-04-25T22:59:34.913056+0000","last_active":"2024-04-25T22:59:44.954406+0000","last_peered":"2024-04-25T22:59:44.954406+0000","last_clean":"2024-04-25T22:59:32.892230+0000","last_became_active":"2024-04-25T22:59:34.913056+0000","last_became_peered":"2024-04-25T22:59:34.913056+0000","last_unstale":"2024-04-25T22:59:44.954406+0000","last_undegraded":"2024-04-25T22:59:44.954406+0000","last_fullsized":"2024-04-25T22:59:34.905206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:10.061452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.956191+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T22:59:44.956191+0000","last_peered":"2024-04-25T22:59:44.956191+0000","last_clean":"2024-04-25T22:59:44.956191+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T22:59:44.956191+0000","last_undegraded":"2024-04-25T22:59:44.956191+0000","last_fullsized":"2024-04-25T22:59:44.956191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954982+0000","last_change":"2024-04-25T22:59:34.916216+0000","last_active":"2024-04-25T22:59:44.954982+0000","last_peered":"2024-04-25T22:59:44.954982+0000","last_clean":"2024-04-25T22:59:32.892494+0000","last_became_active":"2024-04-25T22:59:34.916216+0000","last_became_peered":"2024-04-25T22:59:34.916216+0000","last_unstale":"2024-04-25T22:59:44.954982+0000","last_undegraded":"2024-04-25T22:59:44.954982+0000","last_fullsized":"2024-04-25T22:59:34.905890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:26.787844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953867+0000","last_change":"2024-04-25T22:59:34.908559+0000","last_active":"2024-04-25T22:59:44.953867+0000","last_peered":"2024-04-25T22:59:44.953867+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.908559+0000","last_became_peered":"2024-04-25T22:59:34.908559+0000","last_unstale":"2024-04-25T22:59:44.953867+0000","last_undegraded":"2024-04-25T22:59:44.953867+0000","last_fullsized":"2024-04-25T22:59:34.903087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:15.198131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954894+0000","last_change":"2024-04-25T22:59:34.915471+0000","last_active":"2024-04-25T22:59:44.954894+0000","last_peered":"2024-04-25T22:59:44.954894+0000","last_clean":"2024-04-25T22:59:32.892243+0000","last_became_active":"2024-04-25T22:59:34.915471+0000","last_became_peered":"2024-04-25T22:59:34.915471+0000","last_unstale":"2024-04-25T22:59:44.954894+0000","last_undegraded":"2024-04-25T22:59:44.954894+0000","last_fullsized":"2024-04-25T22:59:34.905445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:29:41.190377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954998+0000","last_change":"2024-04-25T22:59:34.913155+0000","last_active":"2024-04-25T22:59:44.954998+0000","last_peered":"2024-04-25T22:59:44.954998+0000","last_clean":"2024-04-25T22:59:00.710585+0000","last_became_active":"2024-04-25T22:59:34.913155+0000","last_became_peered":"2024-04-25T22:59:34.913155+0000","last_unstale":"2024-04-25T22:59:44.954998+0000","last_undegraded":"2024-04-25T22:59:44.954998+0000","last_fullsized":"2024-04-25T22:59:34.905109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:55.825730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953675+0000","last_change":"2024-04-25T22:59:34.905758+0000","last_active":"2024-04-25T22:59:44.953675+0000","last_peered":"2024-04-25T22:59:44.953675+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.905758+0000","last_became_peered":"2024-04-25T22:59:34.905758+0000","last_unstale":"2024-04-25T22:59:44.953675+0000","last_undegraded":"2024-04-25T22:59:44.953675+0000","last_fullsized":"2024-04-25T22:59:34.902851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:56.902634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":34,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.956440+0000","last_change":"2024-04-25T22:59:34.918879+0000","last_active":"2024-04-25T22:59:44.956440+0000","last_peered":"2024-04-25T22:59:44.956440+0000","last_clean":"2024-04-25T22:59:32.893457+0000","last_became_active":"2024-04-25T22:59:34.918879+0000","last_became_peered":"2024-04-25T22:59:34.918879+0000","last_unstale":"2024-04-25T22:59:44.956440+0000","last_undegraded":"2024-04-25T22:59:34.908104+0000","last_fullsized":"2024-04-25T22:59:34.907883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:41.710353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955673+0000","last_change":"2024-04-25T22:59:34.918812+0000","last_active":"2024-04-25T22:59:44.955673+0000","last_peered":"2024-04-25T22:59:44.955673+0000","last_clean":"2024-04-25T22:59:32.893219+0000","last_became_active":"2024-04-25T22:59:34.918812+0000","last_became_peered":"2024-04-25T22:59:34.918812+0000","last_unstale":"2024-04-25T22:59:44.955673+0000","last_undegraded":"2024-04-25T22:59:44.955673+0000","last_fullsized":"2024-04-25T22:59:34.908064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:58.959875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953078+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T22:59:44.953078+0000","last_peered":"2024-04-25T22:59:44.953078+0000","last_clean":"2024-04-25T22:59:44.953078+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T22:59:44.953078+0000","last_undegraded":"2024-04-25T22:59:44.953078+0000","last_fullsized":"2024-04-25T22:59:44.953078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955516+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T22:59:44.955516+0000","last_peered":"2024-04-25T22:59:44.955516+0000","last_clean":"2024-04-25T22:59:44.955516+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T22:59:44.955516+0000","last_undegraded":"2024-04-25T22:59:44.955516+0000","last_fullsized":"2024-04-25T22:59:44.955516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955824+0000","last_change":"2024-04-25T22:59:34.909779+0000","last_active":"2024-04-25T22:59:44.955824+0000","last_peered":"2024-04-25T22:59:44.955824+0000","last_clean":"2024-04-25T22:59:33.272389+0000","last_became_active":"2024-04-25T22:59:34.909779+0000","last_became_peered":"2024-04-25T22:59:34.909779+0000","last_unstale":"2024-04-25T22:59:44.955824+0000","last_undegraded":"2024-04-25T22:59:44.955824+0000","last_fullsized":"2024-04-25T22:59:34.905765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:29.893960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953770+0000","last_change":"2024-04-25T22:59:34.907007+0000","last_active":"2024-04-25T22:59:44.953770+0000","last_peered":"2024-04-25T22:59:44.953770+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.907007+0000","last_became_peered":"2024-04-25T22:59:34.907007+0000","last_unstale":"2024-04-25T22:59:44.953770+0000","last_undegraded":"2024-04-25T22:59:44.953770+0000","last_fullsized":"2024-04-25T22:59:34.903101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:40:19.955353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954473+0000","last_change":"2024-04-25T22:59:34.907917+0000","last_active":"2024-04-25T22:59:44.954473+0000","last_peered":"2024-04-25T22:59:44.954473+0000","last_clean":"2024-04-25T22:59:33.271121+0000","last_became_active":"2024-04-25T22:59:34.907917+0000","last_became_peered":"2024-04-25T22:59:34.907917+0000","last_unstale":"2024-04-25T22:59:44.954473+0000","last_undegraded":"2024-04-25T22:59:44.954473+0000","last_fullsized":"2024-04-25T22:59:34.903809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:37.584582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":42,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.955353+0000","last_change":"2024-04-25T22:59:34.908751+0000","last_active":"2024-04-25T22:59:44.955353+0000","last_peered":"2024-04-25T22:59:44.955353+0000","last_clean":"2024-04-25T22:59:33.272578+0000","last_became_active":"2024-04-25T22:59:34.908751+0000","last_became_peered":"2024-04-25T22:59:34.908751+0000","last_unstale":"2024-04-25T22:59:44.955353+0000","last_undegraded":"2024-04-25T22:59:34.904817+0000","last_fullsized":"2024-04-25T22:59:34.904736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:29:41.190377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.952834+0000","last_change":"2024-04-25T22:59:34.909994+0000","last_active":"2024-04-25T22:59:44.952834+0000","last_peered":"2024-04-25T22:59:44.952834+0000","last_clean":"2024-04-25T22:59:32.891138+0000","last_became_active":"2024-04-25T22:59:34.909994+0000","last_became_peered":"2024-04-25T22:59:34.909994+0000","last_unstale":"2024-04-25T22:59:44.952834+0000","last_undegraded":"2024-04-25T22:59:44.952834+0000","last_fullsized":"2024-04-25T22:59:34.902330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:18:05.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":27,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.955536+0000","last_change":"2024-04-25T22:59:34.910223+0000","last_active":"2024-04-25T22:59:44.955536+0000","last_peered":"2024-04-25T22:59:44.955536+0000","last_clean":"2024-04-25T22:59:06.770635+0000","last_became_active":"2024-04-25T22:59:34.910223+0000","last_became_peered":"2024-04-25T22:59:34.910223+0000","last_unstale":"2024-04-25T22:59:44.955536+0000","last_undegraded":"2024-04-25T22:59:34.905659+0000","last_fullsized":"2024-04-25T22:59:34.905453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:40:49.272444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954775+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T22:59:44.954775+0000","last_peered":"2024-04-25T22:59:44.954775+0000","last_clean":"2024-04-25T22:59:44.954775+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T22:59:44.954775+0000","last_undegraded":"2024-04-25T22:59:44.954775+0000","last_fullsized":"2024-04-25T22:59:44.954775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.952735+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T22:59:44.952735+0000","last_peered":"2024-04-25T22:59:44.952735+0000","last_clean":"2024-04-25T22:59:44.952735+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T22:59:44.952735+0000","last_undegraded":"2024-04-25T22:59:44.952735+0000","last_fullsized":"2024-04-25T22:59:44.952735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.956293+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T22:59:44.956293+0000","last_peered":"2024-04-25T22:59:44.956293+0000","last_clean":"2024-04-25T22:59:44.956293+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T22:59:44.956293+0000","last_undegraded":"2024-04-25T22:59:44.956293+0000","last_fullsized":"2024-04-25T22:59:44.956293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.952720+0000","last_change":"2024-04-25T22:59:34.909668+0000","last_active":"2024-04-25T22:59:44.952720+0000","last_peered":"2024-04-25T22:59:44.952720+0000","last_clean":"2024-04-25T22:59:32.891227+0000","last_became_active":"2024-04-25T22:59:34.909668+0000","last_became_peered":"2024-04-25T22:59:34.909668+0000","last_unstale":"2024-04-25T22:59:44.952720+0000","last_undegraded":"2024-04-25T22:59:44.952720+0000","last_fullsized":"2024-04-25T22:59:34.902884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:22.947580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954992+0000","last_change":"2024-04-25T22:59:34.908535+0000","last_active":"2024-04-25T22:59:44.954992+0000","last_peered":"2024-04-25T22:59:44.954992+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.908535+0000","last_became_peered":"2024-04-25T22:59:34.908535+0000","last_unstale":"2024-04-25T22:59:44.954992+0000","last_undegraded":"2024-04-25T22:59:44.954992+0000","last_fullsized":"2024-04-25T22:59:34.904921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:33.760444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953591+0000","last_change":"2024-04-25T22:59:34.910434+0000","last_active":"2024-04-25T22:59:44.953591+0000","last_peered":"2024-04-25T22:59:44.953591+0000","last_clean":"2024-04-25T22:59:32.891461+0000","last_became_active":"2024-04-25T22:59:34.910434+0000","last_became_peered":"2024-04-25T22:59:34.910434+0000","last_unstale":"2024-04-25T22:59:44.953591+0000","last_undegraded":"2024-04-25T22:59:44.953591+0000","last_fullsized":"2024-04-25T22:59:34.903137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:55.893943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955092+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T22:59:44.955092+0000","last_peered":"2024-04-25T22:59:44.955092+0000","last_clean":"2024-04-25T22:59:44.955092+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T22:59:44.955092+0000","last_undegraded":"2024-04-25T22:59:44.955092+0000","last_fullsized":"2024-04-25T22:59:44.955092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953040+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T22:59:44.953040+0000","last_peered":"2024-04-25T22:59:44.953040+0000","last_clean":"2024-04-25T22:59:44.953040+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T22:59:44.953040+0000","last_undegraded":"2024-04-25T22:59:44.953040+0000","last_fullsized":"2024-04-25T22:59:44.953040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954189+0000","last_change":"2024-04-25T22:59:34.909141+0000","last_active":"2024-04-25T22:59:44.954189+0000","last_peered":"2024-04-25T22:59:44.954189+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.909141+0000","last_became_peered":"2024-04-25T22:59:34.909141+0000","last_unstale":"2024-04-25T22:59:44.954189+0000","last_undegraded":"2024-04-25T22:59:44.954189+0000","last_fullsized":"2024-04-25T22:59:34.904462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:18:03.993920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.952707+0000","last_change":"2024-04-25T22:59:34.907777+0000","last_active":"2024-04-25T22:59:44.952707+0000","last_peered":"2024-04-25T22:59:44.952707+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"2024-04-25T22:59:34.907777+0000","last_became_peered":"2024-04-25T22:59:34.907777+0000","last_unstale":"2024-04-25T22:59:44.952707+0000","last_undegraded":"2024-04-25T22:59:44.952707+0000","last_fullsized":"2024-04-25T22:59:34.902051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:36.907991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953790+0000","last_change":"2024-04-25T22:59:34.912282+0000","last_active":"2024-04-25T22:59:44.953790+0000","last_peered":"2024-04-25T22:59:44.953790+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.912282+0000","last_became_peered":"2024-04-25T22:59:34.912282+0000","last_unstale":"2024-04-25T22:59:44.953790+0000","last_undegraded":"2024-04-25T22:59:44.953790+0000","last_fullsized":"2024-04-25T22:59:34.903937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:37.584582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.954119+0000","last_change":"2024-04-25T22:59:34.906374+0000","last_active":"2024-04-25T22:59:44.954119+0000","last_peered":"2024-04-25T22:59:44.954119+0000","last_clean":"2024-04-25T22:59:04.735940+0000","last_became_active":"2024-04-25T22:59:34.906374+0000","last_became_peered":"2024-04-25T22:59:34.906374+0000","last_unstale":"2024-04-25T22:59:44.954119+0000","last_undegraded":"2024-04-25T22:59:44.954119+0000","last_fullsized":"2024-04-25T22:59:34.903157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:51.561386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954514+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T22:59:44.954514+0000","last_peered":"2024-04-25T22:59:44.954514+0000","last_clean":"2024-04-25T22:59:44.954514+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T22:59:44.954514+0000","last_undegraded":"2024-04-25T22:59:44.954514+0000","last_fullsized":"2024-04-25T22:59:44.954514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.955244+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T22:59:44.955244+0000","last_peered":"2024-04-25T22:59:44.955244+0000","last_clean":"2024-04-25T22:59:44.955244+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T22:59:44.955244+0000","last_undegraded":"2024-04-25T22:59:44.955244+0000","last_fullsized":"2024-04-25T22:59:44.955244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.954302+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T22:59:44.954302+0000","last_peered":"2024-04-25T22:59:44.954302+0000","last_clean":"2024-04-25T22:59:44.954302+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T22:59:44.954302+0000","last_undegraded":"2024-04-25T22:59:44.954302+0000","last_fullsized":"2024-04-25T22:59:44.954302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":27,"reported_epoch":27,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:59:44.954562+0000","last_change":"2024-04-25T22:59:34.910183+0000","last_active":"2024-04-25T22:59:44.954562+0000","last_peered":"2024-04-25T22:59:44.954562+0000","last_clean":"2024-04-25T22:59:06.771919+0000","last_became_active":"2024-04-25T22:59:34.910183+0000","last_became_peered":"2024-04-25T22:59:34.910183+0000","last_unstale":"2024-04-25T22:59:44.954562+0000","last_undegraded":"2024-04-25T22:59:34.905352+0000","last_fullsized":"2024-04-25T22:59:34.904509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:47.173911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.953389+0000","last_change":"2024-04-25T22:59:34.912097+0000","last_active":"2024-04-25T22:59:44.953389+0000","last_peered":"2024-04-25T22:59:44.953389+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T22:59:34.912097+0000","last_became_peered":"2024-04-25T22:59:34.912097+0000","last_unstale":"2024-04-25T22:59:44.953389+0000","last_undegraded":"2024-04-25T22:59:44.953389+0000","last_fullsized":"2024-04-25T22:59:34.903578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:09.150320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":33,"reported_epoch":27,"state":"active+undersized","last_fresh":"2024-04-25T22:59:44.955428+0000","last_change":"2024-04-25T22:59:34.918356+0000","last_active":"2024-04-25T22:59:44.955428+0000","last_peered":"2024-04-25T22:59:44.955428+0000","last_clean":"2024-04-25T22:59:32.892921+0000","last_became_active":"2024-04-25T22:59:34.918356+0000","last_became_peered":"2024-04-25T22:59:34.918356+0000","last_unstale":"2024-04-25T22:59:44.955428+0000","last_undegraded":"2024-04-25T22:59:44.955428+0000","last_fullsized":"2024-04-25T22:59:34.907165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:10.686036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.953866+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T22:59:44.953866+0000","last_peered":"2024-04-25T22:59:44.953866+0000","last_clean":"2024-04-25T22:59:44.953866+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T22:59:44.953866+0000","last_undegraded":"2024-04-25T22:59:44.953866+0000","last_fullsized":"2024-04-25T22:59:44.953866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:59:44.956153+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T22:59:44.956153+0000","last_peered":"2024-04-25T22:59:44.956153+0000","last_clean":"2024-04-25T22:59:44.956153+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T22:59:44.956153+0000","last_undegraded":"2024-04-25T22:59:44.956153+0000","last_fullsized":"2024-04-25T22:59:44.956153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":9761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":46,"acting":46,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":89314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":686417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:59:49.135 INFO:tasks.thrashosds.thrasher:Setting 4.2d to [2, 1, 0] 2024-04-25T22:59:49.135 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2d', '2', '1', '0'] 2024-04-25T22:59:49.135 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2d 2 1 0 2024-04-25T22:59:49.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:59:49.198 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:49.195+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:49.235 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:49.235 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:49.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:49.298 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:49.295+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:49.360 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:49.360 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:49.367 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:49.367 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:49.367 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:49.367 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:49.367 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:49.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:49.382 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:49.382 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:49.382 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:49.384 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:49.384 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:49.400 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:49.395+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:49.484 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-25T22:59:49.490 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:59:49.490 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-25T22:59:49.500 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:49.495+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.029754056000002, 2024-04-25T22:59:49.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.029694110000001, 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:49.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:49.569 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.029553604, 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:49.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:49.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.029519493999999, 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.575 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:49.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:49.581 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.029484818, 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.029357779000001, 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.786277730000002, 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.786210590000003, 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.786063575, 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785993595000001, 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785932019000001, 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785829616000001, 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785765906999998, 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785706724000001, 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785643231000002, 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785584954999997, 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785481142000002, 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785329873000002, 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785263667999999, 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.785084638999997, 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:49.673 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:49.675 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:49.675 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:49.675+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:49.776 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:49.771+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:49.806 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:49.806 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:49.806 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:49.806 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:49.819 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:49.877 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:49.875+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:49.977 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:49.979+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:49.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:59:49.988 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:49.988 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:49.988 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:49.988 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:49.988 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:50.001 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:50.078 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:50.071+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:50.135 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.363988841999998, 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:50.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:50.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.142 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.363852153000003, 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:50.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.363776176000002, 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:50.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:50.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:50.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.363676064000003, 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:50.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:50.160 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.363590068000001, 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:50.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.167 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.363522580999998, 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:50.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:50.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:50.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:50.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:50.173 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.363221551000002, 2024-04-25T22:59:50.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:50.174 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.174 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.174 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:50.174 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:50.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:50.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:50.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:50.178 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.362840554000002, 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:50.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.182 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.362744431000003, 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:50.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:50.187 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.349555180000003, 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:50.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:50.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.191 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.347936869000002, 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:50.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:50.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.345749453000003, 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.195 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:50.199 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.345607639999997, 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:50.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:50.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.343121803000003, 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.204 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.343051656999997, 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.208 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.211 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.342455624999999, 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.341929311999998, 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:50.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.324318918000003, 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:50.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 41.367873729999999, 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:50.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 16.365593989000001, 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.229 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:50.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:50.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:50.234 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:50.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:50.237 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:50.235+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:50.338 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:50.335+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:50.368 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:50.368 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:50.382 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:50.470 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:50.471+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:50.543 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:50.543+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:50.549 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:50.549 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:50.549 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:50.549 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:50.549 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:50.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:50.649 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:50.647+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:50.732 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:50.732 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:50.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:50.732 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:50.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.733 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:50.733 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:50.733 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.200966160999997, 2024-04-25T22:59:50.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:50.733 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.734 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:50.734 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:50.734 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:50.734 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:50.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.735 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:50.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:50.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:50.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:50.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:50.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:50.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:50.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:50.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:50.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:50.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:50.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:50.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:50.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:50.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:50.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:50.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:50.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:50.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:50.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:50.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:50.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:50.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:50.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:50.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.749 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.750 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:50.750 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:50.750 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.200906215000003, 2024-04-25T22:59:50.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:50.750 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.751 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.751 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:50.751 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:50.751 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:50.751 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:50.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:50.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:50.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:50.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:50.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:50.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:50.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:50.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:50.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:50.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:50.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:50.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:50.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:50.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:50.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:50.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:50.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:50.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:50.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:50.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:50.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:50.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:50.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:50.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:50.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.762 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.763 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:50.763 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:50.763 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.200765709000002, 2024-04-25T22:59:50.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:50.763 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.764 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.764 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:50.764 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:50.764 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:50.764 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:50.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.765 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:50.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:50.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:50.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:50.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:50.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:50.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:50.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:50.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:50.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:50.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:50.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:50.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:50.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:50.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:50.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:50.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:50.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:50.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:50.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:50.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:50.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:50.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:50.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:50.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.775 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.776 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:50.776 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:50.776 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.200731599000001, 2024-04-25T22:59:50.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:50.777 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.777 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.777 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:50.777 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:50.778 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:50.778 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:50.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.778 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:50.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:50.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:50.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:50.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:50.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:50.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:50.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:50.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:50.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:50.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:50.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:50.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:50.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:50.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:50.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:50.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:50.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:50.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:50.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:50.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:50.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:50.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:50.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:50.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.789 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.790 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:50.790 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:50.790 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.200696923000002, 2024-04-25T22:59:50.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:50.790 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:50.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:50.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.200569883999997, 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.957489834999997, 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:50.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:50.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:50.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:50.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.957422694999998, 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.807 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.957275680000002, 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.813 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:50.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.818 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.957205700000003, 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:50.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.824 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.957144124000003, 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:50.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:50.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.957041721000003, 2024-04-25T22:59:50.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:50.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:50.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.956978012, 2024-04-25T22:59:50.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:50.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:50.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.839 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.956918829000003, 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:50.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:50.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.956855335999997, 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.845 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:50.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:50.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:50.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.95679706, 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.851 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:50.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:50.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.956693246999997, 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:50.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:50.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:50.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:50.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.956541977999997, 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:50.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:50.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.956475773000001, 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:50.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:50.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:50.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.956296743999999, 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:50.875 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:50.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:50.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:50.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:50.879 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:50.881 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:50.882 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:50.875+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:50.975 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T22:59:50.984 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:50.983+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:51.015 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:51.015 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:51.015 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:51.015 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:51.029 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:51.083 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:51.083+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:51.150 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:51.151 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:51.151 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:51.151 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:51.151 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:51.165 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:51.211 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:51.207+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:51.284 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:51.283+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.517734707999999, 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.517598018999998, 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.517522042000003, 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.517421929999998, 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.310 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.311 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.312 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.313 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.314 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.517335934000002, 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:51.315 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:51.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.318 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.517268446999999, 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.321 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:51.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:51.323 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:51.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:51.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.326 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.516967417000004, 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.327 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:51.328 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:51.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.330 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.516586420000003, 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.331 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.333 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:51.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.516490296999997, 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:51.335 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:51.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.339 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.503301045999997, 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.340 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:51.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.344 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.501682735000003, 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:51.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.499495318999998, 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.348 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:51.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.351 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:51.352 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.499353505999999, 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:51.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.354 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.356 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:51.356 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:51.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.356 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.358 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.496867668999997, 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.359 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.360 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:51.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.362 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.496797522999998, 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.363 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:51.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:51.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.496201491000001, 2024-04-25T22:59:51.366 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.370 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.495675177999999, 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.371 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:51.374 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 44.478064783999997, 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.375 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.378 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 42.521619596000001, 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.379 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:51.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:51.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.519339854999998, 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:51.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:51.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:51.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:51.389 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:51.390 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:59:51.392 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:51.387+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:51.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:51.491 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:51.491+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:51.525 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:51.525 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:51.525 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:51.525 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:51.540 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:51.554 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:51.575 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:51.576 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:51.576 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:51.579 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:51.579 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:51.625 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:51.627+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:51.693 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:51.687+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:51.701 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:51.701 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:51.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:51.794 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:51.791+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:51.880 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:51.880 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:51.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-04-25T22:59:51.895 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:51.891+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:51.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:51.996 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:51.991+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:52.028 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:52.028 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:52.042 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:52.127 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:52.123+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:52.198 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:52.199+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:52.208 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:52.208 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:52.223 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:52.315 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:52.311+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:52.391 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:52.391 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:52.399 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:52.395+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:52.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:52.499 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:52.499+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:52.534 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:52.535 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:52.548 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:52.600 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:52.599+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:52.702 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:52.703+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:52.711 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:52.711 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:52.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:52.817 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:52.819+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:52.890 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:52.890 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:52.904 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:52.904 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:52.903+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:53.000 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:59:53.005 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:53.003+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:53.035 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:53.035 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:53.051 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:53.105 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:53.099+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:53.174 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:53.174 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:53.188 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:53.231 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:53.227+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:53.307 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:53.307+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:53.354 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:53.354 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:53.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:53.418 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:53.419+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:53.500 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:53.500 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:53.512 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:53.511+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:53.515 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:53.580 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:59:53.612 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:53.611+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:53.680 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:53.680 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:53.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:53.714 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:53.711+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:53.732 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:53.733 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:53.754 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:53.754 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:53.754 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:53.757 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:53.757 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:53.815 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:53.811+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:53.860 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.332516769000001, 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.332456823000001, 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.332316317, 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.332282206999999, 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.332247531, 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.332120492000001, 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.089040443000002, 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088973303000003, 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088826288, 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088756308000001, 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088694732, 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088592329000001, 2024-04-25T22:59:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088528619999998, 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088469437000001, 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088405944000002, 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088347667999997, 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088243855000002, 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088092586000002, 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.088026380999999, 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.087847351999997, 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:53.981 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:53.983 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:53.983 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:53.975+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:53.987 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T22:59:54.083 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.079+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:54.114 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:54.115 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:54.115 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:54.115 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:54.129 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:54.185 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:54.183+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:54.286 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.279+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:54.294 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:54.294 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:54.294 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:54.294 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:54.294 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:54.309 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:54.399 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.395+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.705066535999997, 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.478 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:54.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:54.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.484 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.704929847000002, 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:54.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:54.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.704853870000001, 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.496 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.704753758000003, 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:54.502 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.704667762, 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.503 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:54.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:54.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.704600274999997, 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:54.509 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:54.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:54.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:54.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.704299245000001, 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:54.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.519 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.703918248000001, 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:54.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:54.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.703822125000002, 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:54.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:54.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.690632874000002, 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:54.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:54.533 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.689014563000001, 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:54.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.537 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.686827147000002, 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:54.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:54.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:54.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.686685334000003, 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:54.546 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.684199497000002, 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:54.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.684129351000003, 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:54.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.554 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.683533318999999, 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:54.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:54.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.558 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.683007005999997, 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:54.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.665396612000002, 2024-04-25T22:59:54.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:54.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 45.708951423999999, 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.567 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:54.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:54.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 20.706671683, 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:54.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:54.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:54.578 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:54.578 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-25T22:59:54.579 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:59:54.579 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-04-25T22:59:54.579 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T22:59:54.579 INFO:teuthology.orchestra.console.smithi172:Power on 2024-04-25T22:59:54.579 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-25T22:59:54.590 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.575+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:54.591 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:54.603 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-04-25T22:59:54.603 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:59:54.632 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-25T22:59:54.681 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.679+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:54.724 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:54.725 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:54.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:54.782 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.775+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:54.862 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:54.862 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:54.876 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:54.883 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.879+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:54.984 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:54.979+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:55.001 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.471786160999997, 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.471726214999997, 2024-04-25T22:59:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.471585709000003, 2024-04-25T22:59:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.471551599000001, 2024-04-25T22:59:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.471516923000003, 2024-04-25T22:59:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.471389883999997, 2024-04-25T22:59:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.228309834999997, 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.228242694999999, 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.228095680000003, 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.228025700000003, 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227964124000003, 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227861720999996, 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227798012000001, 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227738829000003, 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227675335999997, 2024-04-25T22:59:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.22761706, 2024-04-25T22:59:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227513246999997, 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227361977999998, 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227295773000002, 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.227116744, 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:55.161 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:55.162 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:55.163 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:55.159+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:55.263 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:55.259+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:55.292 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:55.293 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:55.293 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:55.293 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:55.306 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:55.395 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:55.391+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:55.465 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:55.463+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:55.473 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:55.473 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:55.473 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:55.473 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:55.473 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:55.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:55.575 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:55.571+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:55.662 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:55.662 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:55.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:55.662 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:55.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.662 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.887093964999998, 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:55.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:55.668 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.886957275999997, 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:55.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.674 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.886881299000002, 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:55.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.886781186999997, 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.681 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:55.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:55.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:55.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:55.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.886695191000001, 2024-04-25T22:59:55.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:55.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:55.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:55.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.886627703999999, 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:55.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:55.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.886326674000003, 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:55.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:55.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.885945677000002, 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.885849554000004, 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.872660303000004, 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.871041992000002, 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.868854575999997, 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.868712762999998, 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.866226926000003, 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.866156779999997, 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.865560748, 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.865034434999998, 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.847424040999996, 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 46.890978853, 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 21.888699112000001, 2024-04-25T22:59:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:55.759 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:55.760 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:59:55.761 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:55.759+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:55.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:55.861 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:55.859+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:55.894 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:55.894 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:55.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:55.920 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:55.921 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:55.942 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:55.942 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:55.942 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:55.946 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:55.946 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:55.962 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:55.955+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:56.011 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:59:56.030 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:56.031 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:56.046 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:56.094 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:56.094+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:56.164 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:56.163+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:56.168 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:56.168 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:56.182 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:56.265 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:56.262+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:56.313 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:56.313 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:56.327 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:56.366 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:56.366+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:56.443 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:56.443 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:56.457 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:56.467 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:56.466+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:56.568 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:56.563+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:56.580 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:56.580 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:56.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:56.669 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:56.663+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:56.725 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:56.725 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:56.740 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:56.786 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:56.786+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:56.856 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:56.856 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:56.870 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:56.914 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:56.914+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:56.973 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:56.970+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:56.998 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T22:59:57.036 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:57.036 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:57.051 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:57.098 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:57.098+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:57.175 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:57.174+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:57.182 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:57.183 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:57.197 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:57.276 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:57.271+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:57.313 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:57.314 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:57.327 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:57.415 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:57.411+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:57.478 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:57.471+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:57.495 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:57.495 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:57.509 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:57.578 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:57.578+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:57.639 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:57.639 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:57.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:57.679 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:57.675+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:57.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2024-04-25T22:59:57.780 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:57.778+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:57.826 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:57.827 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:57.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:57.882 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:57.882+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:57.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:59:57.981 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:57.978+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:58.005 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T22:59:58.005 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:59:58.019 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:58.082 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:58.075+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:58.111 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T22:59:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:59:58.133 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T22:59:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:59:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T22:59:58.136 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:59:58.137 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:59:58.152 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:58.153 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:58.153 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:58.153 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:58.167 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:58.211 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:58.207+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:58.283 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:58.282+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:58.332 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:58.333 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:58.333 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:58.333 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:58.333 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:58.347 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:58.391 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:58.387+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:58.470 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:58.470 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:58.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.699381721000002, 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:58.476 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.699245032, 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:58.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:58.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:58.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.699169054999999, 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.699068943, 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.489 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:58.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:58.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:58.494 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.698982946999998, 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:58.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:58.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:58.500 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.698915460000002, 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:58.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:58.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.506 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.698614429999999, 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:58.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:58.510 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.698233432999999, 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:58.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:58.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:58.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.69813731, 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:58.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.519 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.684948059, 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:58.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:58.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:58.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:58.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.683329747999998, 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:58.526 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.681142332, 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.531 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:58.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:58.535 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.681000519000001, 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:58.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.678514681999999, 2024-04-25T22:59:58.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.544 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.678444536000001, 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:58.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:58.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.677848503999996, 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:58.548 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:58.552 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.677322191000002, 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:58.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:58.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:58.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:58.557 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.659711797, 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:58.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:58.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:58.561 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 49.703266609000003, 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:58.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:58.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.567 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 24.700986868000001, 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.568 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:58.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:58.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:58.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:58.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:58.573 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.574 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.574 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.574 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:58.574 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:58.576 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:58.575+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:58.576 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:58.633 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:59:58.677 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:58.675+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:58.707 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:58.707 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:58.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:58.743 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-25T22:59:58.778 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:58.775+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:58.839 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:58.839 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:58.839 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:58.839 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:58.839 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:58.844 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-04-25T22:59:58.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:59:58.879 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:58.875+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T22:59:58.945 DEBUG:teuthology.orchestra.console.smithi172:Waiting for login prompt 2024-04-25T22:59:58.946 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi172 2024-04-25T22:59:58.979 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.448564281000003, 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T22:59:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.448504335000003, 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T22:59:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.448363829000002, 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.448329719, 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T22:59:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T22:59:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.448295043000002, 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T22:59:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.448168004000003, 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.205087955000003, 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T22:59:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T22:59:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T22:59:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.205020814999997, 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T22:59:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T22:59:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204873800000001, 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T22:59:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T22:59:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T22:59:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204803820000002, 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.035 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T22:59:59.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T22:59:59.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204742244000002, 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.041 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:59.046 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204639841000002, 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T22:59:59.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204576132, 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:59:59.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T22:59:59.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204516949000002, 2024-04-25T22:59:59.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T22:59:59.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T22:59:59.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T22:59:59.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204453456000003, 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:59.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204395179999999, 2024-04-25T22:59:59.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T22:59:59.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T22:59:59.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204291367000003, 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T22:59:59.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204140098000003, 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T22:59:59.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.204073893, 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T22:59:59.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T22:59:59.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.203894863999999, 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T22:59:59.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T22:59:59.099 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:59.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:59:59.102 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:59:59.103 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.098+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.202 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.202+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.235 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:59.235 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:59.235 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T22:59:59.235 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:59.249 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:59:59.303 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.302+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.366 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:59.366 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T22:59:59.366 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T22:59:59.367 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T22:59:59.367 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:59.380 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:59:59.403 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.402+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.498 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T22:59:59.498 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T22:59:59.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T22:59:59.498 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T22:59:59.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.725793236999998, 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T22:59:59.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T22:59:59.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T22:59:59.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.504 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.725656548000003, 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T22:59:59.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.725580571000002, 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.511 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T22:59:59.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T22:59:59.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.725480459000003, 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T22:59:59.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.725394463000001, 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T22:59:59.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T22:59:59.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.725326975999998, 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.529 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.725025946000002, 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:59.535 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.538 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.724644949000002, 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:59.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T22:59:59.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T22:59:59.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.543 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.724548826000003, 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T22:59:59.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T22:59:59.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:59.548 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.711359575000003, 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T22:59:59.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T22:59:59.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.709741264000002, 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.553 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T22:59:59.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.707553848000003, 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.557 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T22:59:59.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T22:59:59.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.707412034999997, 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.562 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T22:59:59.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.566 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.704926198000003, 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T22:59:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T22:59:59.570 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.704856051999997, 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.574 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.70426002, 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.578 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.703733706999998, 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T22:59:59.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.686123313000003, 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.583 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T22:59:59.586 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 50.729678125, 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T22:59:59.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T22:59:59.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T22:59:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.727398384000001, 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T22:59:59.592 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T22:59:59.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T22:59:59.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T22:59:59.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.597 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.598 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T22:59:59.598 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T22:59:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T22:59:59.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:59:59.600 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.598+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.700 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.698+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.731 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T22:59:59.731 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:59.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:59:59.834 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.834+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.902 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T22:59:59.902+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T22:59:59.906 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T22:59:59.906 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T22:59:59.907 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T22:59:59.907 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T22:59:59.907 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T22:59:59.921 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:00.004 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T22:59:59.999+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:00.017 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:00:00.105 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:00.103+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:00.117 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:00.117 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:00.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:00.117 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:00.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.117 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:00.117 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.586812584999997, 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:00.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:00.123 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.586752638999997, 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:00.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.586612133000003, 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.129 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:00.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:00.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:00.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:00.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:00.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:00.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.586578023000001, 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:00.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.586543347000003, 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:00.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:00.143 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:00.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.143 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.148 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.586416307999997, 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:00.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:00.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.343336258999997, 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:00.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:00.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:00.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:00.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:00.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:00.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:00.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:00.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:00.163 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.343269118999999, 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:00.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:00.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.343122104000003, 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.170 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:00.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:00.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.343052124000003, 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.181 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342990548000003, 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.186 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342888145000003, 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:00.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:00.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342824436000001, 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.192 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:00.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:00.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:00.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:00.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342765253000003, 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:00.197 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342701759999997, 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:00.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:00.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342643484, 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.209 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342539670999997, 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.215 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:00.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:00.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342388401999997, 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:00.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:00.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:00.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:00.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:00.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342322197000001, 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:00.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:00.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:00.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.342143168, 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:00.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:00.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:00.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:00.237 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:00.238 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:00.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:00.240 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:00.240 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:00.238+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:00.341 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:00.335+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:00.369 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:00.369 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:00.369 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:00.369 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:00.383 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:00.396 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:00.396 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:00.414 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:00.418 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:00.419 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:00.471 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:00.467+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:00.543 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:00.542+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:00.546 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:00.546 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:00.559 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:00.644 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:00.642+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:00.721 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:00.721 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:00.734 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:00.745 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:00.743+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:00.846 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:00.846+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:00.861 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:00.861 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:00.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:00.947 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:00.943+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:01.040 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:01.040 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:01.048 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:01.046+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:01.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:01.149 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:01.147+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:01.220 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:01.220 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:01.234 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:01.279 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:01.279+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:01.350 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:01.350+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:01.361 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:01.361 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:01.375 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:01.451 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:01.450+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:01.540 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:01.541 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:01.552 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:01.547+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:01.553 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:01.653 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:01.650+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:01.702 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:01.702 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:01.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:01.753 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:01.751+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:01.847 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:01.847 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:01.854 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:01.854+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:01.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:01.956 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:01.955+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:02.030 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:02.030 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:02.039 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:00:02.044 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:02.094 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:02.094+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:02.158 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:02.158+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:02.167 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:02.168 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:02.182 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:02.259 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:02.259+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:02.308 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:02.308 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:02.321 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:02.360 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:02.358+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:02.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:02.462 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:02.462+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:02.470 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:02.470 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:02.482 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:02.562 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:02.559+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:02.574 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:02.575 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:02.595 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:02.598 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:02.599 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:02.606 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:02.606 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:02.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:02.606 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:02.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.833769930000003, 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:02.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:02.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:02.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:02.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.833633241000001, 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:02.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:02.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:02.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.833557264, 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:02.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:02.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:02.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:02.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:02.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.833457152000001, 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:02.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:02.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.833371155999998, 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:02.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:02.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:02.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:02.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.833303669000003, 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.833002639, 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:02.644 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:02.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.832621641999999, 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:02.648 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:02.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.652 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.832525519000001, 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:02.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:02.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.819336268000001, 2024-04-25T23:00:02.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:02.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:02.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.661 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.817717956999999, 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.665 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.815530541000001, 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:02.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.815388728000002, 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.670 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:02.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.812902891, 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:02.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.812832745000001, 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:02.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:02.682 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.812236712999997, 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:02.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.811710400000003, 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.686 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:02.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.794100006000001, 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:02.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:02.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:02.694 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 53.837654817999997, 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:02.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.699 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 28.835375076999998, 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:02.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:02.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:02.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:02.705 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:02.707 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:02.708 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:02.706+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:02.807 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:02.806+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:02.839 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:02.840 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:02.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:02.909 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:02.907+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:03.009 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:03.007+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:03.020 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:03.020 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:03.026 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:00:03.035 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:03.110 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:03.107+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:03.161 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.630855347999997, 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.630795402000004, 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.630654895999996, 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.630620785999994, 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:03.180 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:03.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.630586109999996, 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:03.186 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:03.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.630459071000004, 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:03.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:03.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:03.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.387379021999998, 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.198 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:03.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:03.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:03.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.387311881999999, 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:03.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:03.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:03.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.387164867000003, 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:03.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:03.216 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.387094887000003, 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:03.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:03.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.387033311000003, 2024-04-25T23:00:03.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:03.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:03.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386930907999997, 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:03.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:03.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386867199000001, 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:03.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.239 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386808016000003, 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:03.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386744522999997, 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:03.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:03.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.252 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386686247, 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:03.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:03.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386582433999997, 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:03.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:03.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386431164999998, 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.265 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:03.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:03.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386364960000002, 2024-04-25T23:00:03.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:03.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:03.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.386185931, 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:03.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:03.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:03.283 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:03.284 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:03.285 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:03.282+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:03.385 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:03.383+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:03.416 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:03.416 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:03.417 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:03.417 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:03.432 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:03.519 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:03.519+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:03.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-04-25T23:00:03.587 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:03.586+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:03.593 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:03.593 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:03.593 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:03.593 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:03.593 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:03.606 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:03.688 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:03.686+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:03.767 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.994360684, 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:03.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:03.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:03.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.994223994999999, 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:03.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:03.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.779 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.994148017999997, 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:03.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.785 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.994047905999999, 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.786 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:03.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:03.791 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.993961910000003, 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:03.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:03.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.993894423, 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:03.798 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.993593392999998, 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:03.804 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:03.806 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:03.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.993212395999997, 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:03.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:03.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.812 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.993116272999998, 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.813 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:03.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:03.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:03.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.979927021999998, 2024-04-25T23:00:03.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:03.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.978308710999997, 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:03.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:03.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.976121294999999, 2024-04-25T23:00:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:03.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.829 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.975979482, 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.830 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:03.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:03.832 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:03.833 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.973493644999998, 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:03.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:03.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:03.837 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.973423498999999, 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.838 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.843 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.844 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.972827467000002, 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.845 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:03.846 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:03.847 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.848 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.972301154, 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:03.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:03.851 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:03.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.954690759999998, 2024-04-25T23:00:03.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:03.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:03.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:03.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 54.998245572000002, 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:03.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:03.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:03.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 29.995965830999999, 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:03.862 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:03.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:03.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:03.867 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:03.868 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:03.869 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:03.870 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:03.866+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:03.970 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:03.967+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:04.002 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:04.002 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:04.002 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:04.003 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:04.017 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:04.071 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:04.070+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:04.140 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:04.140 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:04.154 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:04.172 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:04.171+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:04.273 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:04.270+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.794482001999995, 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:04.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.794422056000002, 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:04.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:04.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:04.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.794281549999994, 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:04.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:04.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:04.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.794247440000007, 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:04.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:04.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.794212763999994, 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.348 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:04.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:04.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:04.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.794085725000002, 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.354 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:04.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.551005676000003, 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:04.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550938535999997, 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:04.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:04.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:04.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:04.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:04.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550791521000001, 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:04.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550721541000001, 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550659965000001, 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550557562000002, 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550493852999999, 2024-04-25T23:00:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550434670000001, 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550371177000002, 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550312900999998, 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550209088000003, 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.550057819000003, 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.549991614, 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.549812584999998, 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:04.440 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:04.442 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:04.442 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:04.439+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:04.544 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:04.542+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:04.573 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:04.573 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:04.588 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:04.600 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:04.644 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:04.643+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:04.704 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:04.705 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:04.705 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:04.705 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:04.705 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:04.719 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:04.754 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:04.763 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:04.763+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:04.772 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:04.773 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:04.773 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:04.776 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:04.776 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:04.845 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:04.842+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:04.886 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:04.886 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:04.900 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:04.946 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:04.946+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:05.031 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:05.032 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:05.046 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:05.047 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:05.047+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:05.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:00:05.152 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:05.151+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:05.210 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:05.211 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:05.224 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:05.252 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:05.251+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:05.340 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:05.341 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:05.352 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:05.351+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:05.355 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:05.453 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:05.450+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:05.487 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:05.488 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:05.505 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:05.554 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:05.551+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:05.627 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:05.627 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:05.641 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:05.683 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:05.683+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:05.757 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:05.754+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:05.806 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:05.806 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:05.820 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:05.857 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:05.855+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:05.953 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:05.953 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:05.958 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:05.958+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:05.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:06.035 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:00:06.062 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:06.062+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:06.138 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:06.138 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:06.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:06.194 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:06.194+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:06.260 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:06.259+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:06.314 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:06.314 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:06.328 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:06.360 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:06.358+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:06.460 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:06.461 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:06.461 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:06.459+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:06.474 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:06.561 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:06.562+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:06.643 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:06.643 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:06.658 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:06.709 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:06.707+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:06.763 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:06.763+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:06.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:06.778 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:06.779 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:06.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:06.864 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:06.862+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:06.925 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:06.925 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:06.932 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:06.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:06.953 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:06.953 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:06.953 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:06.956 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:06.956 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:06.982 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:06.982+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:07.066 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:07.066+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:07.103 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:07.104 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:07.104 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:07.104 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:07.104 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:07.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:07.167 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:07.167+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:07.268 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:07.267+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:07.289 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:07.289 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.759118780999998, 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:07.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:07.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.296 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.759058835000005, 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:07.297 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:07.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:07.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:07.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.758918328999997, 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:07.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:07.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:07.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.758884218999995, 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.758849542999997, 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.758722504000005, 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515642454999998, 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515575315, 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515428299999996, 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515358319999997, 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515296743999997, 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515194340999997, 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515130632000002, 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515071448999997, 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.515007955999998, 2024-04-25T23:00:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.514949680000001, 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.514845866999998, 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.514694597999998, 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.514628393000002, 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.514449364000001, 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:07.414 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:07.416 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:07.417 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:07.414+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:07.517 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:07.514+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:07.549 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:07.549 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:07.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:07.549 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:07.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:07.618 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:07.615+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:07.686 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:07.687 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:07.687 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:07.687 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:07.687 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:07.700 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:07.743 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:07.743+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:07.819 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:07.819+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.100390359999999, 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.873 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:07.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:07.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.879 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.100253670999997, 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.885 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.100177694000003, 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:07.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.891 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.100077581999997, 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:07.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.099991586000002, 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.898 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:07.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:07.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.904 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.099924098999999, 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:07.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:07.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:07.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:07.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.099623069000003, 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.099242072000003, 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:07.915 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:07.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:07.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:07.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.099145948999997, 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.920 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:07.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.085956697999997, 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.084338387000003, 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:07.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.082150970999997, 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.933 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:07.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.937 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.082009157999998, 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.079523321000003, 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.079453174999998, 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:07.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:07.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.078857143, 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:07.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.953 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.078330829999999, 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:07.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.060720435999997, 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:07.958 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 59.104275248, 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:07.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:07.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:07.967 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 34.101995506999998, 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:07.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:07.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.972 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:07.973 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:07.973 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:07.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:07.975 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:07.974+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:08.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:00:08.075 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:08.074+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:08.107 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:08.107 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:08.122 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:08.176 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:08.175+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:08.277 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:08.275+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:08.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:08.378 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:08.378+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:08.433 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:08.433 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:08.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:08.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:08.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:08.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.904910110000003, 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.904850163999996, 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:08.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:08.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:08.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:08.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.444 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.904709658000002, 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:08.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:08.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.904675548, 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.904640872000002, 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.904513832999996, 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:08.460 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:08.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:08.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.661433784000003, 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:08.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.661366643999997, 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:08.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:08.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:08.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.661219629000001, 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:08.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:08.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:08.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.661149649000002, 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:08.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:08.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:08.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:08.488 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.661088073000002, 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.493 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660985670000002, 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:08.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660921961, 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660862778000002, 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:08.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.509 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660799285000003, 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:08.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:08.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:08.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:08.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660741008999999, 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:08.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.520 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660637196000003, 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:08.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:08.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:08.526 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660485927000003, 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660419722, 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.660240692999999, 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:08.542 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:08.543 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:08.544 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:08.543+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:08.644 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:08.643+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:08.674 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:08.674 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:08.674 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:08.674 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:08.688 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:08.775 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:08.775+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:08.846 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:08.843+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:08.854 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:08.854 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:08.854 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:08.854 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:08.854 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:08.868 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:08.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:08.959 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:08.959+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:09.034 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.261933853000002, 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.035 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:09.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:09.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:09.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:09.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.261797164000001, 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.041 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:09.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.261721186999999, 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:09.047 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:09.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:09.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.053 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.261621075000001, 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:09.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:09.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.059 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.261535078999998, 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:09.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:09.065 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.261467592000002, 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:09.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.071 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.261166562, 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:09.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.075 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.260785564999999, 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:09.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.260689442, 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.080 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:09.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:09.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:09.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.247500191, 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:09.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:09.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:09.089 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.245881879999999, 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:09.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:09.092 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.243694464000001, 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.243552651000002, 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:09.097 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.101 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.241066814, 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.105 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.240996668000001, 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.240400635999997, 2024-04-25T23:00:09.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:09.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.239874323000002, 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.113 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:09.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 62.222263929, 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:09.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.120 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 60.265818740999997, 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.263539000000002, 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:09.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:09.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.132 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:09.133 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:09.133 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:09.135 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:00:09.135 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:09.131+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:09.136 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:09.136 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:09.136 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:09.137 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:09.137 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:09.138 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:09.138 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:09.138 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:09.235 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:09.235+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:09.267 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:09.267 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:09.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:09.336 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:09.335+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:09.402 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:09.402 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:09.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:09.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-04-25T23:00:09.466 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:09.466+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:09.538 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:09.538+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:09.539 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:09.540 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:09.554 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:09.640 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:09.638+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:09.685 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:09.685 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:09.699 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:09.743 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:09.743+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:09.816 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:09.817 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:09.830 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:09.875 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:09.875+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:09.944 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:09.943+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:09.998 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:09.999 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:10.012 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:10.058 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.058+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.136 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:10.137 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:10.145 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:10.143+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:10.150 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:10.246 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.246+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.314 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:10.314 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:10.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:10.370 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.370+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.448 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.446+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.488 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:10.489 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:10.502 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:10.548 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.546+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.632 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:10.633 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:10.647 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:10.648 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.646+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.749 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:10.747+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:10.764 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:10.764 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:10.778 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:10.851 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.850+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.940 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:10.940 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:10.952 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:10.950+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:10.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:11.053 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:11.050+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:11.082 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:11.082 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:11.096 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:11.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:00:11.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:11.154 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:11.151+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:11.255 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:11.255+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:11.259 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:11.259 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:11.273 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:11.315 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:11.315 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:11.336 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:11.337 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:11.337 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:11.339 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:11.340 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:11.355 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:11.355+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.868163209000002, 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:11.397 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:11.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:11.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.868103262999995, 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:11.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:11.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.867962757000001, 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.410 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:11.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.867928646999999, 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.416 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:11.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:11.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:11.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.867893971000001, 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:11.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:11.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:11.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.867766931999995, 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:11.430 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:11.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.435 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624686882999995, 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:11.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624619742999997, 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:11.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:11.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:11.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624472728000001, 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624402747999994, 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:11.453 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.458 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624341172000001, 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:11.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:11.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624238769000002, 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.464 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:11.469 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624175059999999, 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:11.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624115876999994, 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.475 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:11.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:11.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.624052383999995, 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:11.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:11.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.623994108000005, 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.493 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.623890294999995, 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:11.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:11.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.623739025999996, 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:11.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:11.506 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.623672821, 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:11.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.623493792000005, 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:11.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:11.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:11.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:11.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:11.517 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:11.519 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:11.519 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:11.515+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:11.620 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:11.618+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:11.648 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:11.649 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:11.649 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:11.649 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:11.663 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:11.720 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:11.718+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:11.786 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:11.786 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:11.786 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:11.786 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:11.786 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:11.800 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:11.847 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:11.847+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:11.923 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:11.922+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:11.927 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:11.927 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:11.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.154593794999997, 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:11.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:11.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:11.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.933 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.154457105999995, 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:11.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:11.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.154381129000001, 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:11.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.154281017000002, 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.154195021000007, 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:11.958 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.154127533999997, 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:11.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:11.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:11.964 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.153826503999994, 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.153445507000001, 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:11.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:11.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.153349383999995, 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.973 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:11.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.140160132999995, 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.978 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:11.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.982 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.138541821999993, 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:11.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:11.986 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.136354405999995, 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.987 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:11.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.136212592999996, 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:11.991 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:11.995 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.133726756000002, 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:11.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:11.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:11.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:11.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.133656610000003, 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:12.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:12.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.133060577999998, 2024-04-25T23:00:12.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:12.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:12.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:12.007 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.132534265000004, 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:12.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:12.012 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.114923871000002, 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:12.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 63.158478682999998, 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:12.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:12.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:12.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:12.022 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 38.156198942000003, 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:12.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:12.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:12.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:12.027 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:12.028 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:12.029 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:12.027+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:12.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:12.054 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:00:12.130 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:12.127+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:12.163 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:12.163 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:12.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:12.230 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:12.230+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:12.292 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:12.293 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:12.306 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:12.332 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:12.331+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:12.433 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:12.430+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:12.472 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.943828452000005, 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.943768505999998, 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.943628000000004, 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.943593890000002, 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.943559214000004, 2024-04-25T23:00:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.943432174999998, 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:12.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:12.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.700352125999999, 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:12.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:12.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.700284986, 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:12.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:12.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.700137971000004, 2024-04-25T23:00:12.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:12.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.700067990999997, 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.529 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:12.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:12.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.700006415000004, 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699904012000005, 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:12.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699840303000002, 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:12.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:12.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699781119999997, 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:12.551 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:12.557 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699717626999998, 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:12.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:12.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:12.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:12.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699659350999994, 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:12.563 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:12.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:12.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.569 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699555537999998, 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:12.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699404268999999, 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:12.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:12.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:12.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699338064000003, 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:12.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:12.588 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.699159034999994, 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:12.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:12.593 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:12.595 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:12.595 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:12.591+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:12.696 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:12.695+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:12.725 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:12.725 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:12.725 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:12.725 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:12.739 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:12.797 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:12.794+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:12.898 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:12.898+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:12.906 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:12.906 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:12.906 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:12.906 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:12.906 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:12.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:12.998 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:12.995+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:13.046 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.274187064000003, 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.047 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:13.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:13.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:13.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.274050375000002, 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:13.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:13.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:13.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:13.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:13.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.059 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.273974398000007, 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:13.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:13.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:13.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.273874285999995, 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:13.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.072 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.273788289999999, 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:13.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:13.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:13.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.078 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.273720803000003, 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:13.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.273419773000001, 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.085 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:13.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.273038776000007, 2024-04-25T23:00:13.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:13.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.272942653000001, 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.094 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:13.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.259753402000001, 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:13.099 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:13.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.103 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.258135091, 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:13.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.255947675000002, 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:13.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:13.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:13.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.112 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.255805862000003, 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:13.117 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.253320024999994, 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:13.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.253249878999995, 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:13.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.252653847000005, 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:13.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.252127533999996, 2024-04-25T23:00:13.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:13.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:13.134 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 66.234517139999994, 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 64.278071952000005, 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:13.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:13.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:13.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:13.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.275792211000002, 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:13.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:13.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:13.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:13.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:13.151 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.151 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.151 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.151 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:13.151 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:13.151 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:13.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:13.153 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:13.150+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:13.254 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:13.251+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:13.282 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:13.283 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:13.283 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:13.283 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:13.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:13.341 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:13.355 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:13.351+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:13.419 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:13.419 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:13.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:13.455 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:13.455+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:13.483 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:13.484 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:13.504 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:13.505 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:13.505 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:13.508 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:13.508 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:13.550 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:13.550 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:13.555 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:13.554+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:13.564 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:13.657 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:13.655+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:13.696 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:13.696 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:13.710 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:13.758 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:13.758+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:13.859 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:13.858+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:13.876 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:13.876 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:13.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:13.959 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:13.959+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:14.014 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:14.014 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:14.028 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:14.071 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:14.071+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:14.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:00:14.161 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:14.158+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:14.161 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:14.162 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:14.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:14.262 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:14.262+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:14.339 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:14.339 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:14.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:14.363 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:14.363+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:14.464 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:14.463+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:14.515 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:14.516 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:14.531 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:14.579 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:14.579+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:14.661 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:14.661 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:14.666 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:14.663+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:14.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:14.767 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:14.767+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:14.844 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:14.844 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:14.858 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:14.868 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:14.866+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:14.968 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:14.966+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:15.020 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:15.021 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:15.035 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:15.069 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:15.067+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:15.075 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:00:15.167 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:15.167 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:15.170 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:15.167+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:15.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:15.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-04-25T23:00:15.270 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:15.267+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:15.303 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:15.303 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:15.317 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:15.371 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:15.371+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:15.434 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:15.434 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:15.448 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:15.472 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:15.470+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:15.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:15.573 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:15.574+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:15.578 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:15.578 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:15.593 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:15.657 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:15.658 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:15.674 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:15.674+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:15.676 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:15.676 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:15.676 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:15.679 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:15.679 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:15.714 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:15.714 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:15.715 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:15.715 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:15.715 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:15.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:15.775 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:15.774+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:15.847 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:15.847 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:15.847 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:15.847 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:15.847 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.075995782999996, 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.848 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:15.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:15.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.853 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.075859093999995, 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:15.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:15.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.857 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:15.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:15.859 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.075783117, 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:15.863 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:15.866 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.075683005000002, 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.867 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:15.868 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:15.869 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:15.870 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.872 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.075597009000006, 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.878 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.075529521999997, 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:15.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:15.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:15.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:15.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.075228491999994, 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:15.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:15.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:15.888 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.074847495, 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:15.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.074751371999994, 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:15.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:15.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:15.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:15.898 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.061562120999994, 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:15.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:15.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:15.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.059943809999993, 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:15.906 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.057756393999995, 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:15.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:15.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.057614580999996, 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:15.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:15.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.055128744000001, 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:15.916 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.055058598000002, 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:15.920 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:15.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:15.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.054462565999998, 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:15.928 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.053936253000003, 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:15.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:15.932 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.036325859000002, 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:15.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.936 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 67.079880670999998, 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:15.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:15.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:15.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 42.077600930000003, 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:15.945 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:15.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:15.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:15.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:15.950 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:15.952 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:15.951+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:15.952 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:16.053 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:16.050+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:16.085 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:16.085 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:16.086 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:16.086 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:16.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:16.153 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.151+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:16.254 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.251+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:16.265 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:16.265 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:16.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:16.354 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.351+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:16.402 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.873967093999994, 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.403 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.408 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.873907148000001, 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.873766642000007, 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:16.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:16.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:16.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:16.420 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.873732532000005, 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:16.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:16.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.873697856000007, 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:16.426 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:16.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:16.431 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.873570817000001, 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:16.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:16.437 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.630490768000001, 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.442 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.630423628000003, 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:16.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:16.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.630276613000007, 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:16.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:16.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.630206633, 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:16.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:16.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.630145056999993, 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.465 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.630042653999993, 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629978945000005, 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:16.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:16.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:16.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629919762, 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629856269000001, 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629797992999997, 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:16.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:16.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:16.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:16.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629694180000001, 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.494 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:16.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629542911000001, 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:16.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:16.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629476706000005, 2024-04-25T23:00:16.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:16.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:16.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:16.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.629297676999997, 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:16.512 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:16.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:16.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.517 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:16.517 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:16.517 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:16.518 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:16.519 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.515+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:16.620 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.619+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:16.650 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:16.651 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:16.651 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:16.651 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:16.665 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:16.751 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.751+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:16.821 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.819+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:16.831 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:16.831 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:16.831 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:16.831 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:16.831 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:16.847 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:16.935 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:16.935+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:17.020 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.247890777999999, 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.021 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:17.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:17.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.247754088999997, 2024-04-25T23:00:17.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:17.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:17.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:17.033 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.247678112000003, 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:17.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.247578000000004, 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:17.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:17.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:17.045 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.247492003999994, 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:17.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.247424516999999, 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:17.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:17.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.247123486999996, 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:17.058 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:17.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:17.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.246742490000003, 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:17.062 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.246646366999997, 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.067 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.071 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.233457115999997, 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:17.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:17.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.231838804999995, 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.076 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.079 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.229651388999997, 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.229509575999998, 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.084 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:17.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.227023739000003, 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:17.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.226953593000005, 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.226357561, 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:17.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:17.100 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.225831248000006, 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:17.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:17.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 70.208220854000004, 2024-04-25T23:00:17.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:17.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 68.251775666, 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.109 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 43.249495924999998, 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:17.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:17.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:17.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:17.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:17.120 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:17.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:00:17.122 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:17.119+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:17.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:17.223 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:17.222+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:17.254 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:17.255 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:17.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:17.354 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:17.354+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:17.425 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:17.422+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:17.430 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:17.431 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:17.445 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:17.530 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:17.530+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:17.612 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.081711945999999, 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.613 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.618 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.081652000000005, 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.619 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:17.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:17.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.081511493999997, 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.625 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:17.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:17.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.081477383999996, 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:17.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.081442707999997, 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:17.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:17.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:17.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.081315669000006, 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.643 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:17.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.838235620000006, 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:17.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:17.654 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.838168479999993, 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:17.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:17.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:17.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:17.661 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.838021464999997, 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:17.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.667 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837951485000005, 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:17.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:17.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837889908999998, 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:17.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:17.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:17.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:17.678 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837787505999998, 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:17.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837723796999995, 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:17.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837664614000005, 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.695 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837601121000006, 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:17.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837542845000002, 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837439032000006, 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:17.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:17.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837287763000006, 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.714 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:17.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837221557999996, 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.837042529000001, 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:17.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:17.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:17.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:17.731 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:17.731 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:17.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:17.733 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:17.734 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:17.730+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:17.833 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:17.830+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:17.864 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:17.864 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:17.868 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:17.868 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:17.868 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:17.868 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:17.882 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:17.883 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:17.883 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:17.883 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:17.886 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:17.887 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:17.933 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:17.931+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.000 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:18.000 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:18.014 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:18.059 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.059+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:00:18.135 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.135+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.184 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:18.184 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:18.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:18.239 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.239+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.328 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:18.328 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:18.337 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.335+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.343 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:18.439 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.435+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.459 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:18.460 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:18.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:18.540 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.539+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.595 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:18.595 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:18.609 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:18.640 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:18.638+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:18.741 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.739+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.742 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:18.742 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:18.757 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:18.843 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:18.843+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:18.920 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:18.920 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:18.935 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:18.943 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:18.942+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:19.043 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:19.043+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:19.101 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:19.101 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:19.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:19.159 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:19.159+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:19.246 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:19.246 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:19.246 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:19.246+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:19.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:19.346 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:19.343+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:19.429 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:19.457 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:19.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:19.459 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:19.455+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:19.559 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:19.559+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:19.580 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:19.580 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:19.595 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:19.660 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:19.658+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:19.729 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:19.729 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:19.743 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:19.761 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:19.762+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:19.862 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:19.859+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:19.866 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:19.866 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:19.880 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:19.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:19.963 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:19.962+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:20.029 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:20.030 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:20.045 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:20.045 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:20.049 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:20.050 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:20.050 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:20.054 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:20.054 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:20.059 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:20.064 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:20.063+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:20.104 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:00:20.164 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:20.163+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:20.188 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:20.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:20.189 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:20.189 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:20.202 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:20.266 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:20.263+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:20.318 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:20.318 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:20.319 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:20.319 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:20.319 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:20.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:20.367 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:20.367+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:20.455 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:20.455 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.927073437000004, 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:20.456 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.927013490999997, 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.926872985000003, 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.467 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.926838875000001, 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.473 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:20.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:20.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:20.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:20.478 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.926804199000003, 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:20.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:20.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.926677159999997, 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.484 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:20.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683597110999997, 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:20.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:20.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683529970999999, 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.495 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:20.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683382956000003, 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683312975999996, 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:20.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:20.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:20.512 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683251400000003, 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:20.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:20.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683148997000004, 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:20.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:20.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683085288000001, 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:20.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.683026104999996, 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:20.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:20.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:20.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:20.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.682962611999997, 2024-04-25T23:00:20.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:20.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:20.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.682904336000007, 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:20.540 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.682800522999997, 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.546 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.682649253999998, 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.682583049000002, 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.558 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:20.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:20.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:20.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:20.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:20.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.682404020000007, 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:20.568 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:20.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:20.570 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:20.567+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:20.671 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:20.670+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:20.700 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:20.700 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:20.700 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:20.700 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:20.715 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:20.772 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:20.770+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:20.837 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:20.837 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:20.837 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:20.837 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:20.837 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:20.853 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:20.899 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:20.899+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:20.974 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.201220653999997, 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:20.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:20.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:20.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.980 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.201083964999995, 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:20.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:20.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:20.986 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.201007988000001, 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:20.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:20.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:20.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:20.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:20.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:20.993 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.200907876000002, 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:20.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:20.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:20.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:20.999 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.200821880000007, 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:21.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.005 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.200754392999997, 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:21.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.200453362999994, 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:21.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.200072366000001, 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:21.020 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.199976242999995, 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:21.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.186786991999995, 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.025 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:21.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:21.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.185168680999993, 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:21.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:21.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.182981264999995, 2024-04-25T23:00:21.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:21.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.182839451999996, 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:21.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.180353615000001, 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:21.045 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.180283469000003, 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:21.049 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.179687436999998, 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:21.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:21.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:21.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.179161124000004, 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:21.053 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 74.161550730000002, 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.061 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 72.205105541999998, 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:21.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:21.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 47.202825801000003, 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:21.067 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:21.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:21.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.072 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:21.073 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:21.073 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:21.073 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:20.971+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:21.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:21.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-04-25T23:00:21.075 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:21.074+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:21.086 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:00:21.176 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:21.174+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:21.198 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:21.198 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:21.198 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:21.199 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:21.212 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:21.277 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:21.275+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:21.378 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:21.378+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:21.381 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:21.381 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:21.381 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:21.382 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:21.382 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:21.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:21.479 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:21.479+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:21.562 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.033591231000003, 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.033531284999995, 2024-04-25T23:00:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.033390779000001, 2024-04-25T23:00:21.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:21.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:21.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:21.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:21.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.584 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.033356669, 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:21.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:21.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.033321993000001, 2024-04-25T23:00:21.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:21.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:21.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:21.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.033194953999995, 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.599 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:21.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:21.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:21.605 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.790114904999996, 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:21.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:21.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.790047764999997, 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:21.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789900750000001, 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:21.619 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:21.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:21.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:21.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:21.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789830769999995, 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:21.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:21.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:21.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:21.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789769194000002, 2024-04-25T23:00:21.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:21.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:21.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789666791000002, 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:21.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:21.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.649 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789603081999999, 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:21.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:21.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:21.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789543898999995, 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:21.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:21.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789480405999996, 2024-04-25T23:00:21.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:21.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:21.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.670 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789422130000005, 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:21.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:21.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.677 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789318316999996, 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.678 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:21.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:21.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789167047999996, 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.685 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:21.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.789100843, 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:21.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:21.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:21.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:21.699 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.788921814000005, 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:21.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:21.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:21.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:21.705 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:21.707 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:21.707 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:21.703+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:21.807 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:21.807+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:21.837 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:21.837 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:21.837 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:21.837 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:21.851 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:21.908 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:21.906+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:22.009 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:22.006+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:22.015 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:22.015 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:22.016 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:22.016 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:22.016 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:22.030 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:22.056 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:22.110 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:22.107+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:22.151 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:22.151 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:22.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:22.151 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.378572188999996, 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:22.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:22.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.378435499999995, 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:22.163 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.378359523, 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.378259411000002, 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:22.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:22.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.378173415000006, 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:22.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.378105927999997, 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:22.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:22.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.187 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.377804897999994, 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.188 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:22.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:22.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:22.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:22.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:22.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.193 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.377423901, 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.377327777999994, 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:22.198 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:22.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:22.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:22.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.364138526999994, 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.206 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.362520215999993, 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:22.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:22.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:22.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.360332799999995, 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:22.210 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:22.214 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.360190986999996, 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:22.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:22.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.218 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.357705150000001, 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:22.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.357635004000002, 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.357038971999998, 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.226 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:22.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.356512659000003, 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 75.338902265000002, 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.234 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:22.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 73.382457076999998, 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.242 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 48.380177336000003, 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:22.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:22.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:22.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:22.247 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.248 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.248 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.248 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:22.248 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:22.248 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:22.249 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:22.249 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:22.250 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:22.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:22.251 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:22.251 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:22.251 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:22.252 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:22.252 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:22.246+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:22.350 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:22.347+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:22.382 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:22.382 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:22.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:22.451 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:22.451+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:22.518 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:22.518 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:22.532 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:22.578 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:22.578+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:22.653 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:22.653 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:22.653 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:22.651+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:22.667 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:22.754 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:22.751+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:22.799 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:22.799 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:22.814 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:22.855 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:22.854+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:22.956 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:22.955+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:22.976 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:22.976 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:22.991 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:23.057 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:23.054+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:23.110 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:00:23.156 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:23.156 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:23.158 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.155+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.170 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:23.260 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.259+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.301 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:23.301 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:23.315 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:23.360 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.359+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.436 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:23.436 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:23.450 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:23.461 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.459+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.562 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.559+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.565 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:23.565 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:23.579 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:23.663 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.663+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.710 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:23.710 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:23.725 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:23.767 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.767+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.866 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.863+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:23.891 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:23.891 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:23.905 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:23.991 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:23.991+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:24.068 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:24.067+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:24.070 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:24.070 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:24.084 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:24.093 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:00:24.169 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:24.166+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:24.214 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:24.215 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:24.229 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:24.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:24.270 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:24.270+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:24.371 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:24.371+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:24.393 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:24.393 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:24.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:24.449 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:24.450 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:24.472 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:24.470+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:24.482 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:24.483 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:24.483 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:24.487 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:24.487 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:24.536 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.005789972000002, 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:24.537 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:24.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:24.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.005730025999995, 2024-04-25T23:00:24.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:24.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:24.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:24.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.005589520000001, 2024-04-25T23:00:24.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:24.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:24.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.005555409999999, 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:24.556 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:24.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:24.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.005520734000001, 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:24.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.005393694999995, 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:24.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:24.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.762313645999996, 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:24.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.762246505999997, 2024-04-25T23:00:24.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:24.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:24.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:24.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:24.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.762099491000001, 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:24.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:24.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.762029510999994, 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:24.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761967935000001, 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:24.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:24.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761865532000002, 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:24.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761801822999999, 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:24.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:24.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761742639999994, 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.616 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:24.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761679146999995, 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:24.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:24.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:24.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761620871000005, 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761517057999995, 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.637 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:24.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761365788999996, 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:24.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:24.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761299584, 2024-04-25T23:00:24.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:24.651 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.651 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.651 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:24.651 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:24.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:24.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:24.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.761120555000005, 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:24.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:24.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:24.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:24.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:24.663 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:24.665 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:24.665 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:24.662+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:24.765 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:24.763+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:24.796 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:24.796 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:24.796 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:24.796 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:24.810 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:24.900 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:24.899+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:24.967 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:24.966+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:24.971 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:24.971 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:24.972 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:24.972 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:24.972 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:24.985 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:25.068 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:25.066+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:25.155 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:25.155 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:25.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:25.155 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.382860269000005, 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:25.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.382723580000004, 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:25.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:25.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.382647602999995, 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.169 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.382547490999997, 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.175 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:25.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.382461495000001, 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.181 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:25.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.382394008000006, 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.187 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:25.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:25.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:25.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:25.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:25.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.382092978000003, 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.193 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.196 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.381711980999995, 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:25.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.201 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.381615858000004, 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:25.206 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.368426607000004, 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:25.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:25.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.210 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.366808296000002, 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:25.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.364620880000004, 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:25.218 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.364479067000005, 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.361993229999996, 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:25.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:25.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.361923083999997, 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:25.230 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.361327051999993, 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:25.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:25.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.360800738999998, 2024-04-25T23:00:25.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:25.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 78.343190344999996, 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 76.386745157000007, 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.242 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:25.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:25.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:25.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:25.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 51.384465415999998, 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:25.247 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:25.252 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:25.254 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:25.254 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:25.254+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:25.355 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:25.355+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:25.383 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:25.384 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:25.384 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:25.384 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:25.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:25.456 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:25.454+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:25.516 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:25.516 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:25.516 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:25.516 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:25.516 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:25.530 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:25.556 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:25.555+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:25.657 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:25.655+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:25.702 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.171306396999995, 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:25.708 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.171246451000002, 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.171105944999994, 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.714 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:25.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:25.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.719 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.171071835000006, 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:25.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.725 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.171037158999994, 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:25.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.170910120000002, 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:25.731 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:25.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:25.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:25.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927830071000002, 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:25.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:25.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:25.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:25.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927762931000004, 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927615915999993, 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927545936000001, 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927484359999994, 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927381956999994, 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927318248000006, 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927259065000001, 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927195572000002, 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927137295999998, 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.927033483000002, 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.926882214000003, 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.926816009000007, 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.926636979999998, 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:25.817 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:25.818 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:25.819 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:25.818+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:25.919 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:25.919+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:25.950 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:25.950 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:25.950 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:25.950 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:25.964 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:26.055 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:26.055+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:26.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:00:26.122 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:26.122+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:26.134 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:26.134 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:26.134 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:26.134 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:26.134 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:26.148 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:26.223 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:26.222+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.542282233999998, 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.315 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.316 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.317 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.318 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.319 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:26.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.542145544999997, 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.321 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.322 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.323 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.324 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:26.325 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.326 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.542069568000002, 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.327 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:26.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.330 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.331 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.332 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.541969456000004, 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.333 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.334 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.335 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.336 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:26.337 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.338 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.541883459999994, 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.340 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.343 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.344 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.541815972999999, 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:26.345 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.346 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:26.347 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:26.348 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.349 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.350 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.541514942999996, 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:26.351 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:26.352 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:26.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.541133946000002, 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.354 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:26.355 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:26.358 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.541037822999996, 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:26.359 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:26.360 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:26.361 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.362 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.527848571999996, 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.363 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.526230260999995, 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.367 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:26.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.370 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.524042844999997, 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.371 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:26.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:26.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.523901031999998, 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.375 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.376 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.521415195000003, 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.521345049000004, 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.520749017, 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.386 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.520222704000005, 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.390 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:26.394 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 79.502612310000004, 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:26.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:26.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 77.546167122, 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.398 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:26.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:26.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 52.543887380999998, 2024-04-25T23:00:26.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:26.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:26.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:26.408 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:26.410 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:26.410+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:26.410 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:26.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:26.510 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:26.510+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:26.556 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:26.611 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:26.607+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:26.687 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:26.687 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:26.712 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:26.710+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:26.720 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:26.720 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:26.721 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:26.723 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:26.724 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:26.724 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:26.725 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:26.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:26.812 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:26.811+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:26.905 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:26.905 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:26.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-04-25T23:00:26.914 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:26.914+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:26.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:27.014 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:27.011+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:27.050 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:27.050 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:27.064 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:27.111 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:00:27.119 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:27.114+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:27.217 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:27.213+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:27.229 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:27.230 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:27.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:27.319 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:27.317+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:27.362 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:27.362 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:27.376 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:27.420 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:27.419+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:27.507 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:27.508 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:27.521 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:27.519+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:27.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:27.622 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:27.621+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:27.643 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:27.643 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:27.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:27.746 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:27.745+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:27.822 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:27.822 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:27.822 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:27.819+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:27.835 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:27.924 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:27.921+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:27.969 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:27.969 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:27.985 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:28.031 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.031+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.107 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:28.108 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:28.122 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:28.163 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.163+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.226 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.223+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.287 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:28.287 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:28.301 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:28.343 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.343+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.428 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.427+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.433 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:28.433 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:28.449 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:28.528 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.527+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.570 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:28.571 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:28.584 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:28.629 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.627+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.705 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:28.705 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:28.718 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:28.726 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:28.730 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:28.729+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:28.831 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:28.829+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:28.850 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:28.850 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:28.866 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:28.928 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:28.929 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:28.931 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:28.931+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:28.961 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:28.962 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:28.962 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:28.965 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:28.966 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:28.991 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:28.991 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:28.992 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:28.992 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:28.992 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:29.005 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:29.051 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:29.051+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:29.133 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:00:29.134 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:29.131+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:29.178 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:29.178 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:29.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.405476961000005, 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.179 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.180 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:29.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:29.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:29.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:29.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:29.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.405340272000004, 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.188 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:29.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.194 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.405264294999995, 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:29.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:29.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:29.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:29.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.405164182999997, 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:29.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:29.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:29.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:29.208 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.405078187000001, 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:29.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:29.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.405010700000005, 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:29.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:29.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:29.220 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.404709670000003, 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:29.224 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.404328672999995, 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.229 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.404232550000003, 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:29.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:29.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.391043299000003, 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.389424988000002, 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:29.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:29.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:29.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:29.242 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.387237572000004, 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.387095759000005, 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.247 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:29.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:29.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.384609921999996, 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.255 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.384539775999997, 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:29.256 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:29.257 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:29.258 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.383943744000007, 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:29.259 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.383417430999998, 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.263 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:29.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.265 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 82.365807036999996, 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.268 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:29.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:29.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 80.409361849000007, 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.272 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:29.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:29.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.276 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:29.277 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 55.407082107999997, 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:29.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:29.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:29.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:29.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:29.283 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:29.283 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.283 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.283 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.283 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:29.283 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:29.283 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:29.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:29.285 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:29.281+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:29.385 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:29.381+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:29.416 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:29.416 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:29.416 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:29.417 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:29.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:29.522 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:29.521+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:29.587 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:29.585+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:29.598 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:29.613 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:29.706 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:29.705+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:29.784 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:29.784 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:29.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:29.784 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:29.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.255306200000007, 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.255246253999999, 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.255105748000005, 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:29.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:29.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:29.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:29.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.255071638000004, 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:29.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:29.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:29.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.255036962000005, 2024-04-25T23:00:29.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:29.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:29.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:29.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.254909923, 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:29.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:29.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:29.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:29.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011829874, 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:29.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:29.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.824 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011762734000001, 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:29.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:29.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:29.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:29.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011615719000005, 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:29.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:29.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.836 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011545738999999, 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:29.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:29.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011484163000006, 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:29.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011381760000006, 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.848 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:29.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011318051000003, 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:29.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:29.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:29.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:29.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011258867999999, 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:29.859 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:29.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:29.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:29.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011195375, 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:29.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:29.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011137098999995, 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:29.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:29.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.011033286, 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:29.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.883 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.010882017, 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:29.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:29.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:29.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:29.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.010815812000004, 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:29.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:29.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:29.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:29.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:29.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:29.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:29.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:29.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:29.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:29.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:29.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:29.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:29.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:29.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:29.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:29.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:29.899 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.899 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.900 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.900 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:29.900 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:29.900 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.010636782999995, 2024-04-25T23:00:29.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:29.901 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:29.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:29.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:29.901 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:29.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:29.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:29.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:29.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:29.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:29.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:29.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:29.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:29.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:29.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:29.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:29.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:29.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:29.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:29.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:29.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:29.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:29.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:29.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:29.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:29.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:29.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:29.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:29.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:29.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:29.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:29.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:29.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:29.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:29.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:29.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:29.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:29.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:29.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.911 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:29.911 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:29.912 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:29.914 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:29.915 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:29.911+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:30.014 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:30.013+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:30.045 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:30.045 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:30.045 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:30.045 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:30.059 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:00:30.115 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:30.111+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:30.181 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:30.181 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:30.181 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:30.181 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:30.181 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:30.197 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:30.216 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:30.213+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:30.317 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:30.315+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:30.363 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:30.363 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:30.363 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.592402665999998, 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:30.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.366 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.368 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.592265976999997, 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.370 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:30.371 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:30.372 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.375 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.592190000000002, 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.376 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.377 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:30.378 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:30.379 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:30.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.592089888000004, 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:30.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.592003891999994, 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:30.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:30.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:30.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.393 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.591936404999998, 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:30.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:30.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:30.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.591635374999996, 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.591254378000002, 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.591158254999996, 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.408 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.412 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.577969003999996, 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:30.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.576350692999995, 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:30.417 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.574163276999997, 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:30.422 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:30.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:30.424 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.574021463999998, 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.571535627000003, 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:30.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.433 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.571465481000004, 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.570869449, 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.437 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:30.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.570343136000005, 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:30.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 83.552732742000003, 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:30.445 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.448 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 81.596287554, 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 56.594007812999997, 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:30.454 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:30.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:30.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:30.459 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:30.461 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:30.461 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:30.461+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:30.562 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:30.559+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:30.593 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:30.593 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:30.593 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:30.593 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:30.607 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:30.663 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:30.661+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:30.723 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:30.724 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:30.724 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:30.724 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:30.724 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:30.737 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:30.782 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:30.781+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:30.864 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:30.863+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.378978912999997, 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:30.908 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:30.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.378918967000004, 2024-04-25T23:00:30.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:30.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:30.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:30.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.378778460999996, 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:30.920 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:30.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:30.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.378744350999995, 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.926 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:30.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.931 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.378709674999996, 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:30.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.378582636000004, 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.938 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:30.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:30.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.135502587000005, 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:30.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:30.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.135435447000006, 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.949 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:30.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.135288431999996, 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:30.955 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:30.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:30.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:30.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.135218452000004, 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:30.961 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:30.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:30.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.135156875999996, 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:30.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:30.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.135054472999997, 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.972 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:30.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:30.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:30.977 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134990763999994, 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:30.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.982 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134931581000004, 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134868088000005, 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:30.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:30.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:30.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134809812, 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:30.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:30.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:30.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:30.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:30.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134705999000005, 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:31.001 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:31.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134554730000005, 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134488524999995, 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.134309496, 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:31.025 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:31.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:31.027 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:31.027 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:31.025+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:31.128 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:31.125+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:31.160 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:31.160 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:31.175 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:31.225 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:31.225 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:31.228 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:31.227+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:31.260 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:31.260 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:31.260 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:31.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:31.264 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:31.295 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:31.296 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:31.311 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:31.329 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:31.325+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:31.430 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:31.429+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:31.476 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:31.476 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:31.490 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:31.534 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:31.533+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:31.622 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:31.622 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:31.631 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:31.629+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:31.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:31.732 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:31.731+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:31.794 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:31.795 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:31.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:31.833 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:31.831+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:31.924 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:31.924 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:31.933 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:31.931+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:31.937 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:32.034 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:32.031+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:32.068 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:32.068 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:32.082 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:32.141 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:00:32.167 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:32.167+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:32.237 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:32.235+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:32.238 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:32.238 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:32.254 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:32.341 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:32.339+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:32.420 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:32.420 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:32.435 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:32.439 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:32.437+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:32.539 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:32.537+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:32.564 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:32.564 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:32.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:32.666 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:32.665+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:32.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-04-25T23:00:32.740 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:32.737+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:32.744 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:32.744 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:32.758 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:32.846 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:32.845+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:32.919 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:32.919 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:32.932 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:32.979 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:32.979+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:33.043 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:33.041+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:33.062 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:33.062 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:33.076 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:33.126 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:00:33.163 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:33.163+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:33.244 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:33.244 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:33.245 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:33.243+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:33.258 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:33.265 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:33.346 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:33.345+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:33.423 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:33.423 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:33.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:33.446 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:33.443+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:33.462 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:33.496 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:33.500 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:33.501 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:33.546 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:33.545+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:33.563 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:33.563 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:33.563 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:33.563 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:33.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:33.647 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:33.647+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:33.739 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:33.739 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:33.739 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:33.739 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:33.739 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:33.748 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:33.747+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:33.753 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:33.849 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:33.847+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:33.871 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:33.871 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:33.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:33.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:33.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 95.342643002000003, 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:33.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 95.342583055999995, 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:33.877 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:33.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:33.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 95.342442550000001, 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:33.883 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 95.34240844, 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:33.889 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:33.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:33.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 95.342373764000001, 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 95.342246724999995, 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.901 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:33.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:33.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.906 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.099166675999996, 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.099099535999997, 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.912 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:33.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098952521000001, 2024-04-25T23:00:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:33.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:33.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098882540999995, 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:33.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:33.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098820965000002, 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:33.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:33.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:33.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098718562000002, 2024-04-25T23:00:33.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:33.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:33.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098654852999999, 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.941 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:33.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098595669999995, 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.952 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098532176999996, 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:33.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098473901000006, 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.959 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:33.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:33.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:33.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098370087999996, 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.965 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:33.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:33.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:33.971 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098218818999996, 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.977 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.098152614, 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:33.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:33.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.097973585000005, 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:33.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:33.988 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:33.990 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:33.990 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:33.989+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:34.090 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:34.087+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:34.123 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:34.123 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:34.123 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:34.123 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:34.137 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:34.223 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:34.223+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:34.292 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:34.289+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:34.301 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:34.301 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:34.301 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:34.301 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:34.302 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:34.315 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:34.392 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:34.389+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:34.479 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:34.479 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:34.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:34.479 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:34.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.479 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.706606218999994, 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:34.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:34.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.706469530000007, 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.486 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:34.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:34.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:34.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.706393552999998, 2024-04-25T23:00:34.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:34.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:34.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.498 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.706293441, 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:34.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:34.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.706207445000004, 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:34.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.511 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.706139957999994, 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:34.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:34.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.705838928000006, 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.518 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:34.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:34.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:34.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.705457930999998, 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:34.522 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:34.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:34.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.705361808000006, 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:34.527 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:34.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:34.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:34.531 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.692172557000006, 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:34.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:34.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:34.536 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.690554246000005, 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:34.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.688366830000007, 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.540 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.688225016999993, 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:34.544 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:34.548 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.685739179999999, 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:34.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:34.551 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.685669034, 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.552 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.553 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.554 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:34.555 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.685073001999996, 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:34.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:34.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.559 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.684546689000001, 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 87.666936294999999, 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 85.710491106999996, 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.567 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:34.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:34.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.572 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 60.708211366, 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:34.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:34.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:34.579 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:34.579 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:34.580 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:34.579+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:34.580 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:34.681 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:34.677+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:34.711 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:34.711 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:34.711 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:34.711 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:34.726 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:34.781 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:34.779+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:34.882 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:34.881+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:34.893 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:34.894 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:34.894 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:34.894 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:34.894 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:34.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:34.998 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:34.997+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:35.081 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:35.081 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.550573047, 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:35.082 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:35.087 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.550513101000007, 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:35.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.550372594999999, 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:35.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:35.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:35.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.550338484999997, 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:35.099 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:35.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.550303808999999, 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.550176769999993, 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:35.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.115 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.307096720999994, 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:35.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:35.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.307029580999995, 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:35.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:35.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:35.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306882565999999, 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:35.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:35.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306812586000007, 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:35.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:35.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.138 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306751009999999, 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:35.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306648607, 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306584897999997, 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306525715000006, 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306462221999993, 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306403946000003, 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306300132999993, 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306148863999994, 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.306082658999998, 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.305903630000003, 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:35.196 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:35.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:00:35.198 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:35.198 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:35.193+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:35.298 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:35.294+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:35.329 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:35.329 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:35.329 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:35.329 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:35.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:35.432 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:35.430+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:35.499 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:35.497+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:35.501 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:35.503 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:35.504 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:35.517 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:35.603 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:35.602+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:35.683 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:35.683 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:35.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:35.683 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.910906529000002, 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:35.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:35.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.689 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.91076984, 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:35.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.910693863000006, 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:35.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:35.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.701 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.910593750999993, 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:35.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:35.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:35.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.910507754999998, 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:35.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.910440268000002, 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:35.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:35.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:35.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.910139237999999, 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.719 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.909758241000006, 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.723 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:35.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.909662118, 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:35.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:35.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.896472867, 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.732 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.736 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.894854555999999, 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:35.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.89266714, 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.740 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:35.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:35.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:35.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.747 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.892525327000001, 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:35.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.890039490000007, 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.752 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:35.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:35.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.889969343999994, 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.756 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.759 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.889373312000004, 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:35.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.888846998999995, 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:35.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 88.871236605000007, 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:35.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 86.914791417000004, 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:35.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:35.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 61.912511676000001, 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:35.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:35.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:35.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:35.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:35.782 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.783 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.783 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.783 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:35.783 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:35.783 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:35.784 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:35.784 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:35.785 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:35.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:35.786 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:35.787 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:35.787 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:35.781+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:35.886 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:35.882+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:35.915 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:35.915 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:35.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:35.987 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:35.985+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:36.044 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:36.044 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:36.058 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:36.088 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:36.086+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:36.138 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:00:36.189 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:36.185+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:36.228 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:36.229 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:36.242 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:36.289 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:36.286+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:36.375 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:36.375 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:36.391 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:36.392 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:36.389+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:36.492 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:36.490+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:36.557 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:36.557 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:36.571 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:36.593 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:36.589+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:36.694 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:36.690+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:36.738 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:36.738 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:36.753 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:36.803 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:36.801+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:36.884 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:36.884 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:36.896 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:36.894+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:36.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:36.997 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:36.994+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:37.066 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:37.066 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:37.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:37.097 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:37.094+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:37.197 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:37.198 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:37.198 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:37.194+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:37.212 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:37.299 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:37.297+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:37.342 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:37.342 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:37.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:37.400 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:37.397+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:37.478 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:37.478 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:37.492 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:37.539 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:37.538+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:37.601 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:37.598+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:37.608 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:37.608 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:37.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:37.702 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:37.701+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:37.754 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:37.754 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:37.768 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:37.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:37.814 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:37.813+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:37.903 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:37.901+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:37.930 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:37.930 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:37.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:37.984 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:37.984 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:38.017 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:38.018 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:38.019 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:38.022 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:38.022 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:38.030 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:38.029+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:38.105 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:38.101+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 99.582924831, 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.114 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:38.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 99.582864885000006, 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:38.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:38.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.124 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 99.582724378999998, 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:38.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:38.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:38.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 99.582690268999997, 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:38.130 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:38.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:38.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 99.582655592999998, 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:38.136 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:38.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:38.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:38.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 99.582528554000007, 2024-04-25T23:00:38.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:38.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:38.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:38.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.339448505000007, 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:38.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.339381364999994, 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:38.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:38.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:38.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.339234349999998, 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.164 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.339164370000006, 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:38.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.339102793999999, 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:38.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:38.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:38.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.339000390999999, 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.175 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:38.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:38.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338936681999996, 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:38.180 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:38.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:38.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338877499000006, 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:38.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:38.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:38.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338814006000007, 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:38.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:38.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:38.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338755730000003, 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:38.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338651917000007, 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:38.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:38.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:38.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:38.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338500647999993, 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:38.209 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:38.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:38.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:38.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338434442999997, 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:38.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:38.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.338255414000002, 2024-04-25T23:00:38.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:38.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.225 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.226 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.226 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:38.226 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:38.226 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:38.226 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:00:38.228 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:38.229 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:38.225+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:38.329 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:38.329+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:38.360 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:38.360 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:38.360 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:38.360 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:38.374 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:38.429 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:38.426+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:38.491 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:38.491 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:38.491 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:38.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:38.491 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:38.505 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:38.547 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:38.546+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:38.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~64s 2024-04-25T23:00:38.632 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:38.629+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.900281211000006, 2024-04-25T23:00:38.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:38.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:38.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:38.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:38.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:38.679 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.900144522000005, 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:38.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.900068544999996, 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:38.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:38.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:38.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.691 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.899968432999998, 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:38.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:38.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:38.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:38.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.697 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.899882437000002, 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:38.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:38.703 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.899814950000007, 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:38.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:38.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:38.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:38.709 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.899513920000004, 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.899132922999996, 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:38.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:38.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:38.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.899036800000005, 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:38.718 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:38.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:38.722 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.885847549000005, 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:38.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:38.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.884229238000003, 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:38.727 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.730 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.882041822000005, 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:38.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:38.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:38.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.881900009000006, 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.879414171999997, 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.739 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:38.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.879344025999998, 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.743 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.746 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.878747993999994, 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:38.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.878221680999999, 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:38.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:38.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:38.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 91.860611286999998, 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:38.755 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:38.758 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 89.904166098999994, 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:38.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:38.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:38.764 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 64.901886357999999, 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:38.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:38.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:38.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:38.770 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.770 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.770 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.770 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:38.770 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:38.770 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:38.771 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:38.770+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:38.772 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:38.872 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:38.870+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:38.900 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:38.901 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:38.901 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:38.901 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:38.915 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:38.973 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:38.970+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:39.031 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:39.031 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:39.031 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:39.031 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:39.031 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:39.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:39.090 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:39.089+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.636743446, 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:39.166 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:39.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:39.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:39.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.6366835, 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:39.172 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:39.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.177 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.636542994, 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.63650888399999, 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:39.183 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.636474208, 2024-04-25T23:00:39.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:39.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:39.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:39.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:39.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.636347169, 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:39.194 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:39.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.199 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.393267120000004, 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:39.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.393199980000006, 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.210 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.393052964999995, 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392982985000003, 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392921408999996, 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392819005999996, 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392755296999994, 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392696114000003, 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392632621000004, 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392574345, 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392470532000004, 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392319263000005, 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392253057999994, 2024-04-25T23:00:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.392074029, 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:39.279 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:39.281 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:39.282 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:39.281+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:39.382 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:39.378+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:39.412 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:39.412 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:39.412 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:39.412 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:39.426 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:39.482 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:39.481+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:39.583 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:39.581+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:39.591 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:39.591 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:39.591 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:39.591 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:39.591 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:39.605 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:39.685 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:39.681+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.959953064999993, 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:39.731 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:39.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:39.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:39.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.959816376000006, 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.959740398999998, 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.743 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:39.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.959640286999999, 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.749 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.959554291000003, 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.755 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:39.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:39.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:39.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:39.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.959486803999994, 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:39.761 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:39.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:39.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:39.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:39.767 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.959185774000005, 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:39.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:39.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.770 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:39.771 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.958804776999997, 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:39.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:39.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:39.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.958708654000006, 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:39.780 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.945519403000006, 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.943901092000004, 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.785 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:39.788 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.941713676000006, 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:39.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.941571862999993, 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:39.793 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:39.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.939086025999998, 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:39.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:39.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.939015879999999, 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:39.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.938419847999995, 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.805 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:39.807 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:39.808 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.937893535000001, 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:39.809 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:39.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:39.812 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.813 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 92.920283140999999, 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.814 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:39.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 90.963837952999995, 2024-04-25T23:00:39.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:39.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.822 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 65.961558212, 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:39.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.825 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:39.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:39.828 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:39.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:39.830 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:39.825+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:39.931 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:39.929+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:39.958 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:39.958 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:39.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:40.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:40.032 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:40.030+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:40.133 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:40.130+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:40.134 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:40.135 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:40.148 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:40.221 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:40.233 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:40.230+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:40.254 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:40.255 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:40.255 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:40.257 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:40.258 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:40.265 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:40.265 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:40.279 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:40.334 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:40.333+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:40.409 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:40.409 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:40.423 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:40.436 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:40.433+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:40.536 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:40.534+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:40.545 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:40.545 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:40.559 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:40.636 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:40.633+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:40.719 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:40.720 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:40.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:40.736 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:40.734+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:40.838 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:40.834+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:40.863 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:40.863 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:40.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:40.939 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:40.937+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:40.999 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:40.999 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:41.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:41.039 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:41.038+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:41.141 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:41.138+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:41.176 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:41.177 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:41.191 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:41.241 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:41.238+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:41.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:00:41.321 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:41.321 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:41.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:41.342 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:41.341+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:41.443 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:41.441+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:41.496 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:41.496 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:41.510 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:41.544 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:41.541+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:41.633 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:41.634 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:41.645 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:41.645+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:41.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:41.746 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:41.745+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:41.779 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:41.780 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:41.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:41.882 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:41.881+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:41.948 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:41.946+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:41.961 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:41.961 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:41.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:42.062 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:42.061+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:42.143 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:42.143 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:42.150 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:42.149+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:42.156 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:42.159 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:00:42.251 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:42.249+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:42.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:42.289 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:42.289 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:42.303 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:42.352 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:42.349+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:42.405 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:42.405 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:42.420 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:42.420 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:42.425 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:42.426 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:42.426 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:42.428 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:42.429 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:42.434 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:42.479 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:42.478+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:42.553 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.781099194999996, 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.554 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:42.555 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:42.556 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:42.557 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.780962505999995, 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.560 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:42.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:42.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:42.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:42.566 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.780886529, 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:42.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:42.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.572 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.780786417000002, 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:42.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.578 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.780700421000006, 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:42.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:42.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:42.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:42.585 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.780632933999996, 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:42.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:42.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.780331903999993, 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.592 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:42.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.779950907, 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.596 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:42.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.779854783999994, 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.601 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:42.603 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:42.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.766665532999994, 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.606 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:42.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:42.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.765047222000007, 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:42.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.762859805999994, 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:42.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:42.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:42.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:42.620 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.762717992999995, 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.760232156000001, 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:42.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:42.628 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.760162010000002, 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:42.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:42.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.759565977999998, 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.632 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.759039665000003, 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:42.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:42.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 95.741429271000001, 2024-04-25T23:00:42.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 93.784984082999998, 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:42.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 68.782704342000002, 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:42.649 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:42.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:42.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:42.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:42.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:42.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:42.655 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.655 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.655 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.655 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:42.655 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:42.655 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:42.655 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:42.550+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:42.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:42.658 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:42.653+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:42.759 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:42.758+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:42.787 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:42.787 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:42.787 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:42.787 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:42.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:42.859 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:42.858+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'. 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T23:00:42.874 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T23:00:42.875 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at b22e2ebdeb2 Merge pull request #57078 from adk3798/squid-cephadm-no-downgrade 2024-04-25T23:00:42.878 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T23:00:42.884 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T23:00:42.888 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T23:00:42.888 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T23:00:42.925 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:42.925 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:42.925 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:42.925 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:42.925 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:42.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:42.961 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:42.958+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:43.062 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:43.057+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:43.064 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 104.53527195700001, 2024-04-25T23:00:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.067 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.067 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:43.067 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:43.067 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:43.067 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:43.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.068 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:43.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 104.535212011, 2024-04-25T23:00:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 104.535071505, 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 104.535037395, 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 104.535002719, 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 104.53487568, 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291795630999999, 2024-04-25T23:00:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291728491000001, 2024-04-25T23:00:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291581476000005, 2024-04-25T23:00:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291511495999998, 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291449920000005, 2024-04-25T23:00:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291347517000005, 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:43.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:43.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:43.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:43.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:43.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:43.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:43.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:43.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:43.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.184 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291283808000003, 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291224624999998, 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.190 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:43.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291161131999999, 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:43.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:43.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:43.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.291102855999995, 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:43.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:43.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:43.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:43.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.290999042999999, 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:43.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:43.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:43.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:43.213 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.290847774, 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:43.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:43.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:43.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:43.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:43.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.290781569000004, 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.225 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.290602539999995, 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:43.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:43.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:43.230 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:43.232 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:43.232 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:43.229+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:43.333 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:43.329+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:43.365 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:43.365 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:43.365 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:43.365 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:43.379 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:43.434 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:43.433+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:43.499 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:43.499 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:43.499 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:43.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:43.499 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:43.513 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:43.559 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:43.558+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:43.635 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T23:00:43.635 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:43.633+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:43.640 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:43.640 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:43.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:43.640 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:43.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.641 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.641 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:43.641 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.868263678000005, 2024-04-25T23:00:43.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:43.641 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.641 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:43.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:43.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:43.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.868126989000004, 2024-04-25T23:00:43.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:43.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:43.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:43.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.868051011999995, 2024-04-25T23:00:43.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:43.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:43.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:43.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.659 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.867950899999997, 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:43.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:43.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:43.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:43.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.665 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.867864904000001, 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:43.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:43.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.867797417000006, 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:43.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.677 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.867496387000003, 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:43.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:43.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:43.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.867115389999995, 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:43.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:43.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.867019267000003, 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.687 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:43.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:43.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.853830016000003, 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.692 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:43.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:43.696 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.852211705000002, 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:43.700 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.850024289000004, 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:43.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:43.704 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.849882476000005, 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:43.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:43.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.847396638999996, 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041229650000000001, 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.709 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790460+0000", 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790461+0000", 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2399999999999997e-07 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790469+0000", 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8329999999999994e-06 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790487+0000", 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8159999999999999e-05 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790508+0000", 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0449e-05 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794259+0000", 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037514010000000001 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794279+0000", 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9813000000000002e-05 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794583+0000", 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030448500000000001 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.713 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.847326492999997, 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00081593699999999998, 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790531+0000", 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.4000000000000001e-07 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790537+0000", 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4929999999999998e-06 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790558+0000", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.09e-05 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.790570+0000", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2464e-05 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791068+0000", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00049767599999999996 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791347+0000", 2024-04-25T23:00:43.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027876399999999998 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.846730461000007, 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003849861, 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:43.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791127+0000", 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791128+0000", 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1399999999999995e-07 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791135+0000", 2024-04-25T23:00:43.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791153+0000", 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7863000000000002e-05 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791169+0000", 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5616000000000001e-05 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794639+0000", 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034706630000000001 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794655+0000", 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5903e-05 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794977+0000", 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000321152 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.846204147999998, 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060492769999999996, 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791653+0000", 2024-04-25T23:00:43.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791654+0000", 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4500000000000001e-06 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791668+0000", 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3679999999999999e-05 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791696+0000", 2024-04-25T23:00:43.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7518999999999999e-05 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791715+0000", 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9556999999999999e-05 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791935+0000", 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022014499999999999 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791984+0000", 2024-04-25T23:00:43.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8402999999999997e-05 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797627+0000", 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056429929999999998 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797702+0000", 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5530000000000004e-05 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 96.828593753999996, 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00093277599999999996, 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809263+0000", 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809264+0000", 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2300000000000001e-07 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809271+0000", 2024-04-25T23:00:43.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5060000000000001e-06 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809288+0000", 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7980000000000001e-05 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809301+0000", 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2417e-05 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810016+0000", 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00071470500000000005 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810196+0000", 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180545 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T23:00:43.728 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 94.872148566000007, 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0033363970000000001, 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765709+0000", 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765711+0000", 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7429999999999998e-06 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765725+0000", 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3647e-05 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765758+0000", 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2889000000000003e-05 2024-04-25T23:00:43.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765774+0000", 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6123000000000001e-05 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.765930+0000", 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015641599999999999 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766133+0000", 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020307499999999999 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.766314+0000", 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018055799999999999 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.767683+0000", 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001369107 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768897+0000", 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012137269999999999 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.768979+0000", 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.2259e-05 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:08.769045+0000", 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5852999999999994e-05 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:43.733 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 69.869868824999998, 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028274530000000002, 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767988+0000", 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:43.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.767991+0000", 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8930000000000001e-06 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768006+0000", 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5291999999999999e-05 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768039+0000", 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2632999999999997e-05 2024-04-25T23:00:43.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768056+0000", 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7085e-05 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768225+0000", 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000168963 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768506+0000", 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000281231 2024-04-25T23:00:43.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.768915+0000", 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00040825900000000001 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770343+0000", 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0014279939999999999 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770635+0000", 2024-04-25T23:00:43.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029276399999999999 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770727+0000", 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1992999999999998e-05 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:33.770816+0000", 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8345999999999997e-05 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.738 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:43.739 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:43.739 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:43.740 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T23:00:43.740 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:43.741 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:43.737+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:43.799 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T23:00:43.800 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T23:00:43.800 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T23:00:43.841 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:43.838+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:43.851 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T23:00:43.855 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T23:00:43.855 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T23:00:43.871 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:43.872 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:43.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:43.901 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T23:00:43.902 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T23:00:43.902 DEBUG:teuthology.orchestra.run.smithi043:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T23:00:43.942 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:43.937+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:43.959 INFO:tasks.workunit.client.0.smithi043.stderr:+ mkdir -p fsstress 2024-04-25T23:00:43.962 INFO:tasks.workunit.client.0.smithi043.stderr:+ pushd fsstress 2024-04-25T23:00:43.963 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T23:00:43.964 INFO:tasks.workunit.client.0.smithi043.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T23:00:44.007 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:44.007 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:44.007 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:44.007 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:44.007 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:44.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:44.043 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:44.042+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:44.144 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:44.142+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:44.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:00:44.188 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:44.188 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:44.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:44.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:44.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.657422907, 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.189 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:44.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.657362961, 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:44.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:44.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:44.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.657222455, 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:44.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:44.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.65718834499999, 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:44.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:44.211 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.657153669, 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:44.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:44.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:44.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:44.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.217 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.65702663, 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:44.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:44.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:44.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:44.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:44.224 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413946581000005, 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:44.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:44.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:44.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413879441000006, 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.230 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:44.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:44.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413732425999996, 2024-04-25T23:00:44.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:44.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:44.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:44.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.242 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413662446000004, 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:44.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413600869999996, 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.248 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:44.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.253 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413498466999997, 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:44.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:44.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:44.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:44.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413434757999994, 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:44.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413375575000003, 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413312082000004, 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:44.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413253806, 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:44.279 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:44.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:44.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:44.285 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.413149993000005, 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:44.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:44.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:44.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:44.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.412998724000005, 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:44.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.412932518999995, 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:44.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:44.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.304 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.41275349, 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:44.309 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:44.311 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:44.312 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:44.309+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:44.412 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:44.410+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:44.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:44.440 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:44.441 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:44.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:44.441 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:44.456 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:44.492 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar xzf ltp-full.tgz 2024-04-25T23:00:44.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-04-25T23:00:44.514 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:44.509+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:44.588 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:44.588 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:44.614 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:44.615 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:44.615 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:44.615 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:44.613+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:44.617 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:44.618 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:44.634 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:44.634 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:44.649 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:44.715 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:44.713+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:44.778 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:44.779 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:44.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:44.816 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:44.814+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:44.918 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:44.913+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:44.932 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:44.932 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:44.947 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:45.019 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:45.018+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:45.120 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:45.117+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:45.123 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:45.123 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:45.139 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:45.183 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:00:45.221 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:45.218+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:45.313 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:45.313 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:45.322 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:45.318+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:45.328 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:45.423 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:45.418+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:45.464 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:45.464 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:45.479 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:45.523 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:45.521+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:45.624 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:45.621+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:45.663 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:45.664 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:45.680 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:45.727 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:45.726+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:45.801 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:45.801 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:45.817 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:45.859 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:45.858+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:45.926 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:45.925+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:45.955 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:45.956 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:45.970 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:46.062 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:46.061+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:46.127 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:46.126+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:46.160 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:46.228 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:46.226+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:46.329 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:46.325+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:46.331 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:46.331 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:46.345 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:46.430 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:46.426+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:46.481 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:46.481 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:46.496 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:46.531 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:46.529+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:46.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:46.631 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:46.630+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:46.662 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:46.662 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:46.678 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:46.732 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:46.728+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:46.797 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:46.797 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:46.818 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:46.819 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:46.819 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:46.822 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:46.822 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:46.832 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:46.828+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:46.850 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:46.850 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:46.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.079060591, 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:46.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.856 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.078923902, 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:46.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.858 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.862 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.07884792500001, 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.863 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:46.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:46.867 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:46.868 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.07874781300001, 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.869 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.870 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.874 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.078661817, 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:46.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.07859433, 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.881 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.0782933, 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.887 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:46.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:46.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:46.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:46.893 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.07791230300001, 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:46.894 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:46.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:46.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.07781618, 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:46.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:46.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:46.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.064626929, 2024-04-25T23:00:46.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:46.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.907 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.063008618, 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:46.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.911 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.060821202, 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:46.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 100.060679389, 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.916 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:46.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.3532810519999998, 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.015735954999999999, 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5 2024-04-25T23:00:46.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495376+0000", 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1599999999999998e-06 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502448+0000", 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0070718450000000002 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502469+0000", 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0712000000000001e-05 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502480+0000", 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1528e-05 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502579+0000", 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8845000000000007e-05 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502789+0000", 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000210151 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.510935+0000", 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0081456129999999995 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.510995+0000", 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9914000000000003e-05 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.511109+0000", 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114187 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:39 4.2e 4:7611a124:::1000000021e.00000000:head [write 0~2544] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.538515+0000", 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.3101387309999999, 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0074117779999999999, 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 39 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538515+0000", 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538515+0000", 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538516+0000", 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.78e-07 2024-04-25T23:00:46.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538522+0000", 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1149999999999999e-06 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538535+0000", 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2850999999999999e-05 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538543+0000", 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9349999999999994e-06 2024-04-25T23:00:46.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538593+0000", 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.9815999999999999e-05 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.538667+0000", 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4284999999999998e-05 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.545846+0000", 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0071789360000000003 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.545880+0000", 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.3420999999999997e-05 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.545927+0000", 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.7441000000000002e-05 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.930 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:52 4.1e 4:7a9d9b47:::1000000022b.00000000:head [write 0~1188] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.552131+0000", 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.296523412, 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0086449119999999994, 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 52 2024-04-25T23:00:46.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552131+0000", 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552131+0000", 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552132+0000", 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.145e-06 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552138+0000", 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3269999999999997e-06 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552154+0000", 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6324000000000002e-05 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552162+0000", 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7500000000000003e-06 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552222+0000", 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9778000000000003e-05 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552359+0000", 2024-04-25T23:00:46.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137014 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.552497+0000", 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013788 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.554475+0000", 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019778259999999998 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.560644+0000", 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.006169061 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.560712+0000", 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.8454999999999994e-05 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.560776+0000", 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3351999999999999e-05 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.936 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:53 4.36 4:6f746908:::1000000022c.00000000:head [write 0~3012] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.553285+0000", 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.2953688759999999, 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0076587970000000002, 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:46.937 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 53 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553285+0000", 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553285+0000", 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553287+0000", 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.024e-06 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553298+0000", 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0740000000000001e-05 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553327+0000", 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9492000000000002e-05 2024-04-25T23:00:46.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553348+0000", 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0509999999999998e-05 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553414+0000", 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6153000000000002e-05 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.553536+0000", 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012201699999999999 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.560785+0000", 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0072492399999999997 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.560851+0000", 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5368000000000002e-05 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.560944+0000", 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.3252999999999996e-05 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:82 4.3b 4:dd50df43:::10000000249.00000000:head [write 0~10843] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.583516+0000", 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.2651384889999999, 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089247289999999993, 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.942 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 82 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.583516+0000", 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.583516+0000", 2024-04-25T23:00:46.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.583517+0000", 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.886e-06 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.583541+0000", 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3646999999999999e-05 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.583569+0000", 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7912999999999999e-05 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.583599+0000", 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0113000000000001e-05 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.583731+0000", 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013210699999999999 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584025+0000", 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029332000000000002 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.592138+0000", 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0081132340000000004 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.592251+0000", 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113579 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.592440+0000", 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018893 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:83 4.29 4:94c02207:::1000000024a.00000000:head [write 0~2404] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.584538+0000", 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.2641163180000001, 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0077306190000000002, 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 83 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584538+0000", 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584538+0000", 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584539+0000", 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7099999999999999e-06 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584550+0000", 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.043e-05 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584575+0000", 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4692e-05 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584587+0000", 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2434e-05 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584660+0000", 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.2539999999999993e-05 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584779+0000", 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011945199999999999 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.584908+0000", 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012915800000000001 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.586721+0000", 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018124949999999999 2024-04-25T23:00:46.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.592172+0000", 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0054509950000000001 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.592225+0000", 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3161000000000001e-05 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.592268+0000", 2024-04-25T23:00:46.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3551999999999999e-05 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:86 4.9 4:915bff82:::1000000024d.00000000:head [write 0~3649] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.587232+0000", 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.26142178, 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0081363709999999999, 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:46.953 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 86 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587232+0000", 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587232+0000", 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:46.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587234+0000", 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7740000000000001e-06 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587245+0000", 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1113e-05 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587265+0000", 2024-04-25T23:00:46.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9922999999999999e-05 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587278+0000", 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2617e-05 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587345+0000", 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7299999999999996e-05 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.587460+0000", 2024-04-25T23:00:46.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114629 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.595237+0000", 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0077772400000000004 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.595294+0000", 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7541999999999999e-05 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:46.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.595369+0000", 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4233000000000006e-05 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:46.958 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:46.960 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:46.958+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:46.960 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:47.060 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:47.058+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:47.102 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:47.102 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:47.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.102 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:1350 4.18 4:18f1376d:::1000000082b.00000000:head [write 0~1943 in=1943b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:47.102 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:47.096666+0000", 2024-04-25T23:00:47.102 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0057818080000000003, 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058639219999999997, 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1350 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.096666+0000", 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.096666+0000", 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.096669+0000", 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5560000000000002e-06 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.096682+0000", 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3142999999999999e-05 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.096707+0000", 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4805999999999999e-05 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.096725+0000", 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8626000000000001e-05 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.096871+0000", 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014547799999999999 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.097067+0000", 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196739 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.097259+0000", 2024-04-25T23:00:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019189899999999999 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:47.098133+0000", 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087411400000000005 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-04-25T23:00:47.107 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:47.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:47.162 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:47.158+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:47.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:00:47.250 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:47.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:47.250 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:47.250 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:47.250 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:47.263 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:47.262+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:47.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:47.364 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:47.360+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:47.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 108.87808146899999, 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.417 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 108.878021523, 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.418 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:47.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 108.87788101699999, 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:47.424 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:47.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:47.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:47.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:47.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.429 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 108.87784690700001, 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:47.430 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:47.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:47.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 108.87781223100001, 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:47.436 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:47.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:47.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 108.877685192, 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:47.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.634605143, 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:47.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:47.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:47.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.634538003, 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.458 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:47.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:47.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.63439098800001, 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.470 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.634321008, 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:47.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:47.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.63425943199999, 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.63415702899999, 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.63409332000001, 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.634034137, 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.492 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:47.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.633970644, 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:47.498 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.633912368, 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.504 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:47.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:47.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.633808555, 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.633657286, 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:47.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:47.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:47.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:47.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.521 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.63359108100001, 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:47.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:47.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:47.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.633412052, 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:47.527 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:47.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:47.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:47.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:47.531 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:47.533 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:47.533 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:47.530+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:47.634 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:47.630+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1809 4.3f 4:fcc2fdbe:::10000000a13.00000000:head [write 0~2433 in=2433b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.674173+0000", 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00089247800000000004, 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000965934, 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:47.675 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1809 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674173+0000", 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674173+0000", 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674176+0000", 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6000000000000001e-06 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674188+0000", 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2159e-05 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674216+0000", 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8127e-05 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674234+0000", 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7963000000000001e-05 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674336+0000", 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000101903 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.674579+0000", 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024274799999999999 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1810 4.10 4:09d89442:::10000000a14.00000000:head [write 0~2446 in=2446b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.675057+0000", 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.85e-06, 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032423400000000001, 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:47.679 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1810 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.675057+0000", 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:47.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.675057+0000", 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.675059+0000", 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2069999999999998e-06 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.675072+0000", 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2680000000000001e-05 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:47.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.675107+0000", 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.5200000000000002e-05 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.675127+0000", 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9346000000000001e-05 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.675254+0000", 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012760199999999999 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:47.682 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:47.683 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:47.683 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:00:47.683 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 2 2024-04-25T23:00:47.683 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:47.693 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:47.735 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:47.732+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:47.836 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:47.834+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:47.873 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:47.873 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:47.873 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:47.873 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:47.873 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:47.888 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:47.937 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:47.932+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:48.038 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:48.036+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.294435714, 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.068 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:48.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.294299025, 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.074 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:48.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:48.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.29422304800001, 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.080 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.29412293599999, 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.086 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:48.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.092 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.29403694, 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:48.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.098 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.293969453, 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:48.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.104 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.293668423, 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.29328742600001, 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:48.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.293191303, 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:48.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:48.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.117 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.280002052, 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.121 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.278383741, 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:48.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:48.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.276196325, 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:48.125 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:48.129 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 101.276054512, 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:48.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:48.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.133 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.5686561750000001, 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.015735954999999999, 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5 2024-04-25T23:00:48.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495376+0000", 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1599999999999998e-06 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502448+0000", 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0070718450000000002 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502469+0000", 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0712000000000001e-05 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502480+0000", 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1528e-05 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502579+0000", 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8845000000000007e-05 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502789+0000", 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000210151 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.510935+0000", 2024-04-25T23:00:48.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0081456129999999995 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.510995+0000", 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9914000000000003e-05 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.511109+0000", 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114187 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:1368 4.2b e47/17 4:d4a2d842:::10000000843.00000000:head v 47'30, mlcod=47'28)", 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.129907+0000", 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.93412172299999996, 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0097255150000000005, 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129907+0000", 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129907+0000", 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129909+0000", 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7400000000000001e-06 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129932+0000", 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2603e-05 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129960+0000", 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8683e-05 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129975+0000", 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4153e-05 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.130113+0000", 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013791899999999999 2024-04-25T23:00:48.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.130149+0000", 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6236999999999999e-05 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.139527+0000", 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093780809999999999 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.139633+0000", 2024-04-25T23:00:48.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106099 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1369 4.16 4:688a6845:::10000000844.00000000:head [write 0~1059] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.131009+0000", 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.93302027600000004, 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0095379990000000001, 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:48.143 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1369 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131009+0000", 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131009+0000", 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131011+0000", 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.663e-06 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131021+0000", 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0159999999999999e-05 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131046+0000", 2024-04-25T23:00:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4870000000000001e-05 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131059+0000", 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3823e-05 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131160+0000", 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000101079 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131361+0000", 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000200428 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131563+0000", 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000202115 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.132735+0000", 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001171966 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.140374+0000", 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0076394000000000002 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.140453+0000", 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8789999999999996e-05 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.140547+0000", 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.3704999999999998e-05 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.148 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1432 4.21 4:87794692:::10000000889.00000000:head [write 0~2483] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.245760+0000", 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.81826959200000005, 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010373828, 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1432 2024-04-25T23:00:48.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245760+0000", 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245760+0000", 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245762+0000", 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3130000000000001e-06 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245774+0000", 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2067e-05 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245801+0000", 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6593000000000001e-05 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245817+0000", 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6840000000000001e-05 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245971+0000", 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015409500000000001 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.246210+0000", 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000238941 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.255863+0000", 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0096528589999999997 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.256015+0000", 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000152058 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.256133+0000", 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118062 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.153 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1439 4.21 4:87a3ca55:::10000000890.00000000:head [write 0~2486] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.254286+0000", 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.80974346699999999, 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0092810189999999997, 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1439 2024-04-25T23:00:48.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254286+0000", 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254286+0000", 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254288+0000", 2024-04-25T23:00:48.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2699999999999999e-06 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254300+0000", 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1764e-05 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254354+0000", 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4032e-05 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254369+0000", 2024-04-25T23:00:48.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5509999999999999e-05 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254579+0000", 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000209858 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.254862+0000", 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00028326499999999999 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.263364+0000", 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0085015779999999992 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.263449+0000", 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5142999999999994e-05 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.263567+0000", 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117599 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.158 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1575 4.7 4:e04170ef:::10000000923.00000000:head [write 0~2468] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.417862+0000", 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.64616685500000004, 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009747894, 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1575 2024-04-25T23:00:48.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417862+0000", 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417862+0000", 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417865+0000", 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3530000000000002e-06 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417878+0000", 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3324e-05 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417904+0000", 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6115999999999999e-05 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417918+0000", 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3499999999999999e-05 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.418048+0000", 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013027899999999999 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.418394+0000", 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00034600599999999999 2024-04-25T23:00:48.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.427232+0000", 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0088381899999999992 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.427393+0000", 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016068500000000001 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.427610+0000", 2024-04-25T23:00:48.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00021744099999999999 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:60 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.782415+0000", 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.28161369000000003, 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012707204, 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:48.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782415+0000", 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782415+0000", 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782417+0000", 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1820000000000001e-06 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782648+0000", 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023170600000000001 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782664+0000", 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5585000000000001e-05 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782670+0000", 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1029999999999998e-06 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782716+0000", 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.5739999999999999e-05 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782769+0000", 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3321e-05 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.785292+0000", 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002522977 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.787860+0000", 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00256836 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.795065+0000", 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0072049870000000004 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.795098+0000", 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2722000000000003e-05 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:48.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.795123+0000", 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4521000000000001e-05 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:48.169 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:48.171 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:48.171 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:48.168+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:00:48.272 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:48.270+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:48.310 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:2271 4.18 4:1b1d6e7c:::10000000c31.00000000:head [write 0~18257 in=18257b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-25T23:00:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:48.308102+0000", 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.002604164, 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026661190000000002, 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2271 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308102+0000", 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308102+0000", 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308104+0000", 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.857e-06 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308145+0000", 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0883999999999997e-05 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308169+0000", 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3830000000000001e-05 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308181+0000", 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2174000000000001e-05 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308302+0000", 2024-04-25T23:00:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121193 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.308643+0000", 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034095700000000002 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.309022+0000", 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037868599999999999 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310718+0000", 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001696225 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:2273 4.34 4:2c01daa2:::10000000c33.00000000:head [write 0~609 in=609b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:48.310099+0000", 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.000607702, 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081005400000000005, 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2273 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310099+0000", 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310099+0000", 2024-04-25T23:00:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310100+0000", 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7999999999999999e-06 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310110+0000", 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9890000000000004e-06 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310135+0000", 2024-04-25T23:00:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4263000000000001e-05 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310149+0000", 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310286+0000", 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013710799999999999 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:48.310663+0000", 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037715300000000003 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 2 2024-04-25T23:00:48.319 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:48.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:48.372 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:48.370+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:48.455 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:48.455 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:48.455 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:48.455 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:48.455 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:48.470 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:48.472 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:48.470+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:48.573 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:48.570+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:48.597 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:48.597 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:48.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 110.066806083, 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:48.598 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 110.066746137, 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 110.066605631, 2024-04-25T23:00:48.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 110.066571521, 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.615 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:48.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:48.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 110.066536845, 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.621 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:48.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:48.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 110.066409806, 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:48.626 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:48.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.823329757, 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.823262617, 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.637 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:48.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.823115602, 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.643 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:48.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:48.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.823045622, 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.822984046, 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:48.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.822881643, 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.661 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:48.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:48.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:48.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:48.666 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.822817934, 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.671 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.82275875099999, 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:48.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:48.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.677 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.822695258, 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.82263698200001, 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:48.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:48.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:48.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:48.689 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.822533169, 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:48.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:48.695 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.8223819, 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:48.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:48.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:48.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:48.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.822315695, 2024-04-25T23:00:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:48.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:48.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:48.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:48.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:48.707 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 101.82213666600001, 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:48.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:48.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:48.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:48.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:48.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:48.712 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:48.712 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:48.714 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:48.710+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:48.814 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:48.810+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:48.822 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:48.850 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:48.850 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:48.851 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:48.851 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:48.865 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:48.915 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:48.912+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:48.998 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:48.998 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:49.016 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:49.014+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:49.022 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:49.022 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:49.025 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:49.025 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:49.043 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:49.043 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:49.059 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:49.147 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:49.146+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:49.217 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:49.214+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:49.236 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:49.236 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:49.252 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:49.318 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:49.314+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:49.395 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:49.395 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:49.410 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:49.419 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:49.418+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:49.520 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:49.518+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:49.537 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:49.537 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:49.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:49.621 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:49.616+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:49.677 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:49.677 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:49.693 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:49.739 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:49.738+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:49.823 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:49.820+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:49.838 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:49.838 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:49.853 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:49.923 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:49.920+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:50.024 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:50.022+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:50.031 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:50.032 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:50.049 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:50.135 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:50.134+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:50.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:00:50.218 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:50.218 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:50.226 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:50.222+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:50.234 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:50.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-04-25T23:00:50.327 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:50.324+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:50.378 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:50.379 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:50.394 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:50.439 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:50.436+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:50.529 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:50.526+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:50.566 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:50.566 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:50.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:50.630 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:50.626+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:50.712 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:50.713 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:50.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:50.731 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:50.728+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:50.832 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:50.830+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:50.874 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:50.874 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:50.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:50.935 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:50.934+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:51.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:51.034 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.028+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:51.070 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:51.070 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:51.086 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:51.134 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:51.130+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:51.177 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:51.198 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:00:51.206 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:51.207 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:51.210 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:51.210 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:51.212 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:51.212 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:51.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:51.212 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:51.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.212 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.44085275, 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038802807000000002, 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769593+0000", 2024-04-25T23:00:51.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769597+0000", 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.05e-06 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769610+0000", 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3757000000000001e-05 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769637+0000", 2024-04-25T23:00:51.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6353e-05 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769667+0000", 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.0003999999999999e-05 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770010+0000", 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000343207 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770026+0000", 2024-04-25T23:00:51.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5835999999999999e-05 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774458+0000", 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0044322620000000002 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774710+0000", 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025241499999999997 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774918+0000", 2024-04-25T23:00:51.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207302 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776741+0000", 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0018236260000000001 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808195+0000", 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.031454126999999998 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808294+0000", 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8336000000000002e-05 2024-04-25T23:00:51.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808396+0000", 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000102532 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.440716061, 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024836265, 2024-04-25T23:00:51.218 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769730+0000", 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769732+0000", 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.547e-06 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769742+0000", 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8130000000000007e-06 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769763+0000", 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1537000000000001e-05 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769780+0000", 2024-04-25T23:00:51.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7337e-05 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770176+0000", 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00039610300000000003 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770195+0000", 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8957000000000002e-05 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774825+0000", 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046295099999999999 2024-04-25T23:00:51.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775079+0000", 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000254035 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775328+0000", 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00024925499999999998 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.779672+0000", 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043432890000000002 2024-04-25T23:00:51.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794294+0000", 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.014622487 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794460+0000", 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165959 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794566+0000", 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106436 2024-04-25T23:00:51.223 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.44064008399999, 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039607593000000003, 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769806+0000", 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769807+0000", 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769844+0000", 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6603000000000002e-05 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769865+0000", 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1103000000000001e-05 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769880+0000", 2024-04-25T23:00:51.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5174000000000001e-05 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770223+0000", 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000342994 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770235+0000", 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1912999999999999e-05 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.775923+0000", 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0056875019999999997 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776075+0000", 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015224600000000001 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776255+0000", 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000180185 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783620+0000", 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0073644729999999999 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809203+0000", 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025583343000000001 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809286+0000", 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3225000000000004e-05 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809414+0000", 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000127596 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.440539972, 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.02505433, 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.230 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769906+0000", 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769908+0000", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.367e-06 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769933+0000", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5789999999999999e-05 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769952+0000", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8969000000000001e-05 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769972+0000", 2024-04-25T23:00:51.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9599999999999999e-05 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770263+0000", 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029148800000000001 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770278+0000", 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4887e-05 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776399+0000", 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061206780000000001 2024-04-25T23:00:51.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776578+0000", 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178939 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776811+0000", 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023312800000000001 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783665+0000", 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0068535139999999998 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794671+0000", 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011006452 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794856+0000", 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000185262 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.794961+0000", 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000104256 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.440453976, 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039860001999999999, 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.236 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769992+0000", 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.769994+0000", 2024-04-25T23:00:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.327e-06 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770001+0000", 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770022+0000", 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.073e-05 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770041+0000", 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9015999999999999e-05 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770313+0000", 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027179800000000002 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770323+0000", 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0563e-05 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776855+0000", 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0065320700000000001 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777033+0000", 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000178145 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777212+0000", 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017810499999999999 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.783679+0000", 2024-04-25T23:00:51.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0064673170000000002 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809562+0000", 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.025883546 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809731+0000", 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016903299999999999 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809852+0000", 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120732 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.44038648900001, 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.038869134999999999, 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.242 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770060+0000", 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770061+0000", 2024-04-25T23:00:51.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770068+0000", 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.593e-06 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770086+0000", 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.732e-05 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770100+0000", 2024-04-25T23:00:51.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3956e-05 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771515+0000", 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001415543 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771528+0000", 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3226e-05 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772268+0000", 2024-04-25T23:00:51.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00073972800000000004 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772505+0000", 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023722500000000001 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.772867+0000", 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000361314 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.776584+0000", 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037170440000000001 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808759+0000", 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032174957999999997 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808829+0000", 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0426999999999995e-05 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.808929+0000", 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9745000000000001e-05 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.440085459, 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039337048999999999, 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:51.248 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770361+0000", 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770363+0000", 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7969999999999999e-06 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770371+0000", 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8459999999999997e-06 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770676+0000", 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030412499999999998 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770703+0000", 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7613000000000001e-05 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774274+0000", 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035705189999999999 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774602+0000", 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000328747 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.809698+0000", 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.035095401999999998 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.251 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.43970446199999, 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039437967999999997, 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770742+0000", 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770744+0000", 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1299999999999999e-06 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770754+0000", 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0627e-05 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770779+0000", 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.459e-05 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770795+0000", 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6305999999999999e-05 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771120+0000", 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032475400000000001 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771132+0000", 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1867e-05 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777749+0000", 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066173350000000002 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.777913+0000", 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000163642 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.255 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.810180+0000", 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032266717 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.439608339, 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020492525000000001, 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.256 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770838+0000", 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770839+0000", 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.497e-06 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.257 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770853+0000", 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3923e-05 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770875+0000", 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1503000000000001e-05 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.770892+0000", 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7635999999999999e-05 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.258 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771749+0000", 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00085643399999999999 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op must wait for map", 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.771764+0000", 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4943000000000001e-05 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.773776+0000", 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002012458 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.259 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.774040+0000", 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000263575 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.791330+0000", 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017290555999999999 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.426419088, 2024-04-25T23:00:51.260 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012045853, 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784027+0000", 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.261 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784028+0000", 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4600000000000003e-07 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784089+0000", 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0609999999999997e-05 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784115+0000", 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5910000000000001e-05 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.262 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.784136+0000", 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1526e-05 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786536+0000", 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002400265 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786580+0000", 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.405e-05 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.263 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795983+0000", 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009402334 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.796073+0000", 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0211999999999996e-05 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.424800777, 2024-04-25T23:00:51.264 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.01035376, 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785645+0000", 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.265 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785647+0000", 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.203e-06 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.785663+0000", 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6206999999999999e-05 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786047+0000", 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038410400000000002 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.266 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786120+0000", 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3452000000000001e-05 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.786505+0000", 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00038462000000000001 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.795999+0000", 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094941739999999993 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.267 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.422613361, 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093424419999999994, 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:51.268 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787833+0000", 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787834+0000", 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.22e-06 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787846+0000", 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1734e-05 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.269 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787866+0000", 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0305999999999998e-05 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787884+0000", 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7914000000000002e-05 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788628+0000", 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00074433400000000003 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.270 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788679+0000", 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0315999999999997e-05 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797091+0000", 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0084126119999999999 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797175+0000", 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4005999999999995e-05 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.271 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 104.422471548, 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0094828429999999995, 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.272 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787975+0000", 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787976+0000", 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.13e-06 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.787997+0000", 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1583e-05 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.788971+0000", 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00097401200000000001 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789088+0000", 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000116779 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789452+0000", 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00036420799999999998 2024-04-25T23:00:51.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.789495+0000", 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2376000000000002e-05 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797360+0000", 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0078650790000000005 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T22:59:06.797457+0000", 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7676000000000005e-05 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.275 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 6.715073211, 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.015735954999999999, 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5 2024-04-25T23:00:51.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495373+0000", 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.277 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.495376+0000", 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1599999999999998e-06 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502448+0000", 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0070718450000000002 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502469+0000", 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0712000000000001e-05 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.278 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502480+0000", 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1528e-05 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502579+0000", 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8845000000000007e-05 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.502789+0000", 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000210151 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.279 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.510935+0000", 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0081456129999999995 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.510995+0000", 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9914000000000003e-05 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:44.511109+0000", 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114187 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.280 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:1368 4.2b e47/17 4:d4a2d842:::10000000843.00000000:head v 47'30, mlcod=47'28)", 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.129907+0000", 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.0805387590000004, 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0097255150000000005, 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129907+0000", 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.281 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129907+0000", 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129909+0000", 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7400000000000001e-06 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129932+0000", 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2603e-05 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.282 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129960+0000", 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8683e-05 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.129975+0000", 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4153e-05 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.130113+0000", 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013791899999999999 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.283 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.130149+0000", 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.6236999999999999e-05 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.139527+0000", 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0093780809999999999 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.139633+0000", 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106099 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.284 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1369 4.16 4:688a6845:::10000000844.00000000:head [write 0~1059] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.131009+0000", 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.0794373119999996, 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0095379990000000001, 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1369 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.285 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131009+0000", 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131009+0000", 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131011+0000", 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.663e-06 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.286 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131021+0000", 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0159999999999999e-05 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131046+0000", 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4870000000000001e-05 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131059+0000", 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3823e-05 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.287 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131160+0000", 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000101079 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131361+0000", 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000200428 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.131563+0000", 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000202115 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.288 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.132735+0000", 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001171966 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.140374+0000", 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0076394000000000002 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.140453+0000", 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8789999999999996e-05 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.140547+0000", 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.3704999999999998e-05 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1432 4.21 4:87794692:::10000000889.00000000:head [write 0~2483] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.245760+0000", 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.9646866279999999, 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010373828, 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1432 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245760+0000", 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245760+0000", 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.291 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245762+0000", 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3130000000000001e-06 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245774+0000", 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2067e-05 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245801+0000", 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6593000000000001e-05 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.292 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245817+0000", 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6840000000000001e-05 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.245971+0000", 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015409500000000001 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.246210+0000", 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000238941 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.293 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.255863+0000", 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0096528589999999997 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.256015+0000", 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000152058 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.256133+0000", 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118062 2024-04-25T23:00:51.294 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:1575 4.7 4:e04170ef:::10000000923.00000000:head [write 0~2468] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.417862+0000", 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.792583891, 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.009747894, 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 1575 2024-04-25T23:00:51.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417862+0000", 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417862+0000", 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.296 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417865+0000", 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3530000000000002e-06 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417878+0000", 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3324e-05 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417904+0000", 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6115999999999999e-05 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.297 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.417918+0000", 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3499999999999999e-05 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.418048+0000", 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013027899999999999 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.418394+0000", 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00034600599999999999 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.298 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.427232+0000", 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0088381899999999992 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.427393+0000", 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016068500000000001 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.427610+0000", 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00021744099999999999 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:60 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:47.782415+0000", 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.4280307259999998, 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.012707204, 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782415+0000", 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.300 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782415+0000", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782417+0000", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1820000000000001e-06 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782648+0000", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023170600000000001 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782664+0000", 2024-04-25T23:00:51.301 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5585000000000001e-05 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782670+0000", 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1029999999999998e-06 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782716+0000", 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.5739999999999999e-05 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.302 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.782769+0000", 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3321e-05 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.785292+0000", 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.002522977 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.787860+0000", 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00256836 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.303 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.795065+0000", 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0072049870000000004 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.795098+0000", 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2722000000000003e-05 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:47.795123+0000", 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4521000000000001e-05 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.304 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:61 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:48.786592+0000", 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 2.4238541270000002, 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010206645, 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786592+0000", 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786592+0000", 2024-04-25T23:00:51.305 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786594+0000", 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-06 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786701+0000", 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010712700000000001 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786720+0000", 2024-04-25T23:00:51.306 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9094e-05 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786735+0000", 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4788e-05 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786831+0000", 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5783000000000001e-05 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.786938+0000", 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000107329 2024-04-25T23:00:51.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.790124+0000", 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031855239999999999 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.793546+0000", 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034221920000000001 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.796731+0000", 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031847849999999999 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.308 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.796770+0000", 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.9654999999999999e-05 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:48.796799+0000", 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8504e-05 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:51.309 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:51.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:51.312 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.308+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:51.411 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.408+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:51.450 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:51.450 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:51.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.450 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:4890 4.a 4:52e00728:::100000016f2.00000000:head [write 0~2672 in=2672b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:51.450 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:51.448146+0000", 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0025135790000000002, 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002533258, 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 4890 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448146+0000", 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448146+0000", 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448148+0000", 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0200000000000001e-06 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448162+0000", 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3787e-05 2024-04-25T23:00:51.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448192+0000", 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9986000000000001e-05 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448211+0000", 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9055e-05 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448293+0000", 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2663999999999993e-05 2024-04-25T23:00:51.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448419+0000", 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012565800000000001 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.448543+0000", 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012442700000000001 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:51.449432+0000", 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00088902700000000002 2024-04-25T23:00:51.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.455 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.455 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:00:51.455 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-04-25T23:00:51.455 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:51.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:51.550 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.548+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:51.613 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.608+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:51.643 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:51.643 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:51.643 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:51.643 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:51.643 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:51.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:51.743 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.740+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:51.814 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.808+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:51.835 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 113.303400658, 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:51.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:51.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 113.30334071199999, 2024-04-25T23:00:51.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:51.847 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 113.303200206, 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:51.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 113.303166096, 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:51.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:51.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:51.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 113.30313142, 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:51.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:51.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 113.30300438099999, 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:51.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:51.870 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.05992433199999, 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:51.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:51.875 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.059857192, 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:51.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:51.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:51.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.059710177, 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:51.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.886 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.05964019699999, 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:51.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:51.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:51.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.059578621, 2024-04-25T23:00:51.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:51.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:51.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.059476218, 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:51.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:51.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:51.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.059412509, 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.05935332599999, 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:51.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:51.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.05928983299999, 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.914 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:51.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:51.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.059231557, 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:51.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.05912774399999, 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:51.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:51.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:51.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.05897647499999, 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.933 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:51.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:51.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:51.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:51.939 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.05891027, 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:51.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:51.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:51.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:51.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.945 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 105.058731241, 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:51.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:51.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:51.950 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:51.952 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:51.953 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:51.948+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:52.053 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:52.050+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:52.095 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:52.095 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5497 4.37 4:edcbc108:::1000000195b.00000000:head [write 0~2746 in=2746b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:52.091100+0000", 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0039518770000000003, 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040079629999999998, 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:52.096 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5497 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091100+0000", 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091100+0000", 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091101+0000", 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.065e-06 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091107+0000", 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0970000000000002e-06 2024-04-25T23:00:52.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091121+0000", 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4241e-05 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091131+0000", 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9049999999999992e-06 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091240+0000", 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010900699999999999 2024-04-25T23:00:52.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091479+0000", 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023909499999999999 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:5496 4.18 e49/17 4:1b4ec18a:::1000000195a.00000000:head v 49'102, mlcod=49'100)", 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:52.091146+0000", 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0039061410000000001, 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040928700000000002, 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.100 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091146+0000", 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091146+0000", 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091147+0000", 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2470000000000001e-06 2024-04-25T23:00:52.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091159+0000", 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1806e-05 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091184+0000", 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5032999999999999e-05 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091200+0000", 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6347000000000001e-05 2024-04-25T23:00:52.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091270+0000", 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0412000000000003e-05 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.091289+0000", 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9021e-05 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5498 4.21 4:87395072:::1000000195c.00000000:head [write 0~2129 in=2129b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:52.092120+0000", 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0029316730000000001, 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003213034, 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5498 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092120+0000", 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092120+0000", 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092121+0000", 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4799999999999997e-07 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092127+0000", 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0959999999999997e-06 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092147+0000", 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9817999999999999e-05 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092156+0000", 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.952e-06 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092289+0000", 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013298100000000001 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.092502+0000", 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00021293500000000001 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:5499 4.30 e49/17 4:0e310a48:::1000000195d.00000000:head v 49'97, mlcod=49'95)", 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:52.093845+0000", 2024-04-25T23:00:52.107 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.001207046, 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001624913, 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093845+0000", 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093845+0000", 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093845+0000", 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.61e-07 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093854+0000", 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1550000000000007e-06 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093866+0000", 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2839e-05 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093873+0000", 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.8680000000000001e-06 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093946+0000", 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.2559999999999996e-05 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.093980+0000", 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.3926e-05 2024-04-25T23:00:52.110 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5500 4.0 4:010bf2b9:::1000000195e.00000000:head [write 0~605 in=605b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:52.094020+0000", 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0010318809999999999, 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015846600000000001, 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:52.111 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5500 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094020+0000", 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094020+0000", 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094021+0000", 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5499999999999996e-07 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094026+0000", 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.9880000000000004e-06 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094037+0000", 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1137e-05 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094045+0000", 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8800000000000008e-06 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094114+0000", 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9276000000000006e-05 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094315+0000", 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000201168 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:52.094552+0000", 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00023664199999999999 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 5 2024-04-25T23:00:52.115 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:52.116 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:52.154 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:52.152+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:52.255 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:52.252+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:52.286 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:52.286 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:52.286 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:52.286 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:52.287 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:52.300 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:52.357 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:52.352+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:52.425 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56995921800000005, 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:00:52.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:00:52.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.431 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56988487899999996, 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:52.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:00:52.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:00:52.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56985150600000001, 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.438 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:00:52.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:00:52.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.444 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56977360300000002, 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:00:52.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:00:52.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56972231699999998, 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.451 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:00:52.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:00:52.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:52.457 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56969228400000005, 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:00:52.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:00:52.463 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56965271100000003, 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:00:52.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:00:52.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:00:52.469 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56962301800000004, 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.470 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:00:52.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:00:52.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56955113199999996, 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.476 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:00:52.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.482 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56951675199999996, 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:00:52.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:00:52.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.488 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.569486995, 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:52.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:00:52.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:52.495 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.56222031100000003, 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:00:52.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:00:52.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 1157912~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.55237159499999999, 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051865150999999998, 2024-04-25T23:00:52.501 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:52.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869048+0000", 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6300000000000004e-07 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869052+0000", 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.284e-06 2024-04-25T23:00:52.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869067+0000", 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4973e-05 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869074+0000", 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3429999999999998e-06 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914821+0000", 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045746811999999998 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914912+0000", 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0359999999999995e-05 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915061+0000", 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000149758 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919434+0000", 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043721209999999996 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920692+0000", 2024-04-25T23:00:52.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012584950000000001 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920813+0000", 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120993 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920912+0000", 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9248999999999998e-05 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.507 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 1159841~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.55233472900000002, 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052040279000000002, 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869085+0000", 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:00:52.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869096+0000", 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.116e-05 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869105+0000", 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5829999999999996e-06 2024-04-25T23:00:52.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869115+0000", 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8300000000000008e-06 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915654+0000", 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046539035999999999 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915763+0000", 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000108386 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915936+0000", 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017375499999999999 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919499+0000", 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003562352 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920932+0000", 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001433272 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921061+0000", 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000128782 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921124+0000", 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3423000000000006e-05 2024-04-25T23:00:52.513 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.552292966, 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:52.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:00:52.519 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.548972986, 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:52.520 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:00:52.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.525 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.54882492400000005, 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:00:52.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:00:52.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.54828209299999997, 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.532 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:00:52.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 1176983~12745 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.54392794600000005, 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052162238, 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.538 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877501+0000", 2024-04-25T23:00:52.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877538+0000", 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7246000000000002e-05 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877568+0000", 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9799999999999999e-05 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877605+0000", 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7506000000000003e-05 2024-04-25T23:00:52.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923423+0000", 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045818151000000001 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923549+0000", 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012604700000000001 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923732+0000", 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018251300000000001 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926357+0000", 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026246160000000002 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929490+0000", 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031331610000000002 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929575+0000", 2024-04-25T23:00:52.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5575999999999995e-05 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929653+0000", 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7775000000000007e-05 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.54229044299999996, 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:00:52.543 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:00:52.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.548 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.549 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.549 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:52.549 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:52.549 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:52.550 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:52.551 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:52.544+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:52.651 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:52.648+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:52.686 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:52.686 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:52.686 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:52.686 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:52.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:52.790 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:52.788+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:52.853 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:52.850+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:52.877 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:52.877 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:52.877 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:52.877 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:52.877 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:52.892 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:52.954 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:52.950+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:53.054 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:53.050+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 114.535611555, 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.065 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:53.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:53.071 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 114.535551609, 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:53.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 114.535411103, 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:53.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:53.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:53.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 114.535376993, 2024-04-25T23:00:53.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 114.535342317, 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:53.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 114.535215278, 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:53.095 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:53.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.292135229, 2024-04-25T23:00:53.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:53.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:53.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.292068089, 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:53.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.291921074, 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.113 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.29185109399999, 2024-04-25T23:00:53.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:53.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:53.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.291789518, 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:53.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.291687115, 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:53.130 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.291623406, 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:53.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:53.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:53.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.29156422299999, 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:53.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.147 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.29150073, 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:53.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:53.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.29144245400001, 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:53.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:53.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:53.160 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.291338641, 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:53.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:53.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.291187372, 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:53.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:53.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:53.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:53.173 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.291121167, 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:53.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:53.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.179 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 106.29094213800001, 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:53.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:53.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:53.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:53.184 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:53.186 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:53.186 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:53.182+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:53.211 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:53.286 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:53.280+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:53.312 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:00:53.339 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:53.339 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:53.339 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.339 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:5974 4.c e49/17 4:33ba78ae:::10000001b6b.00000000:head v 49'106, mlcod=49'104)", 2024-04-25T23:00:53.339 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:53.338244+0000", 2024-04-25T23:00:53.339 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0011941230000000001, 2024-04-25T23:00:53.339 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012362650000000001, 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338244+0000", 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338244+0000", 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:53.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338246+0000", 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.933e-06 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338258+0000", 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2847000000000001e-05 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338284+0000", 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.58e-05 2024-04-25T23:00:53.341 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338297+0000", 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2306e-05 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338430+0000", 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000133936 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:53.338488+0000", 2024-04-25T23:00:53.342 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7179000000000003e-05 2024-04-25T23:00:53.343 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:53.343 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:53.343 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:53.343 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:53.343 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:00:53.343 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 1 2024-04-25T23:00:53.343 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:53.357 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:53.385 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:53.403 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:53.402+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:53.409 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:53.409 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:53.409 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:53.412 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:53.413 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:53.488 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:53.488 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:53.488 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:53.486+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:53.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:53.589 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:53.584+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:53.681 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:53.681 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:53.690 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:53.684+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:53.697 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:53.791 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:53.788+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:53.834 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:53.834 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:53.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:53.895 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:53.892+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:53.993 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:53.988+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:54.021 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:54.021 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:54.035 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:54.094 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:54.090+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:54.196 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:54.192+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:54.206 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:54.206 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:54.220 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:54.251 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:00:54.296 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:54.292+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:54.363 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:54.363 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:54.379 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:54.427 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:54.426+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:54.498 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:54.494+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:54.514 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:54.514 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:54.529 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:54.599 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:54.596+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:54.700 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:54.700 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:54.700 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:54.698+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:54.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:54.800 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:54.798+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:54.853 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:54.853 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:54.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:54.914 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:54.912+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:54.988 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:54.989 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:55.002 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:54.996+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:55.003 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:55.103 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:55.102+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:55.171 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:55.171 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:55.186 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:55.204 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:55.200+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:55.305 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:55.302+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:55.319 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:55.319 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:55.333 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:55.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:55.423 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:55.422+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:55.506 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:55.504+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:55.509 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:55.509 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:55.525 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:55.585 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:55.585 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:55.607 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:55.604+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:55.608 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:55.609 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:55.609 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:55.612 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:55.612 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:55.705 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8501788029999999, 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8501044640000002, 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:00:55.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:00:55.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.715 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8500710910000002, 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:00:55.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.849993188, 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:00:55.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.725 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8499419019999999, 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:00:55.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:00:55.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.730 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.849911869, 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:00:55.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:00:55.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.735 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.849872296, 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:00:55.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:00:55.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:55.740 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8498426029999999, 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:00:55.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8497707170000002, 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:00:55.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.749 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.750 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.849736337, 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8497065799999999, 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:00:55.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:00:55.758 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:55.760 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8424398960000001, 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.764 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 1157912~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8325911800000001, 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051865150999999998, 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869048+0000", 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6300000000000004e-07 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869052+0000", 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.284e-06 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869067+0000", 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4973e-05 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869074+0000", 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3429999999999998e-06 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914821+0000", 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045746811999999998 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914912+0000", 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0359999999999995e-05 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915061+0000", 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000149758 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919434+0000", 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043721209999999996 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920692+0000", 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012584950000000001 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920813+0000", 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120993 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920912+0000", 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9248999999999998e-05 2024-04-25T23:00:55.769 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 1159841~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8325543140000002, 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052040279000000002, 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.770 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869085+0000", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869096+0000", 2024-04-25T23:00:55.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.116e-05 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869105+0000", 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5829999999999996e-06 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869115+0000", 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8300000000000008e-06 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915654+0000", 2024-04-25T23:00:55.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046539035999999999 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915763+0000", 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000108386 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915936+0000", 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017375499999999999 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919499+0000", 2024-04-25T23:00:55.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003562352 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920932+0000", 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001433272 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921061+0000", 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000128782 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921124+0000", 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3423000000000006e-05 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8325125509999998, 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:00:55.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8291925710000001, 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.780 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:00:55.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:00:55.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:00:55.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.829044509, 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.786 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:00:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:00:55.789 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8285016779999999, 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:00:55.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 1176983~12745 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8241475309999999, 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052162238, 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877501+0000", 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.796 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877538+0000", 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7246000000000002e-05 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877568+0000", 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9799999999999999e-05 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877605+0000", 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7506000000000003e-05 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923423+0000", 2024-04-25T23:00:55.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045818151000000001 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923549+0000", 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012604700000000001 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923732+0000", 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018251300000000001 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.798 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926357+0000", 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026246160000000002 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929490+0000", 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031331610000000002 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929575+0000", 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5575999999999995e-05 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929653+0000", 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7775000000000007e-05 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.8225100279999999, 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:55.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:55.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:55.805 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:55.806 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:55.802+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:55.807 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:55.907 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:55.904+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:55.944 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:55.944 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:55.944 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:55.944 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:55.958 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:56.046 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:56.044+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:56.109 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:56.106+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:56.128 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:56.128 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:56.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:56.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-04-25T23:00:56.235 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:56.232+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:56.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:00:56.310 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:56.306+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:56.325 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 117.79350950600001, 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031108356, 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 184 2024-04-25T23:00:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527602+0000", 2024-04-25T23:00:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7299999999999995e-07 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527607+0000", 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527637+0000", 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9773000000000001e-05 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527646+0000", 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8440000000000004e-06 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553793+0000", 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026146808000000001 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.553921+0000", 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128066 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554112+0000", 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019163200000000001 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558410+0000", 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042979860000000002 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558458+0000", 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7783e-05 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558594+0000", 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013611600000000001 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558710+0000", 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115695 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 117.79344956, 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035105623000000002, 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 185 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527661+0000", 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527662+0000", 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527762+0000", 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010001300000000001 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527777+0000", 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527786+0000", 2024-04-25T23:00:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4370000000000007e-06 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.554857+0000", 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027071657999999998 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555105+0000", 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024797799999999999 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.555483+0000", 2024-04-25T23:00:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037752 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.558868+0000", 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003385061 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562502+0000", 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036339150000000001 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562650+0000", 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014832199999999999 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562767+0000", 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116833 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 117.79330905400001, 2024-04-25T23:00:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035384654000000001, 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 186 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527802+0000", 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527803+0000", 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527808+0000", 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7359999999999998e-06 2024-04-25T23:00:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527818+0000", 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6399999999999992e-06 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527825+0000", 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557326+0000", 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029500702 2024-04-25T23:00:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557467+0000", 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014062600000000001 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.557671+0000", 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020428800000000001 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562902+0000", 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052309160000000004 2024-04-25T23:00:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.562939+0000", 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7586999999999998e-05 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563080+0000", 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140822 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563187+0000", 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106313 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 117.793274944, 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038724440999999998, 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 187 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527836+0000", 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527837+0000", 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527842+0000", 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2329999999999997e-06 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527851+0000", 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9530000000000005e-06 2024-04-25T23:00:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527860+0000", 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7560000000000005e-06 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559020+0000", 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031160630000000002 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559276+0000", 2024-04-25T23:00:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025609100000000001 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.559646+0000", 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036906100000000001 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.564577+0000", 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049318820000000003 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566280+0000", 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017026770000000001 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566443+0000", 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000162972 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.566561+0000", 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117489 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 117.79324026800001, 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03972461, 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 188 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527871+0000", 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527872+0000", 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8700000000000005e-07 2024-04-25T23:00:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527961+0000", 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9798999999999999e-05 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527972+0000", 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527984+0000", 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.153e-05 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560586+0000", 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032601682 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.560819+0000", 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023357099999999999 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.561183+0000", 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036388700000000002 2024-04-25T23:00:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567075+0000", 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058924750000000003 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567277+0000", 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000201535 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567469+0000", 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019157199999999999 2024-04-25T23:00:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567595+0000", 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012678200000000001 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 117.793113229, 2024-04-25T23:00:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040203655999999997, 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4147", 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.43:0/1310424722", 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 189 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527998+0000", 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.527999+0000", 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528004+0000", 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-04-25T23:00:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528013+0000", 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3570000000000004e-06 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.528021+0000", 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3329999999999999e-06 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563293+0000", 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035272460999999998 2024-04-25T23:00:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563432+0000", 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013876900000000001 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.563643+0000", 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000211306 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567905+0000", 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042611960000000001 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.567944+0000", 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9360000000000003e-05 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568088+0000", 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014368200000000001 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:58:58.568201+0000", 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113849 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.55003318, 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029796907000000001, 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771078+0000", 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771079+0000", 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-04-25T23:00:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771088+0000", 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0059999999999998e-06 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771110+0000", 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2254000000000001e-05 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771126+0000", 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5376e-05 2024-04-25T23:00:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787698+0000", 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016571995999999999 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787991+0000", 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029354400000000002 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788325+0000", 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033351099999999999 2024-04-25T23:00:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800543+0000", 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012218481999999999 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800641+0000", 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8243000000000001e-05 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800774+0000", 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132082 2024-04-25T23:00:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800875+0000", 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010121899999999999 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.54996604, 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040559294000000003, 2024-04-25T23:00:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771145+0000", 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771146+0000", 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.39e-06 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771154+0000", 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.267e-06 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771171+0000", 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7388999999999999e-05 2024-04-25T23:00:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771197+0000", 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6163e-05 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773348+0000", 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00215073 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773361+0000", 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3543999999999999e-05 2024-04-25T23:00:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.790421+0000", 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017059291000000001 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791573+0000", 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001152298 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791910+0000", 2024-04-25T23:00:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033743400000000001 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803211+0000", 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011300289999999999 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811455+0000", 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082445829999999998 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811537+0000", 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1476000000000004e-05 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811704+0000", 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016743899999999999 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.54981902500001, 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034362982, 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771292+0000", 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771294+0000", 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5600000000000001e-06 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771303+0000", 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1400000000000006e-06 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771325+0000", 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2229999999999999e-05 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771340+0000", 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4786999999999999e-05 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773433+0000", 2024-04-25T23:00:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020933140000000002 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773444+0000", 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1043000000000001e-05 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787272+0000", 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013827673 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787572+0000", 2024-04-25T23:00:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030001499999999999 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.787902+0000", 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033051000000000001 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803132+0000", 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230172 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805389+0000", 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022561529999999999 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805535+0000", 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146176 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805655+0000", 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120209 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549749045, 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031317434999999998, 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771362+0000", 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771363+0000", 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-06 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771371+0000", 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6830000000000008e-06 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771391+0000", 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771406+0000", 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5173e-05 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789100+0000", 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017694074000000001 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789304+0000", 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020331400000000001 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789596+0000", 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000292365 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800906+0000", 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011309583 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801604+0000", 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069839800000000003 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802570+0000", 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096584899999999996 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.802679+0000", 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109586 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.54968746900001, 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040350825, 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771424+0000", 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771425+0000", 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2270000000000001e-06 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771472+0000", 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7466000000000003e-05 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771491+0000", 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9127000000000002e-05 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771505+0000", 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3903000000000001e-05 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791559+0000", 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020053294999999999 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.791796+0000", 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000236975 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792099+0000", 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000303627 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800920+0000", 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088208790000000002 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811540+0000", 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010620085 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811686+0000", 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000145456 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811774+0000", 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8784999999999998e-05 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.54958506600001, 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040583776000000002, 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771526+0000", 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771527+0000", 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.42e-06 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771534+0000", 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.72e-06 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771551+0000", 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7036000000000001e-05 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771567+0000", 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6325999999999999e-05 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792703+0000", 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021135474000000001 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792906+0000", 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000203165 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793201+0000", 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029501400000000002 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800936+0000", 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077348139999999996 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811875+0000", 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010938715999999999 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812004+0000", 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012914900000000001 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812110+0000", 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105942 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549521357, 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041755657000000002, 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771590+0000", 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771591+0000", 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3999999999999999e-06 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771600+0000", 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4400000000000005e-06 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771617+0000", 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7306999999999999e-05 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771631+0000", 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4630000000000001e-05 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794289+0000", 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022657441 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794406+0000", 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011709600000000001 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.794672+0000", 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026649399999999999 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806972+0000", 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012299565 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813111+0000", 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061386710000000001 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813231+0000", 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119876 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813345+0000", 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114737 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549462174, 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.040428999, 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771649+0000", 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771650+0000", 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771656+0000", 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2670000000000003e-06 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771674+0000", 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7496e-05 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771692+0000", 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8580000000000002e-05 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773504+0000", 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018113020000000001 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773514+0000", 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0730000000000001e-05 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792841+0000", 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019326698 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793036+0000", 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019463099999999999 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.793451+0000", 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041558699999999998 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806690+0000", 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013238895000000001 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811825+0000", 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005134525 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.811988+0000", 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000163079 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812078+0000", 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0038999999999996e-05 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549398681, 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034463083999999998, 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771712+0000", 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771714+0000", 2024-04-25T23:00:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1659999999999999e-06 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771720+0000", 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1e-06 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771737+0000", 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6937000000000001e-05 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771754+0000", 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7159999999999998e-05 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773579+0000", 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001825213 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773589+0000", 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8190000000000003e-06 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.788728+0000", 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015139026999999999 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789115+0000", 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000387697 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.789394+0000", 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000278721 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803148+0000", 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013753922999999999 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805798+0000", 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002650304 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806070+0000", 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027173099999999999 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806175+0000", 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010528599999999999 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549340405, 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032419112999999999, 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771771+0000", 2024-04-25T23:00:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771772+0000", 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771797+0000", 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5256e-05 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771832+0000", 2024-04-25T23:00:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5055999999999998e-05 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771850+0000", 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8294000000000001e-05 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777288+0000", 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054378810000000003 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-04-25T23:00:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777304+0000", 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780685+0000", 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033808670000000001 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.780981+0000", 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029579399999999999 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.781968+0000", 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098731300000000008 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.792398+0000", 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010430159 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.803931+0000", 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011532304 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804082+0000", 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150863 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.804190+0000", 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108179 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549236592, 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041091048999999998, 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771874+0000", 2024-04-25T23:00:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771876+0000", 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3459999999999999e-06 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771883+0000", 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2339999999999997e-06 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771901+0000", 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8430000000000001e-05 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.771919+0000", 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7679000000000001e-05 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773663+0000", 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017434830000000001 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773672+0000", 2024-04-25T23:00:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.796964+0000", 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023291487 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797283+0000", 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031916099999999999 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797599+0000", 2024-04-25T23:00:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031569699999999998 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.806698+0000", 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090996170000000008 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812838+0000", 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061391359999999999 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812907+0000", 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9362000000000004e-05 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.812965+0000", 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8570000000000003e-05 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549085323, 2024-04-25T23:00:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041196218999999999, 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772026+0000", 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772027+0000", 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.223e-06 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772035+0000", 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772054+0000", 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8842999999999999e-05 2024-04-25T23:00:56.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772070+0000", 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773748+0000", 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016782800000000001 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:56.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773758+0000", 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5200000000000003e-06 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.800785+0000", 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027027188000000001 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801130+0000", 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034535700000000002 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-04-25T23:00:56.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.801518+0000", 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038762099999999999 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808789+0000", 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072711370000000004 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813027+0000", 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042374630000000003 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813128+0000", 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101408 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.813222+0000", 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3979000000000003e-05 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.549019118, 2024-04-25T23:00:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033630239999999999, 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772092+0000", 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772093+0000", 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4300000000000001e-06 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772102+0000", 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9670000000000007e-06 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772120+0000", 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7459999999999999e-05 2024-04-25T23:00:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772133+0000", 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777739+0000", 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056059500000000002 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.777755+0000", 2024-04-25T23:00:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5990000000000001e-05 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.785065+0000", 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073093100000000003 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786610+0000", 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545495 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.786798+0000", 2024-04-25T23:00:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018823900000000001 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.797695+0000", 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010896319 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805476+0000", 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077812530000000001 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805621+0000", 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014482899999999999 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.805722+0000", 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010146500000000001 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 109.548840089, 2024-04-25T23:00:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044060166999999997, 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772271+0000", 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772273+0000", 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.57e-06 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772279+0000", 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6969999999999996e-06 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772299+0000", 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9470000000000002e-05 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.772313+0000", 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773826+0000", 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015137250000000001 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.773837+0000", 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0516999999999999e-05 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.807143+0000", 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033305704999999998 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.808151+0000", 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001008033 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T22:59:06.816331+0000", 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081803770000000008 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:56.440 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:56.441 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:56.442 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:56.438+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:56.542 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:56.538+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:56.591 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:56.591 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:56.591 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:00:56.591 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:56.607 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:56.651 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:56.650+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:56.744 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:56.740+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:56.790 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:56.790 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:00:56.790 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:00:56.790 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:00:56.790 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:56.806 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:56.855 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:56.854+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:56.936 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:56.936 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:00:56.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0833799109999998, 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:00:56.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0833055720000004, 2024-04-25T23:00:56.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:56.947 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0832721989999996, 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:00:56.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.952 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0831942960000003, 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:56.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:00:56.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:00:56.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.957 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0831430099999997, 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:00:56.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:00:56.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0831129769999999, 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.963 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:00:56.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:00:56.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0830734040000003, 2024-04-25T23:00:56.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0830437110000002, 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:00:56.973 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.978 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0829718249999996, 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:56.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:00:56.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:00:56.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0829374449999998, 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:00:56.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:00:56.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:00:56.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0829076879999997, 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.993 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0756410040000004, 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:00:56.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:00:56.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:00:56.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:00:56.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 1157912~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:56.998 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0657922879999999, 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051865150999999998, 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:56.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869048+0000", 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6300000000000004e-07 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869052+0000", 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.284e-06 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869067+0000", 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4973e-05 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869074+0000", 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3429999999999998e-06 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914821+0000", 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045746811999999998 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914912+0000", 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0359999999999995e-05 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915061+0000", 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000149758 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919434+0000", 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043721209999999996 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920692+0000", 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012584950000000001 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920813+0000", 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120993 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920912+0000", 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9248999999999998e-05 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.003 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 1159841~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0657554219999996, 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052040279000000002, 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869085+0000", 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869096+0000", 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.116e-05 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869105+0000", 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5829999999999996e-06 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869115+0000", 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8300000000000008e-06 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915654+0000", 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046539035999999999 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915763+0000", 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000108386 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915936+0000", 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017375499999999999 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919499+0000", 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003562352 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920932+0000", 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001433272 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921061+0000", 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000128782 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921124+0000", 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3423000000000006e-05 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.065713659, 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.013 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0623936790000004, 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:00:57.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:00:57.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:00:57.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:00:57.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.018 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0622456170000003, 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:00:57.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:57.023 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0617027859999997, 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:00:57.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:00:57.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:00:57.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 1176983~12745 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:57.028 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0573486389999998, 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052162238, 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877501+0000", 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877538+0000", 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7246000000000002e-05 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877568+0000", 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9799999999999999e-05 2024-04-25T23:00:57.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877605+0000", 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7506000000000003e-05 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923423+0000", 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045818151000000001 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923549+0000", 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012604700000000001 2024-04-25T23:00:57.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923732+0000", 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018251300000000001 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926357+0000", 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026246160000000002 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929490+0000", 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031331610000000002 2024-04-25T23:00:57.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929575+0000", 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5575999999999995e-05 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929653+0000", 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7775000000000007e-05 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.0557111360000002, 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:00:57.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:00:57.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.038 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.039 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.039 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:57.040 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:57.038+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:57.040 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:57.141 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:57.138+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:57.182 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:00:57.182 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:57.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:57.242 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:57.240+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:57.277 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:00:57.323 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:00:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:00:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:00:57.323 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:57.339 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:57.387 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:57.384+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:57.444 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:57.442+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:57.526 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:00:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:00:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:00:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:00:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.66693926800000003, 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:00:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:00:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:00:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.66690828199999996, 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.66686586000000003, 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:00:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.66683504100000002, 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:00:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:00:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.66680536199999996, 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:00:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.65254836299999996, 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:00:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:00:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.652137996, 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:00:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:00:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.649637299, 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:00:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.64958469799999996, 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:00:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:00:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.64955125199999997, 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.64219906800000004, 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:00:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.64208575099999998, 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:00:57.581 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.642021807, 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:00:57.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:00:57.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:00:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.64197679500000004, 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.586 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:00:57.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:00:57.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.64193954900000005, 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.64060565000000003, 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.595 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:00:57.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:00:57.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:00:57.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.638444923, 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:00:57.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:00:57.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.63629902299999996, 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:00:57.604 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.63593295400000005, 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:00:57.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:00:57.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:00:57.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.63247911300000004, 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:00:57.613 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:00:57.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:00:57.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:00:57.618 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:00:57.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:00:57.620 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:57.621 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:57.616+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:57.720 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:57.716+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:57.758 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:00:57.758 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:00:57.758 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:8281 4.16 4:6a4c20b9:::100000025b0.00000000:head [write 0~1096 in=1096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:57.757961+0000", 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00098337800000000003, 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0010027759999999999, 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 8281 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:00:57.759 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.757961+0000", 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.757961+0000", 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.757963+0000", 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.793e-06 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.760 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.757973+0000", 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.022e-05 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.757997+0000", 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3810000000000001e-05 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.758010+0000", 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3057000000000001e-05 2024-04-25T23:00:57.761 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.758064+0000", 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4033999999999998e-05 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.758136+0000", 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1913000000000001e-05 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.758205+0000", 2024-04-25T23:00:57.762 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9882000000000006e-05 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:57.758832+0000", 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00062618400000000001 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 1 2024-04-25T23:00:57.763 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:00:57.768 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:57.768 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:57.774 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:57.787 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:57.791 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:57.791 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:00:57.821 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:57.818+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:57.908 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:57.908 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:57.922 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:57.920+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:57.923 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:58.023 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:58.020+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:58.093 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:58.093 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:58.107 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:58.123 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:58.122+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:58.224 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:58.222+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:58.250 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:58.250 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:58.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:58.325 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:58.320+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:58.393 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:58.393 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:58.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:58.450 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:58.448+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:58.528 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:58.526+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:58.578 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:58.578 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:58.593 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:58.639 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:58.638+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:58.728 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:58.729 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:58.730 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:58.726+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:58.743 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:58.835 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:58.834+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:58.912 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:58.912 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:58.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:58.971 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:58.970+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:59.032 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:59.028+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:59.095 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:59.095 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:59.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:00:59.133 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:59.130+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:59.234 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:59.230+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:59.244 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:59.244 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:59.259 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:00:59.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:00:59.335 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:59.332+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:59.381 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:59.381 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:59.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:00:59.438 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:59.436+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:59.537 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:59.532+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:59.569 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:59.569 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:59.584 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:00:59.638 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:59.634+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:59.739 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:59.736+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:59.748 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:59.748 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:59.765 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:00:59.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:00:59.855 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:00:59.854+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:00:59.933 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:00:59.933 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:00:59.941 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:00:59.936+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:00:59.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:00:59.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:00:59.960 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:00:59.980 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:00:59.981 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:00:59.981 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:00:59.983 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:00:59.984 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:00.041 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:00.038+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2661494199999996, 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:00.119 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:00.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:00.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2660750810000003, 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:00.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:00.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:00.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2660417079999995, 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:00.130 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:00.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:00.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2659638050000002, 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:00.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:00.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:00.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2659125190000005, 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:00.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:00.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:00.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:00.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2658824860000006, 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.147 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:00.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:00.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.150 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:00.152 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2658429130000002, 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:00.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:00.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:00.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.164 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2658132200000001, 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:00.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:00.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:00.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2657413339999994, 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.170 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.175 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2657069540000006, 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:00.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:00.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:00.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.182 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2656771970000005, 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:00.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2584105129999994, 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.188 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:00.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.192 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 1157912~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2485617970000007, 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051865150999999998, 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.193 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869048+0000", 2024-04-25T23:01:00.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6300000000000004e-07 2024-04-25T23:01:00.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869052+0000", 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.284e-06 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869067+0000", 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4973e-05 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869074+0000", 2024-04-25T23:01:00.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3429999999999998e-06 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914821+0000", 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045746811999999998 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914912+0000", 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0359999999999995e-05 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915061+0000", 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000149758 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919434+0000", 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043721209999999996 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920692+0000", 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012584950000000001 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920813+0000", 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120993 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920912+0000", 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9248999999999998e-05 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 1159841~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:00.199 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2485249310000004, 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052040279000000002, 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:00.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869085+0000", 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869096+0000", 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.116e-05 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869105+0000", 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5829999999999996e-06 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869115+0000", 2024-04-25T23:01:00.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8300000000000008e-06 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915654+0000", 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046539035999999999 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915763+0000", 2024-04-25T23:01:00.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000108386 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915936+0000", 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017375499999999999 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919499+0000", 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003562352 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920932+0000", 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001433272 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921061+0000", 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000128782 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921124+0000", 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3423000000000006e-05 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.205 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2484831679999999, 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:00.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:00.211 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2451631879999994, 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:00.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:00.216 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2450151260000002, 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:00.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:00.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2444722949999996, 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:00.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:00.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.228 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 1176983~12745 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2401181480000005, 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052162238, 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:00.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877501+0000", 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877538+0000", 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7246000000000002e-05 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877568+0000", 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9799999999999999e-05 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877605+0000", 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7506000000000003e-05 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923423+0000", 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045818151000000001 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923549+0000", 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012604700000000001 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923732+0000", 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018251300000000001 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926357+0000", 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026246160000000002 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929490+0000", 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031331610000000002 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929575+0000", 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5575999999999995e-05 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929653+0000", 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7775000000000007e-05 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.233 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.2384806449999992, 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:00.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:00.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:00.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:00.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:00.239 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:00.240 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:00.178+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:00.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:00.281 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:01:00.286 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:00.284+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:00.382 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:00.378+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:00.386 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:00.387 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:00.404 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:00.490 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:00.488+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:00.571 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:00.585 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:00.582+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:00.588 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:00.685 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:00.680+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9091232360000001, 2024-04-25T23:01:00.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:00.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:00.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:00.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.90909225, 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:00.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:00.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9090498280000001, 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:00.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:00.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:00.782 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9090190090000001, 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:00.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9089893299999998, 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8947323310000002, 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.894321964, 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:00.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8918212670000001, 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.806 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8917686659999999, 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8917352200000002, 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:00.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:00.816 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.884383036, 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:00.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8842697189999997, 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:00.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:00.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:00.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8842057749999999, 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:00.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:00.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8841607630000001, 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:00.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8841235169999999, 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:00.835 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:00.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8827896179999999, 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.840 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:00.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8806288909999997, 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:00.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:00.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8784829910000003, 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:00.849 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:00.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.8781169220000002, 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.874663081, 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:00.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:00.863 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:00.865 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:00.865 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:00.860+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:00.966 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:00.962+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:01.003 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:01.003 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:01.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.004 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:10111 4.2e 4:76459878:::10000002e61.00000000:head [write 0~321 in=321b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-25T23:01:01.004 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:01.002615+0000", 2024-04-25T23:01:01.005 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00080385999999999999, 2024-04-25T23:01:01.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00087173199999999995, 2024-04-25T23:01:01.005 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 10111 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002615+0000", 2024-04-25T23:01:01.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002615+0000", 2024-04-25T23:01:01.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002617+0000", 2024-04-25T23:01:01.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1100000000000001e-06 2024-04-25T23:01:01.008 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002628+0000", 2024-04-25T23:01:01.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0577000000000001e-05 2024-04-25T23:01:01.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002657+0000", 2024-04-25T23:01:01.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8753000000000001e-05 2024-04-25T23:01:01.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002674+0000", 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7223000000000001e-05 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002761+0000", 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7169999999999994e-05 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.003066+0000", 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030538700000000001 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10110 4.a e52/17 4:522da020:::10000002e60.00000000:head v 52'156, mlcod=52'154)", 2024-04-25T23:01:01.012 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:01.002932+0000", 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00048684299999999999, 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00078965999999999997, 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002932+0000", 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002932+0000", 2024-04-25T23:01:01.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002939+0000", 2024-04-25T23:01:01.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5100000000000004e-06 2024-04-25T23:01:01.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002967+0000", 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8234000000000001e-05 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.002991+0000", 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3603000000000001e-05 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.003010+0000", 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9683000000000001e-05 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.003091+0000", 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1192000000000005e-05 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:01.003113+0000", 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1047999999999999e-05 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 2 2024-04-25T23:01:01.016 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:01.019 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:01.067 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:01.064+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:01.167 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:01.166+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:01.191 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:01.191 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:01.191 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:01.192 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:01.192 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:01.207 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:01.295 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:01.294+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:01.370 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:01.366+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:01.392 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5371972199999995, 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.396 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:01.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:01.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:01.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:01.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:01.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:01.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:01.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:01.400 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5371228810000002, 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:01.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:01.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:01.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.408 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5370895079999993, 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:01.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:01.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:01.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:01.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.537011605, 2024-04-25T23:01:01.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.417 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:01.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:01.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5369603190000003, 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.422 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:01.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:01.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:01.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5369302860000005, 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:01.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.536890713, 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.433 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:01.438 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5368610199999999, 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5367891339999993, 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.444 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5367547540000004, 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:01.450 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:01.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:01.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:01.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5367249970000003, 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:01.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:01.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5294583129999992, 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:01.463 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:01.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 1157912~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5196095970000005, 2024-04-25T23:01:01.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051865150999999998, 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869048+0000", 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6300000000000004e-07 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869052+0000", 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.284e-06 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869067+0000", 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4973e-05 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869074+0000", 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3429999999999998e-06 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914821+0000", 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045746811999999998 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914912+0000", 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0359999999999995e-05 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.472 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915061+0000", 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000149758 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919434+0000", 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043721209999999996 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920692+0000", 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012584950000000001 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920813+0000", 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120993 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920912+0000", 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9248999999999998e-05 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 1159841~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5195727310000002, 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052040279000000002, 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869085+0000", 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869096+0000", 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.116e-05 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869105+0000", 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5829999999999996e-06 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869115+0000", 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8300000000000008e-06 2024-04-25T23:01:01.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915654+0000", 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046539035999999999 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915763+0000", 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000108386 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915936+0000", 2024-04-25T23:01:01.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017375499999999999 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919499+0000", 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003562352 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920932+0000", 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001433272 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921061+0000", 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000128782 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921124+0000", 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3423000000000006e-05 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:01.480 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5195309679999998, 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:01.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5162109879999992, 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.486 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:01.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:01.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.491 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.516062926, 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:01.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:01.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5155200949999994, 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:01.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:01.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 1176983~12745 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5111659480000004, 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052162238, 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877501+0000", 2024-04-25T23:01:01.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877538+0000", 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7246000000000002e-05 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877568+0000", 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9799999999999999e-05 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877605+0000", 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7506000000000003e-05 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923423+0000", 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045818151000000001 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923549+0000", 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012604700000000001 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923732+0000", 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018251300000000001 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926357+0000", 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026246160000000002 2024-04-25T23:01:01.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929490+0000", 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031331610000000002 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929575+0000", 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5575999999999995e-05 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929653+0000", 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7775000000000007e-05 2024-04-25T23:01:01.509 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.5095284450000008, 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:01.510 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:01.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:01.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:01.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:01.516 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:01.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:01.519 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:01.512+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:01.619 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:01.616+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:01.652 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:01.652 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:01.652 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:01.652 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:01.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:01.719 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:01.718+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:01.822 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:01.820+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:01.834 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:01.835 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:01.835 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:01.835 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:01.835 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:01.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:01.923 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:01.922+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:01.985 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1662139439999999, 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.024 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:02.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:02.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1661829580000003, 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.029 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:02.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:02.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1661405360000003, 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1661097170000003, 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:02.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:02.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:02.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:02.043 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1660800379999996, 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:02.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:02.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1518230389999999, 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:02.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:02.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1514126720000002, 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:02.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:02.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.058 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1489119749999999, 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1488593739999997, 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1488259279999999, 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1414737439999998, 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:02.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1413604270000004, 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:02.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1412964829999996, 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:02.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:02.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1412514710000004, 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:02.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:02.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1412142249999997, 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1398803260000001, 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:02.098 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:02.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:02.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1377195990000004, 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.103 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:02.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:02.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.135573699, 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:02.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:02.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:02.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:02.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.13520763, 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.113 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:02.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1317537890000002, 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:02.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:02.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:02.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:02.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:02.123 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:02.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-04-25T23:01:02.124 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T23:01:02.125 INFO:tasks.workunit.client.0.smithi043.stderr:+ make 2024-04-25T23:01:02.125 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:02.022+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:02.125 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:02.122+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:02.126 INFO:tasks.workunit.client.0.smithi043.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T23:01:02.126 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:02.155 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:02.155 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:02.174 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:02.175 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:02.177 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:02.178 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:02.225 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:02.220+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:02.257 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:02.257 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:02.271 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:02.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:01:02.325 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:02.322+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:02.394 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:02.395 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:02.406 INFO:tasks.workunit.client.0.smithi043.stderr:++ readlink -f fsstress 2024-04-25T23:01:02.408 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:02.409 INFO:tasks.workunit.client.0.smithi043.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T23:01:02.409 INFO:tasks.workunit.client.0.smithi043.stderr:+ popd 2024-04-25T23:01:02.409 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T23:01:02.410 INFO:tasks.workunit.client.0.smithi043.stderr:+ popd 2024-04-25T23:01:02.410 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T23:01:02.410 INFO:tasks.workunit.client.0.smithi043.stderr:++ mktemp -d -p . 2024-04-25T23:01:02.411 INFO:tasks.workunit.client.0.smithi043.stderr:+ T=./tmp.G7uZ8STz75 2024-04-25T23:01:02.411 INFO:tasks.workunit.client.0.smithi043.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.G7uZ8STz75 -l 1 -n 1000 -p 10 -v 2024-04-25T23:01:02.413 INFO:tasks.workunit.client.0.smithi043.stdout:seed = 1714205017 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/0: dwrite - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/1: stat - no entries 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/2: write - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/3: write - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/4: fsync - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/5: truncate - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/6: truncate - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/7: dwrite - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/8: chown . 19757066 1 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/9: rename - no filename 2024-04-25T23:01:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/10: dwrite - no filename 2024-04-25T23:01:02.416 INFO:tasks.workunit.client.0.smithi043.stdout:0/11: symlink l0 0 2024-04-25T23:01:02.416 INFO:tasks.workunit.client.0.smithi043.stdout:2/0: rename - no filename 2024-04-25T23:01:02.416 INFO:tasks.workunit.client.0.smithi043.stdout:2/1: write - no filename 2024-04-25T23:01:02.417 INFO:tasks.workunit.client.0.smithi043.stdout:2/2: truncate - no filename 2024-04-25T23:01:02.417 INFO:tasks.workunit.client.0.smithi043.stdout:0/12: symlink l1 0 2024-04-25T23:01:02.417 INFO:tasks.workunit.client.0.smithi043.stdout:3/0: rename - no filename 2024-04-25T23:01:02.417 INFO:tasks.workunit.client.0.smithi043.stdout:2/3: creat f0 x:0 0 0 2024-04-25T23:01:02.418 INFO:tasks.workunit.client.0.smithi043.stdout:2/4: dread - f0 zero size 2024-04-25T23:01:02.418 INFO:tasks.workunit.client.0.smithi043.stdout:2/5: rmdir - no directory 2024-04-25T23:01:02.418 INFO:tasks.workunit.client.0.smithi043.stdout:0/13: chown l0 2 1 2024-04-25T23:01:02.418 INFO:tasks.workunit.client.0.smithi043.stdout:0/14: dwrite - no filename 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:0/15: fsync - no filename 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:0/16: rmdir - no directory 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/1: mknod c0 0 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/2: write - no filename 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:4/0: write - no filename 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:4/1: link - no file 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:2/6: fdatasync f0 0 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/3: unlink c0 0 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/4: rmdir - no directory 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:0/17: mknod c2 0 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:0/18: dwrite - no filename 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:0/19: dwrite - no filename 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:5/0: dread - no filename 2024-04-25T23:01:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:5/1: write - no filename 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:5/2: dread - no filename 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:5/3: dwrite - no filename 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:5/4: chown . 40 1 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:3/5: mkdir d1 0 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:3/6: write - no filename 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:3/7: dwrite - no filename 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:4/2: mknod c0 0 2024-04-25T23:01:02.420 INFO:tasks.workunit.client.0.smithi043.stdout:0/20: creat f3 x:0 0 0 2024-04-25T23:01:02.423 INFO:tasks.workunit.client.0.smithi043.stdout:6/0: read - no filename 2024-04-25T23:01:02.423 INFO:tasks.workunit.client.0.smithi043.stdout:6/1: unlink - no file 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:6/2: dread - no filename 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:3/8: chown d1 14 1 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:3/9: write - no filename 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:6/3: chown . 495676 1 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:5/5: mkdir d0 0 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:0/21: write f3 [1013449,62773] 0 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:4/3: rename c0 to c1 0 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:7/0: dread - no filename 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:7/1: link - no file 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:5/6: symlink d0/l1 0 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:5/7: dread - no filename 2024-04-25T23:01:02.424 INFO:tasks.workunit.client.0.smithi043.stdout:5/8: dread - no filename 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:4/4: creat f2 x:0 0 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:6/4: mknod c0 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:3/10: rmdir d1 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:3/11: fdatasync - no filename 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:7/2: symlink l0 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:7/3: dread - no filename 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:7/4: read - no filename 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:4/5: mkdir d3 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:6/5: mkdir d1 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:6/6: readlink - no filename 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:6/7: dwrite - no filename 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:3/12: symlink l2 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:5/9: symlink d0/l2 0 2024-04-25T23:01:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:5/10: truncate - no filename 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:6/8: unlink c0 0 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:6/9: read - no filename 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/5: creat f1 x:0 0 0 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/6: stat f1 0 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:8/0: mkdir d0 0 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:8/1: link - no file 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:8/2: write - no filename 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:8/3: chown d0 3040 1 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:8/4: dwrite - no filename 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:4/6: creat d3/f4 x:0 0 0 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/7: read - f1 zero size 2024-04-25T23:01:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:5/11: symlink d0/l3 0 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/12: dwrite - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/13: dwrite - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/14: dread - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/15: fsync - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/0: symlink l0 0 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/1: write - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/2: read - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/3: dwrite - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:3/13: creat f3 x:0 0 0 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:6/10: creat d1/f2 x:0 0 0 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:3/14: readlink l2 0 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/16: chown d0/l1 55 1 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/17: dwrite - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/18: dwrite - no filename 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:3/15: chown f3 731734813 1 2024-04-25T23:01:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:4/7: dread - d3/f4 zero size 2024-04-25T23:01:02.428 INFO:tasks.workunit.client.0.smithi043.stdout:9/4: creat f1 x:0 0 0 2024-04-25T23:01:02.428 INFO:tasks.workunit.client.0.smithi043.stdout:9/5: rmdir - no directory 2024-04-25T23:01:02.429 INFO:tasks.workunit.client.0.smithi043.stdout:6/11: symlink d1/l3 0 2024-04-25T23:01:02.429 INFO:tasks.workunit.client.0.smithi043.stdout:3/16: unlink l2 0 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:9/6: readlink l0 0 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/19: unlink d0/l1 0 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/20: write - no filename 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/12: dread - d1/f2 zero size 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/21: chown d0 46071 1 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:3/17: creat f4 x:0 0 0 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:4/8: rename f2 to d3/f5 0 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:4/9: chown d3 1164 1 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:3/18: creat f5 x:0 0 0 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/22: unlink d0/l2 0 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/23: dwrite - no filename 2024-04-25T23:01:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/24: dread - no filename 2024-04-25T23:01:02.431 INFO:tasks.workunit.client.0.smithi043.stdout:5/25: fsync - no filename 2024-04-25T23:01:02.431 INFO:tasks.workunit.client.0.smithi043.stdout:6/13: unlink d1/f2 0 2024-04-25T23:01:02.431 INFO:tasks.workunit.client.0.smithi043.stdout:9/7: link l0 l2 0 2024-04-25T23:01:02.431 INFO:tasks.workunit.client.0.smithi043.stdout:6/14: chown d1 92 1 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:3/19: creat f6 x:0 0 0 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:5/26: symlink d0/l4 0 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:5/27: write - no filename 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:5/28: truncate - no filename 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:5/29: truncate - no filename 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:9/8: readlink l2 0 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:6/15: creat d1/f4 x:0 0 0 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:3/20: read - f3 zero size 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:6/16: mkdir d1/d5 0 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:9/9: write f1 [822368,3537] 0 2024-04-25T23:01:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:3/21: mkdir d7 0 2024-04-25T23:01:02.433 INFO:tasks.workunit.client.0.smithi043.stdout:6/17: dread - d1/f4 zero size 2024-04-25T23:01:02.433 INFO:tasks.workunit.client.0.smithi043.stdout:3/22: read - f3 zero size 2024-04-25T23:01:02.433 INFO:tasks.workunit.client.0.smithi043.stdout:3/23: creat d7/f8 x:0 0 0 2024-04-25T23:01:02.433 INFO:tasks.workunit.client.0.smithi043.stdout:6/18: symlink d1/d5/l6 0 2024-04-25T23:01:02.434 INFO:tasks.workunit.client.0.smithi043.stdout:0/22: dwrite f3 [0,4194304] 0 2024-04-25T23:01:02.434 INFO:tasks.workunit.client.0.smithi043.stdout:0/23: rmdir - no directory 2024-04-25T23:01:02.438 INFO:tasks.workunit.client.0.smithi043.stdout:6/19: creat d1/d5/f7 x:0 0 0 2024-04-25T23:01:02.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/24: creat f4 x:0 0 0 2024-04-25T23:01:02.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/25: chown l1 89920 1 2024-04-25T23:01:02.439 INFO:tasks.workunit.client.0.smithi043.stdout:6/20: write d1/f4 [735391,4917] 0 2024-04-25T23:01:02.439 INFO:tasks.workunit.client.0.smithi043.stdout:0/26: stat f3 0 2024-04-25T23:01:02.440 INFO:tasks.workunit.client.0.smithi043.stdout:0/27: chown l1 616385495 1 2024-04-25T23:01:02.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/28: fdatasync f4 0 2024-04-25T23:01:02.443 INFO:tasks.workunit.client.0.smithi043.stdout:9/10: dwrite f1 [0,4194304] 0 2024-04-25T23:01:02.443 INFO:tasks.workunit.client.0.smithi043.stdout:6/21: dread - d1/d5/f7 zero size 2024-04-25T23:01:02.444 INFO:tasks.workunit.client.0.smithi043.stdout:3/24: dwrite f3 [0,4194304] 0 2024-04-25T23:01:02.455 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:02.454+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:02.459 INFO:tasks.workunit.client.0.smithi043.stdout:6/22: rmdir d1/d5 39 2024-04-25T23:01:02.459 INFO:tasks.workunit.client.0.smithi043.stdout:3/25: creat d7/f9 x:0 0 0 2024-04-25T23:01:02.460 INFO:tasks.workunit.client.0.smithi043.stdout:4/10: stat c1 0 2024-04-25T23:01:02.460 INFO:tasks.workunit.client.0.smithi043.stdout:5/30: getdents d0 0 2024-04-25T23:01:02.460 INFO:tasks.workunit.client.0.smithi043.stdout:5/31: write - no filename 2024-04-25T23:01:02.460 INFO:tasks.workunit.client.0.smithi043.stdout:5/32: dwrite - no filename 2024-04-25T23:01:02.460 INFO:tasks.workunit.client.0.smithi043.stdout:9/11: stat l2 0 2024-04-25T23:01:02.461 INFO:tasks.workunit.client.0.smithi043.stdout:4/11: creat d3/f6 x:0 0 0 2024-04-25T23:01:02.461 INFO:tasks.workunit.client.0.smithi043.stdout:3/26: link f6 d7/fa 0 2024-04-25T23:01:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:5/33: creat d0/f5 x:0 0 0 2024-04-25T23:01:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:9/12: mknod c3 0 2024-04-25T23:01:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:4/12: chown d3 16132 1 2024-04-25T23:01:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:5/34: stat d0 0 2024-04-25T23:01:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:3/27: read - f6 zero size 2024-04-25T23:01:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:6/23: write d1/d5/f7 [277537,38133] 0 2024-04-25T23:01:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:0/29: fsync f3 0 2024-04-25T23:01:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:5/35: write d0/f5 [282763,121800] 0 2024-04-25T23:01:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:4/13: rmdir d3 39 2024-04-25T23:01:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/28: chown d7/fa 1 1 2024-04-25T23:01:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/29: readlink - no filename 2024-04-25T23:01:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:6/24: creat d1/d5/f8 x:0 0 0 2024-04-25T23:01:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:9/13: link l2 l4 0 2024-04-25T23:01:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/30: stat f4 0 2024-04-25T23:01:02.464 INFO:tasks.workunit.client.0.smithi043.stdout:5/36: creat d0/f6 x:0 0 0 2024-04-25T23:01:02.464 INFO:tasks.workunit.client.0.smithi043.stdout:6/25: symlink d1/l9 0 2024-04-25T23:01:02.464 INFO:tasks.workunit.client.0.smithi043.stdout:3/31: rename f3 to d7/fb 0 2024-04-25T23:01:02.464 INFO:tasks.workunit.client.0.smithi043.stdout:5/37: read - d0/f6 zero size 2024-04-25T23:01:02.464 INFO:tasks.workunit.client.0.smithi043.stdout:0/30: getdents . 0 2024-04-25T23:01:02.466 INFO:tasks.workunit.client.0.smithi043.stdout:5/38: creat d0/f7 x:0 0 0 2024-04-25T23:01:02.468 INFO:tasks.workunit.client.0.smithi043.stdout:3/32: write d7/fb [608324,46641] 0 2024-04-25T23:01:02.469 INFO:tasks.workunit.client.0.smithi043.stdout:5/39: mkdir d0/d8 0 2024-04-25T23:01:02.470 INFO:tasks.workunit.client.0.smithi043.stdout:3/33: symlink d7/lc 0 2024-04-25T23:01:02.471 INFO:tasks.workunit.client.0.smithi043.stdout:9/14: write f1 [4373327,13832] 0 2024-04-25T23:01:02.472 INFO:tasks.workunit.client.0.smithi043.stdout:5/40: creat d0/f9 x:0 0 0 2024-04-25T23:01:02.472 INFO:tasks.workunit.client.0.smithi043.stdout:9/15: symlink l5 0 2024-04-25T23:01:02.473 INFO:tasks.workunit.client.0.smithi043.stdout:3/34: symlink d7/ld 0 2024-04-25T23:01:02.474 INFO:tasks.workunit.client.0.smithi043.stdout:5/41: mknod d0/ca 0 2024-04-25T23:01:02.476 INFO:tasks.workunit.client.0.smithi043.stdout:3/35: dread - d7/fa zero size 2024-04-25T23:01:02.476 INFO:tasks.workunit.client.0.smithi043.stdout:4/14: dwrite d3/f6 [0,4194304] 0 2024-04-25T23:01:02.477 INFO:tasks.workunit.client.0.smithi043.stdout:6/26: dwrite d1/d5/f7 [0,4194304] 0 2024-04-25T23:01:02.477 INFO:tasks.workunit.client.0.smithi043.stdout:3/36: dread - d7/f9 zero size 2024-04-25T23:01:02.478 INFO:tasks.workunit.client.0.smithi043.stdout:0/31: dwrite f3 [0,4194304] 0 2024-04-25T23:01:02.478 INFO:tasks.workunit.client.0.smithi043.stdout:3/37: fsync f4 0 2024-04-25T23:01:02.478 INFO:tasks.workunit.client.0.smithi043.stdout:0/32: chown l0 0 1 2024-04-25T23:01:02.478 INFO:tasks.workunit.client.0.smithi043.stdout:6/27: write d1/d5/f8 [165394,91386] 0 2024-04-25T23:01:02.479 INFO:tasks.workunit.client.0.smithi043.stdout:9/16: link l0 l6 0 2024-04-25T23:01:02.480 INFO:tasks.workunit.client.0.smithi043.stdout:4/15: creat d3/f7 x:0 0 0 2024-04-25T23:01:02.480 INFO:tasks.workunit.client.0.smithi043.stdout:4/16: truncate d3/f5 287909 0 2024-04-25T23:01:02.480 INFO:tasks.workunit.client.0.smithi043.stdout:4/17: fdatasync d3/f7 0 2024-04-25T23:01:02.483 INFO:tasks.workunit.client.0.smithi043.stdout:0/33: dread f3 [0,4194304] 0 2024-04-25T23:01:02.483 INFO:tasks.workunit.client.0.smithi043.stdout:6/28: unlink d1/l3 0 2024-04-25T23:01:02.484 INFO:tasks.workunit.client.0.smithi043.stdout:9/17: rename l5 to l7 0 2024-04-25T23:01:02.486 INFO:tasks.workunit.client.0.smithi043.stdout:4/18: mkdir d3/d8 0 2024-04-25T23:01:02.486 INFO:tasks.workunit.client.0.smithi043.stdout:6/29: rmdir d1 39 2024-04-25T23:01:02.487 INFO:tasks.workunit.client.0.smithi043.stdout:6/30: stat d1/f4 0 2024-04-25T23:01:02.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/19: rename c1 to d3/c9 0 2024-04-25T23:01:02.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/20: readlink - no filename 2024-04-25T23:01:02.491 INFO:tasks.workunit.client.0.smithi043.stdout:4/21: creat d3/fa x:0 0 0 2024-04-25T23:01:02.491 INFO:tasks.workunit.client.0.smithi043.stdout:0/34: dread f3 [0,4194304] 0 2024-04-25T23:01:02.493 INFO:tasks.workunit.client.0.smithi043.stdout:3/38: dwrite f6 [0,4194304] 0 2024-04-25T23:01:02.493 INFO:tasks.workunit.client.0.smithi043.stdout:0/35: chown f3 105241100 1 2024-04-25T23:01:02.493 INFO:tasks.workunit.client.0.smithi043.stdout:6/31: dread d1/d5/f8 [0,4194304] 0 2024-04-25T23:01:02.494 INFO:tasks.workunit.client.0.smithi043.stdout:6/32: chown d1 492578 1 2024-04-25T23:01:02.495 INFO:tasks.workunit.client.0.smithi043.stdout:4/22: creat d3/d8/fb x:0 0 0 2024-04-25T23:01:02.495 INFO:tasks.workunit.client.0.smithi043.stdout:0/36: rename l1 to l5 0 2024-04-25T23:01:02.495 INFO:tasks.workunit.client.0.smithi043.stdout:0/37: rmdir - no directory 2024-04-25T23:01:02.496 INFO:tasks.workunit.client.0.smithi043.stdout:9/18: dwrite f1 [0,4194304] 0 2024-04-25T23:01:02.496 INFO:tasks.workunit.client.0.smithi043.stdout:4/23: mknod d3/d8/cc 0 2024-04-25T23:01:02.497 INFO:tasks.workunit.client.0.smithi043.stdout:0/38: symlink l6 0 2024-04-25T23:01:02.497 INFO:tasks.workunit.client.0.smithi043.stdout:9/19: mkdir d8 0 2024-04-25T23:01:02.498 INFO:tasks.workunit.client.0.smithi043.stdout:9/20: chown c3 148896537 1 2024-04-25T23:01:02.499 INFO:tasks.workunit.client.0.smithi043.stdout:0/39: symlink l7 0 2024-04-25T23:01:02.499 INFO:tasks.workunit.client.0.smithi043.stdout:4/24: creat d3/d8/fd x:0 0 0 2024-04-25T23:01:02.501 INFO:tasks.workunit.client.0.smithi043.stdout:9/21: write f1 [2439533,56462] 0 2024-04-25T23:01:02.501 INFO:tasks.workunit.client.0.smithi043.stdout:0/40: creat f8 x:0 0 0 2024-04-25T23:01:02.502 INFO:tasks.workunit.client.0.smithi043.stdout:9/22: write f1 [731125,45430] 0 2024-04-25T23:01:02.502 INFO:tasks.workunit.client.0.smithi043.stdout:0/41: rename f4 to f9 0 2024-04-25T23:01:02.502 INFO:tasks.workunit.client.0.smithi043.stdout:5/42: dread d0/f5 [0,4194304] 0 2024-04-25T23:01:02.504 INFO:tasks.workunit.client.0.smithi043.stdout:6/33: dread d1/d5/f7 [0,4194304] 0 2024-04-25T23:01:02.504 INFO:tasks.workunit.client.0.smithi043.stdout:3/39: dwrite f4 [0,4194304] 0 2024-04-25T23:01:02.506 INFO:tasks.workunit.client.0.smithi043.stdout:3/40: mkdir d7/de 0 2024-04-25T23:01:02.506 INFO:tasks.workunit.client.0.smithi043.stdout:3/41: rename f4 to d7/ff 0 2024-04-25T23:01:02.507 INFO:tasks.workunit.client.0.smithi043.stdout:3/42: chown d7/ff 216 1 2024-04-25T23:01:02.508 INFO:tasks.workunit.client.0.smithi043.stdout:3/43: chown d7/de 2 1 2024-04-25T23:01:02.508 INFO:tasks.workunit.client.0.smithi043.stdout:9/23: dread f1 [0,4194304] 0 2024-04-25T23:01:02.508 INFO:tasks.workunit.client.0.smithi043.stdout:9/24: rename d8 to d8/d9 22 2024-04-25T23:01:02.511 INFO:tasks.workunit.client.0.smithi043.stdout:4/25: rename d3/d8 to d3/de 0 2024-04-25T23:01:02.511 INFO:tasks.workunit.client.0.smithi043.stdout:0/42: rename f9 to fa 0 2024-04-25T23:01:02.512 INFO:tasks.workunit.client.0.smithi043.stdout:4/26: write d3/fa [997258,46001] 0 2024-04-25T23:01:02.512 INFO:tasks.workunit.client.0.smithi043.stdout:4/27: truncate d3/f4 768362 0 2024-04-25T23:01:02.513 INFO:tasks.workunit.client.0.smithi043.stdout:6/34: dread d1/f4 [0,4194304] 0 2024-04-25T23:01:02.514 INFO:tasks.workunit.client.0.smithi043.stdout:6/35: rename d1/f4 to d1/fa 0 2024-04-25T23:01:02.517 INFO:tasks.workunit.client.0.smithi043.stdout:3/44: fdatasync d7/ff 0 2024-04-25T23:01:02.519 INFO:tasks.workunit.client.0.smithi043.stdout:3/45: mkdir d7/de/d10 0 2024-04-25T23:01:02.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/43: dwrite fa [0,4194304] 0 2024-04-25T23:01:02.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/44: creat fb x:0 0 0 2024-04-25T23:01:02.520 INFO:tasks.workunit.client.0.smithi043.stdout:3/46: getdents d7/de/d10 0 2024-04-25T23:01:02.520 INFO:tasks.workunit.client.0.smithi043.stdout:0/45: mknod cc 0 2024-04-25T23:01:02.521 INFO:tasks.workunit.client.0.smithi043.stdout:0/46: unlink cc 0 2024-04-25T23:01:02.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/47: link f5 d7/f11 0 2024-04-25T23:01:02.521 INFO:tasks.workunit.client.0.smithi043.stdout:0/47: creat fd x:0 0 0 2024-04-25T23:01:02.521 INFO:tasks.workunit.client.0.smithi043.stdout:0/48: stat f8 0 2024-04-25T23:01:02.522 INFO:tasks.workunit.client.0.smithi043.stdout:0/49: write fd [167899,28776] 0 2024-04-25T23:01:02.522 INFO:tasks.workunit.client.0.smithi043.stdout:3/48: link d7/lc d7/de/l12 0 2024-04-25T23:01:02.523 INFO:tasks.workunit.client.0.smithi043.stdout:0/50: read fa [3274165,97246] 0 2024-04-25T23:01:02.523 INFO:tasks.workunit.client.0.smithi043.stdout:0/51: stat fd 0 2024-04-25T23:01:02.523 INFO:tasks.workunit.client.0.smithi043.stdout:3/49: rename d7/ff to d7/de/f13 0 2024-04-25T23:01:02.523 INFO:tasks.workunit.client.0.smithi043.stdout:3/50: rmdir d7/de 39 2024-04-25T23:01:02.524 INFO:tasks.workunit.client.0.smithi043.stdout:3/51: unlink d7/f11 0 2024-04-25T23:01:02.525 INFO:tasks.workunit.client.0.smithi043.stdout:3/52: mknod d7/c14 0 2024-04-25T23:01:02.526 INFO:tasks.workunit.client.0.smithi043.stdout:3/53: creat d7/de/f15 x:0 0 0 2024-04-25T23:01:02.526 INFO:tasks.workunit.client.0.smithi043.stdout:4/28: getdents d3 0 2024-04-25T23:01:02.526 INFO:tasks.workunit.client.0.smithi043.stdout:9/25: fsync f1 0 2024-04-25T23:01:02.527 INFO:tasks.workunit.client.0.smithi043.stdout:6/36: fsync d1/fa 0 2024-04-25T23:01:02.529 INFO:tasks.workunit.client.0.smithi043.stdout:6/37: link d1/l9 d1/lb 0 2024-04-25T23:01:02.529 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:02.526+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:02.530 INFO:tasks.workunit.client.0.smithi043.stdout:6/38: unlink d1/d5/f8 0 2024-04-25T23:01:02.537 INFO:tasks.workunit.client.0.smithi043.stdout:0/52: dwrite fa [4194304,4194304] 0 2024-04-25T23:01:02.539 INFO:tasks.workunit.client.0.smithi043.stdout:0/53: creat fe x:0 0 0 2024-04-25T23:01:02.541 INFO:tasks.workunit.client.0.smithi043.stdout:3/54: dwrite d7/de/f15 [0,4194304] 0 2024-04-25T23:01:02.542 INFO:tasks.workunit.client.0.smithi043.stdout:9/26: dwrite f1 [4194304,4194304] 0 2024-04-25T23:01:02.542 INFO:tasks.workunit.client.0.smithi043.stdout:0/54: fsync f3 0 2024-04-25T23:01:02.544 INFO:tasks.workunit.client.0.smithi043.stdout:3/55: symlink d7/de/l16 0 2024-04-25T23:01:02.544 INFO:tasks.workunit.client.0.smithi043.stdout:0/55: write fe [922466,120612] 0 2024-04-25T23:01:02.544 INFO:tasks.workunit.client.0.smithi043.stdout:6/39: dread d1/d5/f7 [0,4194304] 0 2024-04-25T23:01:02.545 INFO:tasks.workunit.client.0.smithi043.stdout:4/29: dwrite d3/de/fd [0,4194304] 0 2024-04-25T23:01:02.547 INFO:tasks.workunit.client.0.smithi043.stdout:0/56: write fe [795174,71025] 0 2024-04-25T23:01:02.547 INFO:tasks.workunit.client.0.smithi043.stdout:3/56: creat d7/de/f17 x:0 0 0 2024-04-25T23:01:02.548 INFO:tasks.workunit.client.0.smithi043.stdout:6/40: creat d1/d5/fc x:0 0 0 2024-04-25T23:01:02.548 INFO:tasks.workunit.client.0.smithi043.stdout:3/57: dread - d7/de/f17 zero size 2024-04-25T23:01:02.548 INFO:tasks.workunit.client.0.smithi043.stdout:4/30: write d3/de/fd [1500228,122007] 0 2024-04-25T23:01:02.550 INFO:tasks.workunit.client.0.smithi043.stdout:3/58: truncate f5 96735 0 2024-04-25T23:01:02.550 INFO:tasks.workunit.client.0.smithi043.stdout:9/27: dread f1 [4194304,4194304] 0 2024-04-25T23:01:02.550 INFO:tasks.workunit.client.0.smithi043.stdout:4/31: write d3/f5 [799883,32263] 0 2024-04-25T23:01:02.550 INFO:tasks.workunit.client.0.smithi043.stdout:4/32: fsync d3/de/fb 0 2024-04-25T23:01:02.551 INFO:tasks.workunit.client.0.smithi043.stdout:9/28: mknod d8/ca 0 2024-04-25T23:01:02.552 INFO:tasks.workunit.client.0.smithi043.stdout:3/59: rename f6 to d7/f18 0 2024-04-25T23:01:02.553 INFO:tasks.workunit.client.0.smithi043.stdout:9/29: readlink l4 0 2024-04-25T23:01:02.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/60: rmdir d7/de/d10 0 2024-04-25T23:01:02.558 INFO:tasks.workunit.client.0.smithi043.stdout:6/41: dwrite d1/fa [0,4194304] 0 2024-04-25T23:01:02.558 INFO:tasks.workunit.client.0.smithi043.stdout:9/30: dread f1 [0,4194304] 0 2024-04-25T23:01:02.559 INFO:tasks.workunit.client.0.smithi043.stdout:3/61: dread d7/f18 [0,4194304] 0 2024-04-25T23:01:02.559 INFO:tasks.workunit.client.0.smithi043.stdout:6/42: creat d1/d5/fd x:0 0 0 2024-04-25T23:01:02.560 INFO:tasks.workunit.client.0.smithi043.stdout:6/43: readlink d1/lb 0 2024-04-25T23:01:02.560 INFO:tasks.workunit.client.0.smithi043.stdout:3/62: unlink d7/de/l12 0 2024-04-25T23:01:02.561 INFO:tasks.workunit.client.0.smithi043.stdout:6/44: creat d1/fe x:0 0 0 2024-04-25T23:01:02.566 INFO:tasks.workunit.client.0.smithi043.stdout:3/63: dread d7/fb [0,4194304] 0 2024-04-25T23:01:02.567 INFO:tasks.workunit.client.0.smithi043.stdout:3/64: fsync d7/f8 0 2024-04-25T23:01:02.567 INFO:tasks.workunit.client.0.smithi043.stdout:9/31: dwrite f1 [4194304,4194304] 0 2024-04-25T23:01:02.567 INFO:tasks.workunit.client.0.smithi043.stdout:3/65: stat d7/de 0 2024-04-25T23:01:02.567 INFO:tasks.workunit.client.0.smithi043.stdout:9/32: stat l2 0 2024-04-25T23:01:02.568 INFO:tasks.workunit.client.0.smithi043.stdout:3/66: truncate d7/de/f17 531003 0 2024-04-25T23:01:02.568 INFO:tasks.workunit.client.0.smithi043.stdout:0/57: fdatasync fe 0 2024-04-25T23:01:02.568 INFO:tasks.workunit.client.0.smithi043.stdout:3/67: chown d7/fa 14640095 1 2024-04-25T23:01:02.569 INFO:tasks.workunit.client.0.smithi043.stdout:3/68: rmdir d7 39 2024-04-25T23:01:02.569 INFO:tasks.workunit.client.0.smithi043.stdout:0/58: truncate fe 260429 0 2024-04-25T23:01:02.570 INFO:tasks.workunit.client.0.smithi043.stdout:0/59: mknod cf 0 2024-04-25T23:01:02.570 INFO:tasks.workunit.client.0.smithi043.stdout:3/69: link d7/lc d7/l19 0 2024-04-25T23:01:02.570 INFO:tasks.workunit.client.0.smithi043.stdout:0/60: write f8 [347966,94545] 0 2024-04-25T23:01:02.572 INFO:tasks.workunit.client.0.smithi043.stdout:0/61: write f8 [1426380,75040] 0 2024-04-25T23:01:02.572 INFO:tasks.workunit.client.0.smithi043.stdout:3/70: unlink d7/lc 0 2024-04-25T23:01:02.572 INFO:tasks.workunit.client.0.smithi043.stdout:3/71: chown d7/de 9178 1 2024-04-25T23:01:02.572 INFO:tasks.workunit.client.0.smithi043.stdout:0/62: chown cf 171472485 1 2024-04-25T23:01:02.572 INFO:tasks.workunit.client.0.smithi043.stdout:3/72: chown d7/de/f15 8191 1 2024-04-25T23:01:02.573 INFO:tasks.workunit.client.0.smithi043.stdout:4/33: truncate d3/fa 147872 0 2024-04-25T23:01:02.573 INFO:tasks.workunit.client.0.smithi043.stdout:3/73: chown d7/de 191822 1 2024-04-25T23:01:02.575 INFO:tasks.workunit.client.0.smithi043.stdout:4/34: dread d3/f4 [0,4194304] 0 2024-04-25T23:01:02.576 INFO:tasks.workunit.client.0.smithi043.stdout:4/35: dread d3/f4 [0,4194304] 0 2024-04-25T23:01:02.577 INFO:tasks.workunit.client.0.smithi043.stdout:3/74: dread d7/fa [0,4194304] 0 2024-04-25T23:01:02.577 INFO:tasks.workunit.client.0.smithi043.stdout:4/36: chown d3/de/fb 11 1 2024-04-25T23:01:02.577 INFO:tasks.workunit.client.0.smithi043.stdout:4/37: mknod d3/cf 0 2024-04-25T23:01:02.577 INFO:tasks.workunit.client.0.smithi043.stdout:3/75: mkdir d7/de/d1a 0 2024-04-25T23:01:02.578 INFO:tasks.workunit.client.0.smithi043.stdout:3/76: chown d7/f18 48531 1 2024-04-25T23:01:02.581 INFO:tasks.workunit.client.0.smithi043.stdout:9/33: truncate f1 7357515 0 2024-04-25T23:01:02.582 INFO:tasks.workunit.client.0.smithi043.stdout:9/34: chown l4 0 1 2024-04-25T23:01:02.584 INFO:tasks.workunit.client.0.smithi043.stdout:4/38: dwrite d3/de/fb [0,4194304] 0 2024-04-25T23:01:02.585 INFO:tasks.workunit.client.0.smithi043.stdout:3/77: dwrite d7/fb [0,4194304] 0 2024-04-25T23:01:02.586 INFO:tasks.workunit.client.0.smithi043.stdout:4/39: rename d3/c9 to d3/de/c10 0 2024-04-25T23:01:02.587 INFO:tasks.workunit.client.0.smithi043.stdout:4/40: mknod d3/c11 0 2024-04-25T23:01:02.588 INFO:tasks.workunit.client.0.smithi043.stdout:4/41: write d3/f7 [289315,30746] 0 2024-04-25T23:01:02.589 INFO:tasks.workunit.client.0.smithi043.stdout:4/42: rmdir d3 39 2024-04-25T23:01:02.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/43: write d3/f7 [1312885,107026] 0 2024-04-25T23:01:02.591 INFO:tasks.workunit.client.0.smithi043.stdout:4/44: write d3/f6 [2242424,75161] 0 2024-04-25T23:01:02.591 INFO:tasks.workunit.client.0.smithi043.stdout:9/35: dread f1 [0,4194304] 0 2024-04-25T23:01:02.591 INFO:tasks.workunit.client.0.smithi043.stdout:9/36: chown d8 944839 1 2024-04-25T23:01:02.591 INFO:tasks.workunit.client.0.smithi043.stdout:4/45: read d3/f6 [3318418,96432] 0 2024-04-25T23:01:02.592 INFO:tasks.workunit.client.0.smithi043.stdout:9/37: link l7 d8/lb 0 2024-04-25T23:01:02.593 INFO:tasks.workunit.client.0.smithi043.stdout:9/38: write f1 [2982765,94541] 0 2024-04-25T23:01:02.596 INFO:tasks.workunit.client.0.smithi043.stdout:3/78: rename d7/ld to d7/l1b 0 2024-04-25T23:01:02.597 INFO:tasks.workunit.client.0.smithi043.stdout:3/79: stat d7/f9 0 2024-04-25T23:01:02.597 INFO:tasks.workunit.client.0.smithi043.stdout:3/80: chown d7 127147318 1 2024-04-25T23:01:02.601 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:02.601 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:02.603 INFO:tasks.workunit.client.0.smithi043.stdout:3/81: dwrite d7/de/f13 [0,4194304] 0 2024-04-25T23:01:02.604 INFO:tasks.workunit.client.0.smithi043.stdout:3/82: symlink d7/de/d1a/l1c 0 2024-04-25T23:01:02.605 INFO:tasks.workunit.client.0.smithi043.stdout:3/83: creat d7/de/d1a/f1d x:0 0 0 2024-04-25T23:01:02.606 INFO:tasks.workunit.client.0.smithi043.stdout:3/84: creat d7/de/d1a/f1e x:0 0 0 2024-04-25T23:01:02.606 INFO:tasks.workunit.client.0.smithi043.stdout:9/39: truncate f1 6074592 0 2024-04-25T23:01:02.612 INFO:tasks.workunit.client.0.smithi043.stdout:3/85: unlink d7/l1b 0 2024-04-25T23:01:02.613 INFO:tasks.workunit.client.0.smithi043.stdout:9/40: write f1 [2580215,52562] 0 2024-04-25T23:01:02.613 INFO:tasks.workunit.client.0.smithi043.stdout:4/46: truncate d3/fa 889688 0 2024-04-25T23:01:02.613 INFO:tasks.workunit.client.0.smithi043.stdout:3/86: unlink f5 0 2024-04-25T23:01:02.613 INFO:tasks.workunit.client.0.smithi043.stdout:9/41: readlink l0 0 2024-04-25T23:01:02.613 INFO:tasks.workunit.client.0.smithi043.stdout:4/47: symlink d3/de/l12 0 2024-04-25T23:01:02.614 INFO:tasks.workunit.client.0.smithi043.stdout:3/87: rmdir d7/de/d1a 39 2024-04-25T23:01:02.614 INFO:tasks.workunit.client.0.smithi043.stdout:9/42: chown l7 788 1 2024-04-25T23:01:02.614 INFO:tasks.workunit.client.0.smithi043.stdout:9/43: creat d8/fc x:0 0 0 2024-04-25T23:01:02.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:02.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/48: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:02.621 INFO:tasks.workunit.client.0.smithi043.stdout:9/44: dwrite f1 [4194304,4194304] 0 2024-04-25T23:01:02.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/45: creat d8/fd x:0 0 0 2024-04-25T23:01:02.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/46: write d8/fc [78471,54581] 0 2024-04-25T23:01:02.626 INFO:tasks.workunit.client.0.smithi043.stdout:9/47: mkdir d8/de 0 2024-04-25T23:01:02.626 INFO:tasks.workunit.client.0.smithi043.stdout:9/48: symlink d8/lf 0 2024-04-25T23:01:02.630 INFO:tasks.workunit.client.0.smithi043.stdout:4/49: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:02.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/50: creat d3/de/f13 x:0 0 0 2024-04-25T23:01:02.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/51: creat d3/de/f14 x:0 0 0 2024-04-25T23:01:02.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/52: fsync d3/f4 0 2024-04-25T23:01:02.633 INFO:tasks.workunit.client.0.smithi043.stdout:9/49: dread d8/fc [0,4194304] 0 2024-04-25T23:01:02.634 INFO:tasks.workunit.client.0.smithi043.stdout:9/50: rmdir d8 39 2024-04-25T23:01:02.635 INFO:tasks.workunit.client.0.smithi043.stdout:9/51: fsync d8/fc 0 2024-04-25T23:01:02.635 INFO:tasks.workunit.client.0.smithi043.stdout:9/52: creat d8/de/f10 x:0 0 0 2024-04-25T23:01:02.636 INFO:tasks.workunit.client.0.smithi043.stdout:9/53: rename d8/de to d8/de/d11 22 2024-04-25T23:01:02.636 INFO:tasks.workunit.client.0.smithi043.stdout:9/54: write d8/fc [881677,76530] 0 2024-04-25T23:01:02.637 INFO:tasks.workunit.client.0.smithi043.stdout:9/55: mkdir d8/de/d12 0 2024-04-25T23:01:02.637 INFO:tasks.workunit.client.0.smithi043.stdout:9/56: dread - d8/de/f10 zero size 2024-04-25T23:01:02.638 INFO:tasks.workunit.client.0.smithi043.stdout:9/57: write d8/fc [142517,6845] 0 2024-04-25T23:01:02.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/58: mknod d8/de/c13 0 2024-04-25T23:01:02.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/59: rename d8/ca to d8/c14 0 2024-04-25T23:01:02.643 INFO:tasks.workunit.client.0.smithi043.stdout:4/53: dwrite d3/f4 [0,4194304] 0 2024-04-25T23:01:02.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/60: dread f1 [4194304,4194304] 0 2024-04-25T23:01:02.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/54: unlink d3/de/l12 0 2024-04-25T23:01:02.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/55: readlink - no filename 2024-04-25T23:01:02.645 INFO:tasks.workunit.client.0.smithi043.stdout:9/61: mkdir d8/de/d12/d15 0 2024-04-25T23:01:02.647 INFO:tasks.workunit.client.0.smithi043.stdout:9/62: getdents d8/de 0 2024-04-25T23:01:02.647 INFO:tasks.workunit.client.0.smithi043.stdout:9/63: chown c3 116242 1 2024-04-25T23:01:02.648 INFO:tasks.workunit.client.0.smithi043.stdout:4/56: dread d3/f6 [0,4194304] 0 2024-04-25T23:01:02.649 INFO:tasks.workunit.client.0.smithi043.stdout:4/57: link d3/f6 d3/f15 0 2024-04-25T23:01:02.653 INFO:tasks.workunit.client.0.smithi043.stdout:4/58: dread d3/de/fd [0,4194304] 0 2024-04-25T23:01:02.653 INFO:tasks.workunit.client.0.smithi043.stdout:9/64: dwrite f1 [0,4194304] 0 2024-04-25T23:01:02.655 INFO:tasks.workunit.client.0.smithi043.stdout:9/65: getdents d8 0 2024-04-25T23:01:02.660 INFO:tasks.workunit.client.0.smithi043.stdout:4/59: dwrite d3/f4 [0,4194304] 0 2024-04-25T23:01:02.661 INFO:tasks.workunit.client.0.smithi043.stdout:4/60: write d3/de/f13 [82582,41989] 0 2024-04-25T23:01:02.663 INFO:tasks.workunit.client.0.smithi043.stdout:4/61: chown d3/de/fb 869536154 1 2024-04-25T23:01:02.663 INFO:tasks.workunit.client.0.smithi043.stdout:9/66: dwrite f1 [4194304,4194304] 0 2024-04-25T23:01:02.663 INFO:tasks.workunit.client.0.smithi043.stdout:9/67: stat f1 0 2024-04-25T23:01:02.663 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:02.662+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:02.664 INFO:tasks.workunit.client.0.smithi043.stdout:9/68: mkdir d8/de/d12/d16 0 2024-04-25T23:01:02.666 INFO:tasks.workunit.client.0.smithi043.stdout:9/69: creat d8/de/d12/d15/f17 x:0 0 0 2024-04-25T23:01:02.667 INFO:tasks.workunit.client.0.smithi043.stdout:4/62: dread d3/f15 [0,4194304] 0 2024-04-25T23:01:02.668 INFO:tasks.workunit.client.0.smithi043.stdout:4/63: rename d3/c11 to d3/c16 0 2024-04-25T23:01:02.670 INFO:tasks.workunit.client.0.smithi043.stdout:4/64: symlink d3/l17 0 2024-04-25T23:01:02.673 INFO:tasks.workunit.client.0.smithi043.stdout:9/70: dwrite d8/de/d12/d15/f17 [0,4194304] 0 2024-04-25T23:01:02.675 INFO:tasks.workunit.client.0.smithi043.stdout:9/71: mkdir d8/de/d12/d16/d18 0 2024-04-25T23:01:02.676 INFO:tasks.workunit.client.0.smithi043.stdout:9/72: write d8/de/f10 [203245,52775] 0 2024-04-25T23:01:02.677 INFO:tasks.workunit.client.0.smithi043.stdout:9/73: chown d8/lb 15898 1 2024-04-25T23:01:02.677 INFO:tasks.workunit.client.0.smithi043.stdout:4/65: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:02.678 INFO:tasks.workunit.client.0.smithi043.stdout:4/66: rename d3/de/fb to d3/de/f18 0 2024-04-25T23:01:02.679 INFO:tasks.workunit.client.0.smithi043.stdout:4/67: mkdir d3/d19 0 2024-04-25T23:01:02.689 INFO:tasks.workunit.client.0.smithi043.stdout:4/68: dwrite d3/fa [0,4194304] 0 2024-04-25T23:01:02.694 INFO:tasks.workunit.client.0.smithi043.stdout:4/69: dread d3/de/fd [0,4194304] 0 2024-04-25T23:01:02.694 INFO:tasks.workunit.client.0.smithi043.stdout:4/70: chown d3/de/c10 8222469 1 2024-04-25T23:01:02.695 INFO:tasks.workunit.client.0.smithi043.stdout:4/71: rename d3/f6 to d3/de/f1a 0 2024-04-25T23:01:02.695 INFO:tasks.workunit.client.0.smithi043.stdout:4/72: readlink d3/l17 0 2024-04-25T23:01:02.696 INFO:tasks.workunit.client.0.smithi043.stdout:4/73: link d3/f15 d3/f1b 0 2024-04-25T23:01:02.697 INFO:tasks.workunit.client.0.smithi043.stdout:4/74: rename d3/l17 to d3/l1c 0 2024-04-25T23:01:02.697 INFO:tasks.workunit.client.0.smithi043.stdout:4/75: creat d3/de/f1d x:0 0 0 2024-04-25T23:01:02.698 INFO:tasks.workunit.client.0.smithi043.stdout:4/76: chown d3/f4 22248773 1 2024-04-25T23:01:02.704 INFO:tasks.workunit.client.0.smithi043.stdout:4/77: dwrite d3/de/f1a [4194304,4194304] 0 2024-04-25T23:01:02.708 INFO:tasks.workunit.client.0.smithi043.stdout:4/78: dread d3/fa [0,4194304] 0 2024-04-25T23:01:02.709 INFO:tasks.workunit.client.0.smithi043.stdout:4/79: dread - d3/de/f14 zero size 2024-04-25T23:01:02.712 INFO:tasks.workunit.client.0.smithi043.stdout:4/80: truncate d3/f1b 8342692 0 2024-04-25T23:01:02.713 INFO:tasks.workunit.client.0.smithi043.stdout:4/81: creat d3/d19/f1e x:0 0 0 2024-04-25T23:01:02.719 INFO:tasks.workunit.client.0.smithi043.stdout:4/82: dwrite d3/de/f1d [0,4194304] 0 2024-04-25T23:01:02.724 INFO:tasks.workunit.client.0.smithi043.stdout:4/83: truncate d3/f5 1579601 0 2024-04-25T23:01:02.728 INFO:tasks.workunit.client.0.smithi043.stdout:4/84: truncate d3/de/f18 3804892 0 2024-04-25T23:01:02.729 INFO:tasks.workunit.client.0.smithi043.stdout:4/85: symlink d3/d19/l1f 0 2024-04-25T23:01:02.729 INFO:tasks.workunit.client.0.smithi043.stdout:4/86: symlink d3/l20 0 2024-04-25T23:01:02.730 INFO:tasks.workunit.client.0.smithi043.stdout:4/87: mkdir d3/d21 0 2024-04-25T23:01:02.730 INFO:tasks.workunit.client.0.smithi043.stdout:4/88: dread - d3/de/f14 zero size 2024-04-25T23:01:02.731 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:02.724+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:02.731 INFO:tasks.workunit.client.0.smithi043.stdout:4/89: chown d3/de/f13 3 1 2024-04-25T23:01:02.734 INFO:tasks.workunit.client.0.smithi043.stdout:4/90: dread d3/fa [0,4194304] 0 2024-04-25T23:01:02.735 INFO:tasks.workunit.client.0.smithi043.stdout:4/91: dread d3/de/f13 [0,4194304] 0 2024-04-25T23:01:02.735 INFO:tasks.workunit.client.0.smithi043.stdout:4/92: dread - d3/d19/f1e zero size 2024-04-25T23:01:02.736 INFO:tasks.workunit.client.0.smithi043.stdout:4/93: unlink d3/f15 0 2024-04-25T23:01:02.736 INFO:tasks.workunit.client.0.smithi043.stdout:4/94: fsync d3/de/fd 0 2024-04-25T23:01:02.739 INFO:tasks.workunit.client.0.smithi043.stdout:4/95: dread d3/fa [0,4194304] 0 2024-04-25T23:01:02.740 INFO:tasks.workunit.client.0.smithi043.stdout:4/96: unlink d3/f1b 0 2024-04-25T23:01:02.741 INFO:tasks.workunit.client.0.smithi043.stdout:4/97: creat d3/d19/f22 x:0 0 0 2024-04-25T23:01:02.741 INFO:tasks.workunit.client.0.smithi043.stdout:4/98: chown d3/cf 158318 1 2024-04-25T23:01:02.741 INFO:tasks.workunit.client.0.smithi043.stdout:4/99: dread - d3/de/f14 zero size 2024-04-25T23:01:02.755 INFO:tasks.workunit.client.0.smithi043.stdout:4/100: dwrite d3/de/f18 [0,4194304] 0 2024-04-25T23:01:02.760 INFO:tasks.workunit.client.0.smithi043.stdout:4/101: dread d3/de/fd [0,4194304] 0 2024-04-25T23:01:02.760 INFO:tasks.workunit.client.0.smithi043.stdout:4/102: unlink d3/cf 0 2024-04-25T23:01:02.761 INFO:tasks.workunit.client.0.smithi043.stdout:4/103: write d3/f4 [3309319,49878] 0 2024-04-25T23:01:02.762 INFO:tasks.workunit.client.0.smithi043.stdout:4/104: getdents d3/de 0 2024-04-25T23:01:02.763 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:02.763 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:02.770 INFO:tasks.workunit.client.0.smithi043.stdout:4/105: dread d3/f7 [0,4194304] 0 2024-04-25T23:01:02.771 INFO:tasks.workunit.client.0.smithi043.stdout:4/106: symlink d3/l23 0 2024-04-25T23:01:02.772 INFO:tasks.workunit.client.0.smithi043.stdout:4/107: link d3/d19/f22 d3/f24 0 2024-04-25T23:01:02.773 INFO:tasks.workunit.client.0.smithi043.stdout:4/108: write d3/f7 [997055,86970] 0 2024-04-25T23:01:02.774 INFO:tasks.workunit.client.0.smithi043.stdout:4/109: rename d3/de/f18 to d3/d21/f25 0 2024-04-25T23:01:02.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:02.780 INFO:tasks.workunit.client.0.smithi043.stdout:4/110: dwrite d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:02.788 INFO:tasks.workunit.client.0.smithi043.stdout:4/111: dwrite d3/de/fd [0,4194304] 0 2024-04-25T23:01:02.789 INFO:tasks.workunit.client.0.smithi043.stdout:4/112: mknod d3/d21/c26 0 2024-04-25T23:01:02.791 INFO:tasks.workunit.client.0.smithi043.stdout:4/113: write d3/d21/f25 [1787855,29855] 0 2024-04-25T23:01:02.796 INFO:tasks.workunit.client.0.smithi043.stdout:4/114: truncate d3/f4 1408199 0 2024-04-25T23:01:02.796 INFO:tasks.workunit.client.0.smithi043.stdout:4/115: stat d3/de/f1a 0 2024-04-25T23:01:02.796 INFO:tasks.workunit.client.0.smithi043.stdout:4/116: readlink d3/d19/l1f 0 2024-04-25T23:01:02.797 INFO:tasks.workunit.client.0.smithi043.stdout:4/117: mkdir d3/de/d27 0 2024-04-25T23:01:02.798 INFO:tasks.workunit.client.0.smithi043.stdout:4/118: chown d3/c16 1 1 2024-04-25T23:01:02.799 INFO:tasks.workunit.client.0.smithi043.stdout:4/119: dread d3/f7 [0,4194304] 0 2024-04-25T23:01:02.799 INFO:tasks.workunit.client.0.smithi043.stdout:4/120: readlink d3/l20 0 2024-04-25T23:01:02.805 INFO:tasks.workunit.client.0.smithi043.stdout:4/121: dwrite d3/d19/f1e [0,4194304] 0 2024-04-25T23:01:02.806 INFO:tasks.workunit.client.0.smithi043.stdout:4/122: dread - d3/de/f14 zero size 2024-04-25T23:01:02.811 INFO:tasks.workunit.client.0.smithi043.stdout:4/123: write d3/f4 [152950,119257] 0 2024-04-25T23:01:02.812 INFO:tasks.workunit.client.0.smithi043.stdout:4/124: truncate d3/de/f13 1082164 0 2024-04-25T23:01:02.831 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:02.830+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:02.932 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:02.928+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:02.952 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:02.952 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:02.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:03.051 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.048+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:03.129 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:03.129 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:03.133 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:03.130+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:03.145 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:03.234 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.232+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:03.276 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:03.276 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:03.290 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:03.309 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:01:03.335 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:03.334+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:03.409 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:03.409 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:03.423 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:03.435 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.432+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:03.536 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.536+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:03.589 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:03.589 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:03.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:03.651 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.648+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:03.736 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:03.736 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:03.737 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.732+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:03.751 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:03.839 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.836+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:03.915 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:03.915 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:03.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:03.972 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:03.968+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:04.039 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:04.038+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:04.096 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:04.096 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:04.110 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:04.140 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:04.136+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:04.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:04.241 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:04.241 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:04.241 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:04.238+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:04.255 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:04.339 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:04.339 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:04.342 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:04.336+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:04.358 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:04.359 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:04.359 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:04.362 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:04.363 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:04.421 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:04.421 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:04.422 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:04.422 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:04.422 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:04.435 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:04.442 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:04.440+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:04.543 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:04.542+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:04.557 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:04.557 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:04.557 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:04.557 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:04.557 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.557 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.557 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.702104443, 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.558 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.559 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.560 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.561 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:04.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.702030104, 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:04.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:04.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701996730999999, 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:04.569 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:04.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.573 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701918828, 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.575 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:04.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:04.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:04.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701867542, 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:04.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:04.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701837509000001, 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:04.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:04.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701797936, 2024-04-25T23:01:04.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:04.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.597 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701768243, 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:04.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.603 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701696356999999, 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:04.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:04.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:04.608 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.701661977000001, 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:04.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:04.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.614 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.70163222, 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:04.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:04.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.694365535999999, 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:04.620 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:04.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:04.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:04.624 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 1157912~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.684516820000001, 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051865150999999998, 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869047+0000", 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869048+0000", 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6300000000000004e-07 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869052+0000", 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.284e-06 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869067+0000", 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4973e-05 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869074+0000", 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3429999999999998e-06 2024-04-25T23:01:04.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914821+0000", 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045746811999999998 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914912+0000", 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0359999999999995e-05 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915061+0000", 2024-04-25T23:01:04.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000149758 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919434+0000", 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0043721209999999996 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920692+0000", 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012584950000000001 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920813+0000", 2024-04-25T23:01:04.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120993 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920912+0000", 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9248999999999998e-05 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.630 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 1159841~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.684479954, 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052040279000000002, 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869085+0000", 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869096+0000", 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.116e-05 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869105+0000", 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5829999999999996e-06 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869115+0000", 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8300000000000008e-06 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915654+0000", 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046539035999999999 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915763+0000", 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000108386 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915936+0000", 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017375499999999999 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919499+0000", 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003562352 2024-04-25T23:01:04.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920932+0000", 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001433272 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921061+0000", 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000128782 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921124+0000", 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3423000000000006e-05 2024-04-25T23:01:04.635 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.684438191, 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.637 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.638 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.639 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:04.640 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.681118210999999, 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.641 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.642 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.643 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.644 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:04.645 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.680970149, 2024-04-25T23:01:04.646 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.647 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:04.648 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:04.649 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.650 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.651 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.680427318, 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.652 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:04.653 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.654 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.655 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:04.656 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 1176983~12745 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.676073171000001, 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052162238, 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.657 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.658 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877501+0000", 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877538+0000", 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7246000000000002e-05 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877568+0000", 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9799999999999999e-05 2024-04-25T23:01:04.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877605+0000", 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7506000000000003e-05 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923423+0000", 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045818151000000001 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923549+0000", 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012604700000000001 2024-04-25T23:01:04.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923732+0000", 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018251300000000001 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926357+0000", 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026246160000000002 2024-04-25T23:01:04.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929490+0000", 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031331610000000002 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929575+0000", 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5575999999999995e-05 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929653+0000", 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7775000000000007e-05 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.674435667999999, 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:04.663 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:04.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:04.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:04.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:04.668 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:04.669 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:04.671 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:04.675 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:04.664+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:04.676 INFO:tasks.workunit.client.0.smithi043.stdout:1/0: sync 2024-04-25T23:01:04.676 INFO:tasks.workunit.client.0.smithi043.stdout:1/1: mkdir d0 0 2024-04-25T23:01:04.676 INFO:tasks.workunit.client.0.smithi043.stdout:1/2: creat d0/f1 x:0 0 0 2024-04-25T23:01:04.676 INFO:tasks.workunit.client.0.smithi043.stdout:1/3: creat d0/f2 x:0 0 0 2024-04-25T23:01:04.676 INFO:tasks.workunit.client.0.smithi043.stdout:1/4: write d0/f2 [579432,123731] 0 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/5: write d0/f2 [943241,120849] 0 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/6: truncate d0/f1 7379 0 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/7: creat d0/f3 x:0 0 0 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/8: creat d0/f4 x:0 0 0 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/9: chown d0/f3 57511027 1 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/10: creat d0/f5 x:0 0 0 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:8/5: sync 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:2/7: sync 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:2/8: rmdir - no directory 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:0/63: sync 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:7/8: sync 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:6/45: sync 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:5/43: sync 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:9/74: sync 2024-04-25T23:01:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:3/88: sync 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:4/125: sync 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:5/44: truncate d0/f6 193938 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:9/75: write d8/de/d12/d15/f17 [5009274,45619] 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:9/76: write d8/de/d12/d15/f17 [3901177,17320] 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:7/9: dwrite f1 [0,4194304] 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:9/77: dwrite d8/de/d12/d15/f17 [0,4194304] 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:1/11: getdents d0 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:2/9: creat f1 x:0 0 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:4/126: rename d3/de/f1d to d3/f28 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:7/10: creat f2 x:0 0 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:2/10: truncate f1 308027 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:9/78: creat d8/de/d12/d15/f19 x:0 0 0 2024-04-25T23:01:04.678 INFO:tasks.workunit.client.0.smithi043.stdout:5/45: write d0/f5 [1283894,117388] 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:6/46: mkdir d1/df 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:8/6: getdents d0 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:8/7: write - no filename 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:8/8: unlink - no file 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:8/9: dwrite - no filename 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:3/89: mknod d7/de/c1f 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:5/46: rename d0 to d0/db 22 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:4/127: mknod d3/c29 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/11: mkdir d3 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:1/12: getdents d0 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:3/90: read d7/fb [1147725,59421] 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:4/128: symlink d3/l2a 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:5/47: truncate d0/f9 794382 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:1/13: creat d0/f6 x:0 0 0 2024-04-25T23:01:04.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/12: rename f2 to d3/f4 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/129: chown d3/l2a 73978311 1 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:1/14: read - d0/f4 zero size 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:1/15: readlink - no filename 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:8/10: getdents d0 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:8/11: dwrite - no filename 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:8/12: link - no file 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:2/11: dread f1 [0,4194304] 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:9/79: write d8/de/d12/d15/f19 [39419,110015] 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/130: mkdir d3/d21/d2b 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/13: write f1 [2596904,93259] 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:2/12: stat f0 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:1/16: symlink d0/l7 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/14: creat d3/f5 x:0 0 0 2024-04-25T23:01:04.680 INFO:tasks.workunit.client.0.smithi043.stdout:1/17: rmdir d0 39 2024-04-25T23:01:04.681 INFO:tasks.workunit.client.0.smithi043.stdout:9/80: symlink d8/de/d12/d16/l1a 0 2024-04-25T23:01:04.681 INFO:tasks.workunit.client.0.smithi043.stdout:9/81: mkdir d8/de/d12/d16/d1b 0 2024-04-25T23:01:04.681 INFO:tasks.workunit.client.0.smithi043.stdout:1/18: link d0/f5 d0/f8 0 2024-04-25T23:01:04.681 INFO:tasks.workunit.client.0.smithi043.stdout:0/64: dwrite fe [0,4194304] 0 2024-04-25T23:01:04.681 INFO:tasks.workunit.client.0.smithi043.stdout:6/47: dwrite d1/d5/fd [0,4194304] 0 2024-04-25T23:01:04.682 INFO:tasks.workunit.client.0.smithi043.stdout:2/13: dwrite f1 [0,4194304] 0 2024-04-25T23:01:04.682 INFO:tasks.workunit.client.0.smithi043.stdout:1/19: read d0/f1 [180,116524] 0 2024-04-25T23:01:04.682 INFO:tasks.workunit.client.0.smithi043.stdout:2/14: chown f0 356297 1 2024-04-25T23:01:04.682 INFO:tasks.workunit.client.0.smithi043.stdout:2/15: unlink f1 0 2024-04-25T23:01:04.682 INFO:tasks.workunit.client.0.smithi043.stdout:1/20: write d0/f2 [1199241,66872] 0 2024-04-25T23:01:04.683 INFO:tasks.workunit.client.0.smithi043.stdout:2/16: mkdir d2 0 2024-04-25T23:01:04.684 INFO:tasks.workunit.client.0.smithi043.stdout:1/21: chown d0/f3 7 1 2024-04-25T23:01:04.684 INFO:tasks.workunit.client.0.smithi043.stdout:2/17: chown f0 53 1 2024-04-25T23:01:04.684 INFO:tasks.workunit.client.0.smithi043.stdout:2/18: stat f0 0 2024-04-25T23:01:04.685 INFO:tasks.workunit.client.0.smithi043.stdout:9/82: dwrite d8/de/f10 [0,4194304] 0 2024-04-25T23:01:04.687 INFO:tasks.workunit.client.0.smithi043.stdout:2/19: mkdir d2/d3 0 2024-04-25T23:01:04.687 INFO:tasks.workunit.client.0.smithi043.stdout:2/20: readlink - no filename 2024-04-25T23:01:04.687 INFO:tasks.workunit.client.0.smithi043.stdout:6/48: dwrite d1/fa [4194304,4194304] 0 2024-04-25T23:01:04.687 INFO:tasks.workunit.client.0.smithi043.stdout:9/83: mkdir d8/de/d12/d16/d1b/d1c 0 2024-04-25T23:01:04.688 INFO:tasks.workunit.client.0.smithi043.stdout:2/21: chown f0 22 1 2024-04-25T23:01:04.688 INFO:tasks.workunit.client.0.smithi043.stdout:2/22: dread - f0 zero size 2024-04-25T23:01:04.690 INFO:tasks.workunit.client.0.smithi043.stdout:6/49: write d1/d5/f7 [1885227,33850] 0 2024-04-25T23:01:04.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/23: rename f0 to d2/f4 0 2024-04-25T23:01:04.692 INFO:tasks.workunit.client.0.smithi043.stdout:9/84: rename d8/lb to d8/de/d12/d16/l1d 0 2024-04-25T23:01:04.692 INFO:tasks.workunit.client.0.smithi043.stdout:2/24: truncate d2/f4 107793 0 2024-04-25T23:01:04.693 INFO:tasks.workunit.client.0.smithi043.stdout:2/25: rmdir d2 39 2024-04-25T23:01:04.694 INFO:tasks.workunit.client.0.smithi043.stdout:1/22: dwrite d0/f3 [0,4194304] 0 2024-04-25T23:01:04.697 INFO:tasks.workunit.client.0.smithi043.stdout:6/50: dread d1/fa [0,4194304] 0 2024-04-25T23:01:04.699 INFO:tasks.workunit.client.0.smithi043.stdout:2/26: write d2/f4 [789361,97577] 0 2024-04-25T23:01:04.699 INFO:tasks.workunit.client.0.smithi043.stdout:6/51: write d1/d5/fd [2074136,86601] 0 2024-04-25T23:01:04.701 INFO:tasks.workunit.client.0.smithi043.stdout:2/27: mknod d2/c5 0 2024-04-25T23:01:04.702 INFO:tasks.workunit.client.0.smithi043.stdout:6/52: creat d1/df/f10 x:0 0 0 2024-04-25T23:01:04.703 INFO:tasks.workunit.client.0.smithi043.stdout:2/28: write d2/f4 [1912056,20919] 0 2024-04-25T23:01:04.704 INFO:tasks.workunit.client.0.smithi043.stdout:9/85: dwrite d8/fd [0,4194304] 0 2024-04-25T23:01:04.704 INFO:tasks.workunit.client.0.smithi043.stdout:6/53: readlink d1/d5/l6 0 2024-04-25T23:01:04.704 INFO:tasks.workunit.client.0.smithi043.stdout:2/29: rmdir d2 39 2024-04-25T23:01:04.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/54: creat d1/df/f11 x:0 0 0 2024-04-25T23:01:04.706 INFO:tasks.workunit.client.0.smithi043.stdout:9/86: write d8/fd [893172,1565] 0 2024-04-25T23:01:04.708 INFO:tasks.workunit.client.0.smithi043.stdout:1/23: dwrite d0/f3 [0,4194304] 0 2024-04-25T23:01:04.708 INFO:tasks.workunit.client.0.smithi043.stdout:2/30: symlink d2/d3/l6 0 2024-04-25T23:01:04.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/24: write d0/f2 [289900,72430] 0 2024-04-25T23:01:04.709 INFO:tasks.workunit.client.0.smithi043.stdout:6/55: dread - d1/df/f11 zero size 2024-04-25T23:01:04.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/25: readlink d0/l7 0 2024-04-25T23:01:04.710 INFO:tasks.workunit.client.0.smithi043.stdout:1/26: mkdir d0/d9 0 2024-04-25T23:01:04.710 INFO:tasks.workunit.client.0.smithi043.stdout:6/56: truncate d1/d5/fc 612617 0 2024-04-25T23:01:04.711 INFO:tasks.workunit.client.0.smithi043.stdout:1/27: rename d0/f4 to d0/fa 0 2024-04-25T23:01:04.711 INFO:tasks.workunit.client.0.smithi043.stdout:6/57: symlink d1/d5/l12 0 2024-04-25T23:01:04.713 INFO:tasks.workunit.client.0.smithi043.stdout:1/28: mknod d0/d9/cb 0 2024-04-25T23:01:04.713 INFO:tasks.workunit.client.0.smithi043.stdout:6/58: creat d1/f13 x:0 0 0 2024-04-25T23:01:04.716 INFO:tasks.workunit.client.0.smithi043.stdout:9/87: dwrite d8/fd [0,4194304] 0 2024-04-25T23:01:04.717 INFO:tasks.workunit.client.0.smithi043.stdout:9/88: chown d8/fd 802 1 2024-04-25T23:01:04.718 INFO:tasks.workunit.client.0.smithi043.stdout:9/89: symlink d8/l1e 0 2024-04-25T23:01:04.720 INFO:tasks.workunit.client.0.smithi043.stdout:9/90: link d8/de/d12/d15/f19 d8/de/d12/d16/f1f 0 2024-04-25T23:01:04.722 INFO:tasks.workunit.client.0.smithi043.stdout:9/91: creat d8/de/d12/d16/d1b/d1c/f20 x:0 0 0 2024-04-25T23:01:04.722 INFO:tasks.workunit.client.0.smithi043.stdout:6/59: dwrite d1/d5/fc [0,4194304] 0 2024-04-25T23:01:04.723 INFO:tasks.workunit.client.0.smithi043.stdout:9/92: rename f1 to d8/de/d12/f21 0 2024-04-25T23:01:04.723 INFO:tasks.workunit.client.0.smithi043.stdout:6/60: mkdir d1/d5/d14 0 2024-04-25T23:01:04.724 INFO:tasks.workunit.client.0.smithi043.stdout:2/31: fdatasync d2/f4 0 2024-04-25T23:01:04.730 INFO:tasks.workunit.client.0.smithi043.stdout:9/93: dwrite d8/de/f10 [4194304,4194304] 0 2024-04-25T23:01:04.733 INFO:tasks.workunit.client.0.smithi043.stdout:9/94: symlink d8/de/l22 0 2024-04-25T23:01:04.734 INFO:tasks.workunit.client.0.smithi043.stdout:9/95: link d8/fd d8/de/d12/f23 0 2024-04-25T23:01:04.734 INFO:tasks.workunit.client.0.smithi043.stdout:2/32: dread d2/f4 [0,4194304] 0 2024-04-25T23:01:04.735 INFO:tasks.workunit.client.0.smithi043.stdout:9/96: mkdir d8/de/d12/d16/d24 0 2024-04-25T23:01:04.735 INFO:tasks.workunit.client.0.smithi043.stdout:2/33: link d2/c5 d2/c7 0 2024-04-25T23:01:04.736 INFO:tasks.workunit.client.0.smithi043.stdout:9/97: creat d8/de/d12/d16/f25 x:0 0 0 2024-04-25T23:01:04.740 INFO:tasks.workunit.client.0.smithi043.stdout:0/65: fdatasync fe 0 2024-04-25T23:01:04.744 INFO:tasks.workunit.client.0.smithi043.stdout:0/66: dread fa [4194304,4194304] 0 2024-04-25T23:01:04.744 INFO:tasks.workunit.client.0.smithi043.stdout:0/67: chown c2 6 1 2024-04-25T23:01:04.750 INFO:tasks.workunit.client.0.smithi043.stdout:0/68: dwrite f3 [0,4194304] 0 2024-04-25T23:01:04.752 INFO:tasks.workunit.client.0.smithi043.stdout:0/69: rename l6 to l10 0 2024-04-25T23:01:04.753 INFO:tasks.workunit.client.0.smithi043.stdout:0/70: chown fb 15 1 2024-04-25T23:01:04.753 INFO:tasks.workunit.client.0.smithi043.stdout:1/29: write d0/f5 [555843,54494] 0 2024-04-25T23:01:04.754 INFO:tasks.workunit.client.0.smithi043.stdout:9/98: rename d8/de/d12/d16/d1b/d1c to d8/de/d12/d16/d26 0 2024-04-25T23:01:04.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/71: write fe [4355301,75424] 0 2024-04-25T23:01:04.754 INFO:tasks.workunit.client.0.smithi043.stdout:1/30: mkdir d0/dc 0 2024-04-25T23:01:04.755 INFO:tasks.workunit.client.0.smithi043.stdout:1/31: symlink d0/ld 0 2024-04-25T23:01:04.755 INFO:tasks.workunit.client.0.smithi043.stdout:9/99: rmdir d8/de/d12/d16/d18 0 2024-04-25T23:01:04.755 INFO:tasks.workunit.client.0.smithi043.stdout:1/32: stat d0/f6 0 2024-04-25T23:01:04.756 INFO:tasks.workunit.client.0.smithi043.stdout:9/100: write d8/de/d12/f21 [5261380,123670] 0 2024-04-25T23:01:04.756 INFO:tasks.workunit.client.0.smithi043.stdout:1/33: rmdir d0/dc 0 2024-04-25T23:01:04.756 INFO:tasks.workunit.client.0.smithi043.stdout:1/34: fsync d0/f3 0 2024-04-25T23:01:04.757 INFO:tasks.workunit.client.0.smithi043.stdout:9/101: write d8/fc [248972,9338] 0 2024-04-25T23:01:04.757 INFO:tasks.workunit.client.0.smithi043.stdout:1/35: rename d0/f8 to d0/fe 0 2024-04-25T23:01:04.758 INFO:tasks.workunit.client.0.smithi043.stdout:1/36: mknod d0/cf 0 2024-04-25T23:01:04.758 INFO:tasks.workunit.client.0.smithi043.stdout:9/102: symlink d8/de/d12/d16/d26/l27 0 2024-04-25T23:01:04.758 INFO:tasks.workunit.client.0.smithi043.stdout:1/37: read d0/f3 [4076832,25095] 0 2024-04-25T23:01:04.758 INFO:tasks.workunit.client.0.smithi043.stdout:1/38: unlink d0/f3 0 2024-04-25T23:01:04.759 INFO:tasks.workunit.client.0.smithi043.stdout:1/39: dread - d0/f6 zero size 2024-04-25T23:01:04.762 INFO:tasks.workunit.client.0.smithi043.stdout:9/103: dread d8/de/d12/f21 [4194304,4194304] 0 2024-04-25T23:01:04.762 INFO:tasks.workunit.client.0.smithi043.stdout:9/104: unlink d8/de/d12/d15/f19 0 2024-04-25T23:01:04.763 INFO:tasks.workunit.client.0.smithi043.stdout:9/105: unlink d8/l1e 0 2024-04-25T23:01:04.764 INFO:tasks.workunit.client.0.smithi043.stdout:9/106: rename d8/de/d12/f21 to d8/de/d12/d16/d24/f28 0 2024-04-25T23:01:04.764 INFO:tasks.workunit.client.0.smithi043.stdout:9/107: readlink l7 0 2024-04-25T23:01:04.765 INFO:tasks.workunit.client.0.smithi043.stdout:9/108: write d8/de/d12/d15/f17 [5237671,114081] 0 2024-04-25T23:01:04.766 INFO:tasks.workunit.client.0.smithi043.stdout:9/109: fdatasync d8/de/d12/d16/d24/f28 0 2024-04-25T23:01:04.768 INFO:tasks.workunit.client.0.smithi043.stdout:0/72: truncate fa 4504842 0 2024-04-25T23:01:04.769 INFO:tasks.workunit.client.0.smithi043.stdout:1/40: truncate d0/f5 475606 0 2024-04-25T23:01:04.769 INFO:tasks.workunit.client.0.smithi043.stdout:0/73: creat f11 x:0 0 0 2024-04-25T23:01:04.770 INFO:tasks.workunit.client.0.smithi043.stdout:9/110: dread d8/fc [0,4194304] 0 2024-04-25T23:01:04.770 INFO:tasks.workunit.client.0.smithi043.stdout:1/41: symlink d0/l10 0 2024-04-25T23:01:04.770 INFO:tasks.workunit.client.0.smithi043.stdout:0/74: creat f12 x:0 0 0 2024-04-25T23:01:04.770 INFO:tasks.workunit.client.0.smithi043.stdout:0/75: fdatasync f11 0 2024-04-25T23:01:04.771 INFO:tasks.workunit.client.0.smithi043.stdout:0/76: mknod c13 0 2024-04-25T23:01:04.771 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:04.770+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:04.773 INFO:tasks.workunit.client.0.smithi043.stdout:1/42: rename d0/fe to d0/f11 0 2024-04-25T23:01:04.774 INFO:tasks.workunit.client.0.smithi043.stdout:9/111: dread d8/de/d12/d16/d24/f28 [0,4194304] 0 2024-04-25T23:01:04.774 INFO:tasks.workunit.client.0.smithi043.stdout:9/112: chown d8/de 214 1 2024-04-25T23:01:04.775 INFO:tasks.workunit.client.0.smithi043.stdout:9/113: link d8/fd d8/f29 0 2024-04-25T23:01:04.775 INFO:tasks.workunit.client.0.smithi043.stdout:9/114: chown d8/de/d12/d15 206631 1 2024-04-25T23:01:04.778 INFO:tasks.workunit.client.0.smithi043.stdout:9/115: rename d8/de/d12/f23 to d8/de/d12/d16/d24/f2a 0 2024-04-25T23:01:04.779 INFO:tasks.workunit.client.0.smithi043.stdout:9/116: readlink l6 0 2024-04-25T23:01:04.782 INFO:tasks.workunit.client.0.smithi043.stdout:1/43: chown d0/f5 2582529 1 2024-04-25T23:01:04.783 INFO:tasks.workunit.client.0.smithi043.stdout:1/44: rename d0/f1 to d0/d9/f12 0 2024-04-25T23:01:04.785 INFO:tasks.workunit.client.0.smithi043.stdout:9/117: dwrite d8/de/d12/d15/f17 [0,4194304] 0 2024-04-25T23:01:04.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/91: sync 2024-04-25T23:01:04.787 INFO:tasks.workunit.client.0.smithi043.stdout:7/15: sync 2024-04-25T23:01:04.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/13: sync 2024-04-25T23:01:04.787 INFO:tasks.workunit.client.0.smithi043.stdout:5/48: sync 2024-04-25T23:01:04.787 INFO:tasks.workunit.client.0.smithi043.stdout:4/131: sync 2024-04-25T23:01:04.787 INFO:tasks.workunit.client.0.smithi043.stdout:0/77: sync 2024-04-25T23:01:04.788 INFO:tasks.workunit.client.0.smithi043.stdout:5/49: fdatasync d0/f9 0 2024-04-25T23:01:04.788 INFO:tasks.workunit.client.0.smithi043.stdout:3/92: fsync d7/f8 0 2024-04-25T23:01:04.788 INFO:tasks.workunit.client.0.smithi043.stdout:4/132: read d3/f5 [1088049,47828] 0 2024-04-25T23:01:04.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/78: creat f14 x:0 0 0 2024-04-25T23:01:04.788 INFO:tasks.workunit.client.0.smithi043.stdout:7/16: symlink d3/l6 0 2024-04-25T23:01:04.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/17: write d3/f5 [682461,125449] 0 2024-04-25T23:01:04.790 INFO:tasks.workunit.client.0.smithi043.stdout:4/133: symlink d3/de/l2c 0 2024-04-25T23:01:04.790 INFO:tasks.workunit.client.0.smithi043.stdout:5/50: getdents d0/d8 0 2024-04-25T23:01:04.790 INFO:tasks.workunit.client.0.smithi043.stdout:8/14: rename d0 to d0/d1 22 2024-04-25T23:01:04.790 INFO:tasks.workunit.client.0.smithi043.stdout:8/15: truncate - no filename 2024-04-25T23:01:04.792 INFO:tasks.workunit.client.0.smithi043.stdout:5/51: rename d0/f9 to d0/fc 0 2024-04-25T23:01:04.792 INFO:tasks.workunit.client.0.smithi043.stdout:7/18: rename l0 to d3/l7 0 2024-04-25T23:01:04.792 INFO:tasks.workunit.client.0.smithi043.stdout:3/93: link d7/fb d7/f20 0 2024-04-25T23:01:04.792 INFO:tasks.workunit.client.0.smithi043.stdout:4/134: truncate d3/de/f14 884174 0 2024-04-25T23:01:04.792 INFO:tasks.workunit.client.0.smithi043.stdout:8/16: getdents d0 0 2024-04-25T23:01:04.793 INFO:tasks.workunit.client.0.smithi043.stdout:4/135: stat d3/de/fd 0 2024-04-25T23:01:04.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/17: getdents d0 0 2024-04-25T23:01:04.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/18: link - no file 2024-04-25T23:01:04.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/19: dwrite - no filename 2024-04-25T23:01:04.795 INFO:tasks.workunit.client.0.smithi043.stdout:9/118: dwrite d8/f29 [0,4194304] 0 2024-04-25T23:01:04.795 INFO:tasks.workunit.client.0.smithi043.stdout:3/94: rename d7/de/l16 to d7/l21 0 2024-04-25T23:01:04.795 INFO:tasks.workunit.client.0.smithi043.stdout:8/20: chown d0 2254 1 2024-04-25T23:01:04.795 INFO:tasks.workunit.client.0.smithi043.stdout:8/21: write - no filename 2024-04-25T23:01:04.796 INFO:tasks.workunit.client.0.smithi043.stdout:9/119: stat d8/fd 0 2024-04-25T23:01:04.797 INFO:tasks.workunit.client.0.smithi043.stdout:4/136: rename d3/l2a to d3/d21/d2b/l2d 0 2024-04-25T23:01:04.797 INFO:tasks.workunit.client.0.smithi043.stdout:3/95: fsync d7/f8 0 2024-04-25T23:01:04.797 INFO:tasks.workunit.client.0.smithi043.stdout:7/19: rename d3/l7 to d3/l8 0 2024-04-25T23:01:04.798 INFO:tasks.workunit.client.0.smithi043.stdout:8/22: rmdir d0 0 2024-04-25T23:01:04.798 INFO:tasks.workunit.client.0.smithi043.stdout:8/23: write - no filename 2024-04-25T23:01:04.799 INFO:tasks.workunit.client.0.smithi043.stdout:8/24: mknod c2 0 2024-04-25T23:01:04.799 INFO:tasks.workunit.client.0.smithi043.stdout:0/79: dwrite f3 [0,4194304] 0 2024-04-25T23:01:04.799 INFO:tasks.workunit.client.0.smithi043.stdout:4/137: chown d3/de/fd 882575 1 2024-04-25T23:01:04.800 INFO:tasks.workunit.client.0.smithi043.stdout:7/20: creat d3/f9 x:0 0 0 2024-04-25T23:01:04.800 INFO:tasks.workunit.client.0.smithi043.stdout:8/25: stat c2 0 2024-04-25T23:01:04.800 INFO:tasks.workunit.client.0.smithi043.stdout:1/45: dwrite d0/d9/f12 [0,4194304] 0 2024-04-25T23:01:04.800 INFO:tasks.workunit.client.0.smithi043.stdout:1/46: stat d0/f5 0 2024-04-25T23:01:04.801 INFO:tasks.workunit.client.0.smithi043.stdout:9/120: truncate d8/de/d12/d16/f1f 166338 0 2024-04-25T23:01:04.801 INFO:tasks.workunit.client.0.smithi043.stdout:7/21: unlink f1 0 2024-04-25T23:01:04.801 INFO:tasks.workunit.client.0.smithi043.stdout:1/47: symlink d0/l13 0 2024-04-25T23:01:04.801 INFO:tasks.workunit.client.0.smithi043.stdout:4/138: creat d3/d21/f2e x:0 0 0 2024-04-25T23:01:04.802 INFO:tasks.workunit.client.0.smithi043.stdout:8/26: mkdir d3 0 2024-04-25T23:01:04.802 INFO:tasks.workunit.client.0.smithi043.stdout:4/139: read d3/f7 [849864,53318] 0 2024-04-25T23:01:04.802 INFO:tasks.workunit.client.0.smithi043.stdout:7/22: mkdir d3/da 0 2024-04-25T23:01:04.803 INFO:tasks.workunit.client.0.smithi043.stdout:9/121: readlink d8/de/d12/d16/l1a 0 2024-04-25T23:01:04.803 INFO:tasks.workunit.client.0.smithi043.stdout:4/140: write d3/d19/f1e [4823584,80376] 0 2024-04-25T23:01:04.804 INFO:tasks.workunit.client.0.smithi043.stdout:7/23: rename d3/l6 to d3/da/lb 0 2024-04-25T23:01:04.804 INFO:tasks.workunit.client.0.smithi043.stdout:8/27: mkdir d3/d4 0 2024-04-25T23:01:04.804 INFO:tasks.workunit.client.0.smithi043.stdout:8/28: stat d3 0 2024-04-25T23:01:04.804 INFO:tasks.workunit.client.0.smithi043.stdout:3/96: dread d7/fb [0,4194304] 0 2024-04-25T23:01:04.805 INFO:tasks.workunit.client.0.smithi043.stdout:8/29: rename d3 to d3/d5 22 2024-04-25T23:01:04.805 INFO:tasks.workunit.client.0.smithi043.stdout:7/24: symlink d3/da/lc 0 2024-04-25T23:01:04.805 INFO:tasks.workunit.client.0.smithi043.stdout:3/97: rmdir d7/de 39 2024-04-25T23:01:04.806 INFO:tasks.workunit.client.0.smithi043.stdout:4/141: rename d3/d19/l1f to d3/de/d27/l2f 0 2024-04-25T23:01:04.807 INFO:tasks.workunit.client.0.smithi043.stdout:4/142: creat d3/d21/f30 x:0 0 0 2024-04-25T23:01:04.807 INFO:tasks.workunit.client.0.smithi043.stdout:3/98: symlink d7/de/l22 0 2024-04-25T23:01:04.808 INFO:tasks.workunit.client.0.smithi043.stdout:2/34: sync 2024-04-25T23:01:04.808 INFO:tasks.workunit.client.0.smithi043.stdout:6/61: sync 2024-04-25T23:01:04.808 INFO:tasks.workunit.client.0.smithi043.stdout:5/52: sync 2024-04-25T23:01:04.808 INFO:tasks.workunit.client.0.smithi043.stdout:8/30: sync 2024-04-25T23:01:04.809 INFO:tasks.workunit.client.0.smithi043.stdout:4/143: read d3/d19/f22 [1681655,113381] 0 2024-04-25T23:01:04.810 INFO:tasks.workunit.client.0.smithi043.stdout:7/25: rename d3/da/lb to d3/da/ld 0 2024-04-25T23:01:04.810 INFO:tasks.workunit.client.0.smithi043.stdout:9/122: write d8/de/d12/d16/f1f [5379,105810] 0 2024-04-25T23:01:04.810 INFO:tasks.workunit.client.0.smithi043.stdout:1/48: dwrite d0/f6 [0,4194304] 0 2024-04-25T23:01:04.810 INFO:tasks.workunit.client.0.smithi043.stdout:5/53: unlink d0/l4 0 2024-04-25T23:01:04.811 INFO:tasks.workunit.client.0.smithi043.stdout:2/35: write d2/f4 [1060528,6682] 0 2024-04-25T23:01:04.811 INFO:tasks.workunit.client.0.smithi043.stdout:3/99: mknod d7/de/d1a/c23 0 2024-04-25T23:01:04.812 INFO:tasks.workunit.client.0.smithi043.stdout:1/49: chown d0/f2 3673 1 2024-04-25T23:01:04.812 INFO:tasks.workunit.client.0.smithi043.stdout:4/144: symlink d3/d21/d2b/l31 0 2024-04-25T23:01:04.812 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:10777 4.1a 4:59c2b69f:::10000003106.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:04.796721+0000", 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.015929796999999999, 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015998268, 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10777 2024-04-25T23:01:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.796721+0000", 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.796721+0000", 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.796744+0000", 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2252999999999999e-05 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.802593+0000", 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058493290000000003 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.802625+0000", 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2515999999999998e-05 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.802644+0000", 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8578999999999999e-05 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.802759+0000", 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115444 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.802906+0000", 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146327 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:04.803104+0000", 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000198631 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-04-25T23:01:04.817 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:04.818 INFO:tasks.workunit.client.0.smithi043.stdout:8/31: creat d3/d4/f6 x:0 0 0 2024-04-25T23:01:04.818 INFO:tasks.workunit.client.0.smithi043.stdout:2/36: creat d2/d3/f8 x:0 0 0 2024-04-25T23:01:04.818 INFO:tasks.workunit.client.0.smithi043.stdout:9/123: symlink d8/de/d12/d16/l2b 0 2024-04-25T23:01:04.818 INFO:tasks.workunit.client.0.smithi043.stdout:6/62: getdents d1 0 2024-04-25T23:01:04.820 INFO:tasks.workunit.client.0.smithi043.stdout:6/63: readlink d1/d5/l12 0 2024-04-25T23:01:04.822 INFO:tasks.workunit.client.0.smithi043.stdout:9/124: getdents d8/de 0 2024-04-25T23:01:04.823 INFO:tasks.workunit.client.0.smithi043.stdout:5/54: dwrite d0/f5 [0,4194304] 0 2024-04-25T23:01:04.826 INFO:tasks.workunit.client.0.smithi043.stdout:6/64: chown d1/d5/f7 604168 1 2024-04-25T23:01:04.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:04.831 INFO:tasks.workunit.client.0.smithi043.stdout:8/32: dwrite d3/d4/f6 [0,4194304] 0 2024-04-25T23:01:04.831 INFO:tasks.workunit.client.0.smithi043.stdout:7/26: getdents d3/da 0 2024-04-25T23:01:04.831 INFO:tasks.workunit.client.0.smithi043.stdout:9/125: creat d8/de/d12/d15/f2c x:0 0 0 2024-04-25T23:01:04.832 INFO:tasks.workunit.client.0.smithi043.stdout:0/80: fdatasync f3 0 2024-04-25T23:01:04.832 INFO:tasks.workunit.client.0.smithi043.stdout:2/37: dwrite d2/d3/f8 [0,4194304] 0 2024-04-25T23:01:04.833 INFO:tasks.workunit.client.0.smithi043.stdout:1/50: dwrite d0/d9/f12 [0,4194304] 0 2024-04-25T23:01:04.834 INFO:tasks.workunit.client.0.smithi043.stdout:4/145: truncate d3/de/f13 1074951 0 2024-04-25T23:01:04.835 INFO:tasks.workunit.client.0.smithi043.stdout:3/100: dwrite d7/f18 [4194304,4194304] 0 2024-04-25T23:01:04.835 INFO:tasks.workunit.client.0.smithi043.stdout:8/33: write d3/d4/f6 [3999428,112618] 0 2024-04-25T23:01:04.836 INFO:tasks.workunit.client.0.smithi043.stdout:2/38: mkdir d2/d9 0 2024-04-25T23:01:04.836 INFO:tasks.workunit.client.0.smithi043.stdout:1/51: dread - d0/fa zero size 2024-04-25T23:01:04.837 INFO:tasks.workunit.client.0.smithi043.stdout:9/126: write d8/de/d12/d16/f25 [12181,15725] 0 2024-04-25T23:01:04.837 INFO:tasks.workunit.client.0.smithi043.stdout:4/146: creat d3/de/f32 x:0 0 0 2024-04-25T23:01:04.837 INFO:tasks.workunit.client.0.smithi043.stdout:0/81: unlink fd 0 2024-04-25T23:01:04.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/82: stat f12 0 2024-04-25T23:01:04.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/34: symlink d3/d4/l7 0 2024-04-25T23:01:04.839 INFO:tasks.workunit.client.0.smithi043.stdout:3/101: rmdir d7/de/d1a 39 2024-04-25T23:01:04.841 INFO:tasks.workunit.client.0.smithi043.stdout:1/52: write d0/d9/f12 [2458038,90375] 0 2024-04-25T23:01:04.842 INFO:tasks.workunit.client.0.smithi043.stdout:4/147: mknod d3/c33 0 2024-04-25T23:01:04.842 INFO:tasks.workunit.client.0.smithi043.stdout:0/83: creat f15 x:0 0 0 2024-04-25T23:01:04.844 INFO:tasks.workunit.client.0.smithi043.stdout:5/55: truncate d0/f6 81517 0 2024-04-25T23:01:04.844 INFO:tasks.workunit.client.0.smithi043.stdout:0/84: readlink l0 0 2024-04-25T23:01:04.844 INFO:tasks.workunit.client.0.smithi043.stdout:5/56: sync 2024-04-25T23:01:04.844 INFO:tasks.workunit.client.0.smithi043.stdout:9/127: write d8/fd [2569078,36796] 0 2024-04-25T23:01:04.845 INFO:tasks.workunit.client.0.smithi043.stdout:0/85: fdatasync f15 0 2024-04-25T23:01:04.846 INFO:tasks.workunit.client.0.smithi043.stdout:8/35: creat d3/d4/f8 x:0 0 0 2024-04-25T23:01:04.847 INFO:tasks.workunit.client.0.smithi043.stdout:1/53: write d0/f2 [267717,56043] 0 2024-04-25T23:01:04.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/57: creat d0/fd x:0 0 0 2024-04-25T23:01:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:0/86: mknod c16 0 2024-04-25T23:01:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:0/87: sync 2024-04-25T23:01:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:6/65: dwrite d1/df/f10 [0,4194304] 0 2024-04-25T23:01:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:5/58: dread - d0/fd zero size 2024-04-25T23:01:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:3/102: creat d7/de/f24 x:0 0 0 2024-04-25T23:01:04.851 INFO:tasks.workunit.client.0.smithi043.stdout:2/39: dread d2/d3/f8 [0,4194304] 0 2024-04-25T23:01:04.851 INFO:tasks.workunit.client.0.smithi043.stdout:7/27: dwrite d3/f4 [0,4194304] 0 2024-04-25T23:01:04.851 INFO:tasks.workunit.client.0.smithi043.stdout:8/36: rename d3/d4/l7 to d3/l9 0 2024-04-25T23:01:04.855 INFO:tasks.workunit.client.0.smithi043.stdout:5/59: fdatasync d0/fc 0 2024-04-25T23:01:04.855 INFO:tasks.workunit.client.0.smithi043.stdout:3/103: readlink d7/l21 0 2024-04-25T23:01:04.857 INFO:tasks.workunit.client.0.smithi043.stdout:7/28: write d3/f4 [1722484,19205] 0 2024-04-25T23:01:04.857 INFO:tasks.workunit.client.0.smithi043.stdout:3/104: write d7/f18 [679969,62804] 0 2024-04-25T23:01:04.857 INFO:tasks.workunit.client.0.smithi043.stdout:9/128: rename d8/f29 to d8/de/d12/d16/d1b/f2d 0 2024-04-25T23:01:04.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/148: dread d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:04.857 INFO:tasks.workunit.client.0.smithi043.stdout:8/37: creat d3/d4/fa x:0 0 0 2024-04-25T23:01:04.858 INFO:tasks.workunit.client.0.smithi043.stdout:2/40: link d2/c5 d2/d3/ca 0 2024-04-25T23:01:04.858 INFO:tasks.workunit.client.0.smithi043.stdout:7/29: truncate d3/f5 1749097 0 2024-04-25T23:01:04.858 INFO:tasks.workunit.client.0.smithi043.stdout:8/38: dread - d3/d4/f8 zero size 2024-04-25T23:01:04.859 INFO:tasks.workunit.client.0.smithi043.stdout:4/149: dread - d3/d21/f2e zero size 2024-04-25T23:01:04.859 INFO:tasks.workunit.client.0.smithi043.stdout:3/105: creat d7/f25 x:0 0 0 2024-04-25T23:01:04.860 INFO:tasks.workunit.client.0.smithi043.stdout:0/88: dread fe [0,4194304] 0 2024-04-25T23:01:04.860 INFO:tasks.workunit.client.0.smithi043.stdout:0/89: rmdir - no directory 2024-04-25T23:01:04.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/60: truncate d0/f5 1820625 0 2024-04-25T23:01:04.861 INFO:tasks.workunit.client.0.smithi043.stdout:2/41: link d2/d3/ca d2/d9/cb 0 2024-04-25T23:01:04.862 INFO:tasks.workunit.client.0.smithi043.stdout:0/90: symlink l17 0 2024-04-25T23:01:04.863 INFO:tasks.workunit.client.0.smithi043.stdout:2/42: read d2/d3/f8 [2854116,15852] 0 2024-04-25T23:01:04.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/54: dread d0/f2 [0,4194304] 0 2024-04-25T23:01:04.864 INFO:tasks.workunit.client.0.smithi043.stdout:0/91: chown l10 11192322 1 2024-04-25T23:01:04.865 INFO:tasks.workunit.client.0.smithi043.stdout:2/43: creat d2/fc x:0 0 0 2024-04-25T23:01:04.866 INFO:tasks.workunit.client.0.smithi043.stdout:3/106: getdents d7/de/d1a 0 2024-04-25T23:01:04.867 INFO:tasks.workunit.client.0.smithi043.stdout:0/92: write f15 [624988,127291] 0 2024-04-25T23:01:04.868 INFO:tasks.workunit.client.0.smithi043.stdout:9/129: dread d8/de/d12/d16/d1b/f2d [0,4194304] 0 2024-04-25T23:01:04.869 INFO:tasks.workunit.client.0.smithi043.stdout:9/130: sync 2024-04-25T23:01:04.869 INFO:tasks.workunit.client.0.smithi043.stdout:0/93: creat f18 x:0 0 0 2024-04-25T23:01:04.869 INFO:tasks.workunit.client.0.smithi043.stdout:2/44: truncate d2/f4 2780738 0 2024-04-25T23:01:04.869 INFO:tasks.workunit.client.0.smithi043.stdout:3/107: mkdir d7/d26 0 2024-04-25T23:01:04.869 INFO:tasks.workunit.client.0.smithi043.stdout:6/66: fsync d1/df/f10 0 2024-04-25T23:01:04.870 INFO:tasks.workunit.client.0.smithi043.stdout:4/150: dread d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:04.874 INFO:tasks.workunit.client.0.smithi043.stdout:2/45: chown d2/f4 303293 1 2024-04-25T23:01:04.874 INFO:tasks.workunit.client.0.smithi043.stdout:7/30: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:04.874 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:04.872+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:04.876 INFO:tasks.workunit.client.0.smithi043.stdout:9/131: readlink d8/de/d12/d16/l1d 0 2024-04-25T23:01:04.876 INFO:tasks.workunit.client.0.smithi043.stdout:4/151: mkdir d3/d19/d34 0 2024-04-25T23:01:04.876 INFO:tasks.workunit.client.0.smithi043.stdout:8/39: dwrite d3/d4/f8 [0,4194304] 0 2024-04-25T23:01:04.877 INFO:tasks.workunit.client.0.smithi043.stdout:6/67: creat d1/df/f15 x:0 0 0 2024-04-25T23:01:04.877 INFO:tasks.workunit.client.0.smithi043.stdout:7/31: symlink d3/le 0 2024-04-25T23:01:04.877 INFO:tasks.workunit.client.0.smithi043.stdout:2/46: mkdir d2/d9/dd 0 2024-04-25T23:01:04.877 INFO:tasks.workunit.client.0.smithi043.stdout:9/132: chown d8/lf 1063546435 1 2024-04-25T23:01:04.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/68: symlink d1/l16 0 2024-04-25T23:01:04.878 INFO:tasks.workunit.client.0.smithi043.stdout:4/152: creat d3/de/f35 x:0 0 0 2024-04-25T23:01:04.880 INFO:tasks.workunit.client.0.smithi043.stdout:9/133: creat d8/f2e x:0 0 0 2024-04-25T23:01:04.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/153: stat d3/de/f14 0 2024-04-25T23:01:04.881 INFO:tasks.workunit.client.0.smithi043.stdout:2/47: link d2/f4 d2/d9/fe 0 2024-04-25T23:01:04.882 INFO:tasks.workunit.client.0.smithi043.stdout:4/154: symlink d3/de/l36 0 2024-04-25T23:01:04.883 INFO:tasks.workunit.client.0.smithi043.stdout:1/55: dwrite d0/fa [0,4194304] 0 2024-04-25T23:01:04.883 INFO:tasks.workunit.client.0.smithi043.stdout:9/134: rmdir d8/de/d12/d16/d1b 39 2024-04-25T23:01:04.883 INFO:tasks.workunit.client.0.smithi043.stdout:7/32: write d3/f5 [4468506,45702] 0 2024-04-25T23:01:04.884 INFO:tasks.workunit.client.0.smithi043.stdout:2/48: stat d2/c5 0 2024-04-25T23:01:04.885 INFO:tasks.workunit.client.0.smithi043.stdout:2/49: chown d2/d9/cb 1816 1 2024-04-25T23:01:04.886 INFO:tasks.workunit.client.0.smithi043.stdout:5/61: dwrite d0/f5 [0,4194304] 0 2024-04-25T23:01:04.886 INFO:tasks.workunit.client.0.smithi043.stdout:1/56: symlink d0/d9/l14 0 2024-04-25T23:01:04.886 INFO:tasks.workunit.client.0.smithi043.stdout:0/94: truncate fe 3098447 0 2024-04-25T23:01:04.886 INFO:tasks.workunit.client.0.smithi043.stdout:0/95: sync 2024-04-25T23:01:04.887 INFO:tasks.workunit.client.0.smithi043.stdout:2/50: chown d2/d3/l6 1831893 1 2024-04-25T23:01:04.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/40: truncate d3/d4/f8 376164 0 2024-04-25T23:01:04.889 INFO:tasks.workunit.client.0.smithi043.stdout:5/62: link d0/fd d0/d8/fe 0 2024-04-25T23:01:04.890 INFO:tasks.workunit.client.0.smithi043.stdout:6/69: read d1/d5/f7 [1007176,119790] 0 2024-04-25T23:01:04.892 INFO:tasks.workunit.client.0.smithi043.stdout:7/33: getdents d3 0 2024-04-25T23:01:04.893 INFO:tasks.workunit.client.0.smithi043.stdout:2/51: write d2/f4 [2141912,127457] 0 2024-04-25T23:01:04.893 INFO:tasks.workunit.client.0.smithi043.stdout:8/41: unlink d3/l9 0 2024-04-25T23:01:04.901 INFO:tasks.workunit.client.0.smithi043.stdout:2/52: symlink d2/d9/dd/lf 0 2024-04-25T23:01:04.904 INFO:tasks.workunit.client.0.smithi043.stdout:4/155: dwrite d3/de/f35 [0,4194304] 0 2024-04-25T23:01:04.909 INFO:tasks.workunit.client.0.smithi043.stdout:9/135: dwrite d8/f2e [0,4194304] 0 2024-04-25T23:01:04.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/156: rmdir d3/de 39 2024-04-25T23:01:04.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/96: dwrite f12 [0,4194304] 0 2024-04-25T23:01:04.918 INFO:tasks.workunit.client.0.smithi043.stdout:1/57: dwrite d0/fa [0,4194304] 0 2024-04-25T23:01:04.920 INFO:tasks.workunit.client.0.smithi043.stdout:5/63: dwrite d0/f7 [0,4194304] 0 2024-04-25T23:01:04.926 INFO:tasks.workunit.client.0.smithi043.stdout:0/97: write f14 [845658,5894] 0 2024-04-25T23:01:04.928 INFO:tasks.workunit.client.0.smithi043.stdout:4/157: rename d3/d21/d2b to d3/d37 0 2024-04-25T23:01:04.928 INFO:tasks.workunit.client.0.smithi043.stdout:1/58: write d0/f6 [2233230,6914] 0 2024-04-25T23:01:04.928 INFO:tasks.workunit.client.0.smithi043.stdout:7/34: dwrite d3/f9 [0,4194304] 0 2024-04-25T23:01:04.930 INFO:tasks.workunit.client.0.smithi043.stdout:5/64: truncate d0/fd 703919 0 2024-04-25T23:01:04.934 INFO:tasks.workunit.client.0.smithi043.stdout:7/35: chown d3/da 185 1 2024-04-25T23:01:04.934 INFO:tasks.workunit.client.0.smithi043.stdout:9/136: rename d8/de/d12/d16/d1b to d8/de/d12/d15/d2f 0 2024-04-25T23:01:04.935 INFO:tasks.workunit.client.0.smithi043.stdout:8/42: dwrite d3/d4/f8 [0,4194304] 0 2024-04-25T23:01:04.935 INFO:tasks.workunit.client.0.smithi043.stdout:1/59: chown d0/f11 1539079 1 2024-04-25T23:01:04.935 INFO:tasks.workunit.client.0.smithi043.stdout:3/108: dwrite d7/f9 [0,4194304] 0 2024-04-25T23:01:04.936 INFO:tasks.workunit.client.0.smithi043.stdout:6/70: dwrite d1/d5/f7 [4194304,4194304] 0 2024-04-25T23:01:04.937 INFO:tasks.workunit.client.0.smithi043.stdout:4/158: write d3/de/fd [2516227,48973] 0 2024-04-25T23:01:04.940 INFO:tasks.workunit.client.0.smithi043.stdout:1/60: chown d0/f11 287988 1 2024-04-25T23:01:04.940 INFO:tasks.workunit.client.0.smithi043.stdout:2/53: dwrite d2/fc [0,4194304] 0 2024-04-25T23:01:04.940 INFO:tasks.workunit.client.0.smithi043.stdout:4/159: write d3/d19/f1e [4225987,37461] 0 2024-04-25T23:01:04.941 INFO:tasks.workunit.client.0.smithi043.stdout:9/137: dread d8/fc [0,4194304] 0 2024-04-25T23:01:04.941 INFO:tasks.workunit.client.0.smithi043.stdout:8/43: mkdir d3/d4/db 0 2024-04-25T23:01:04.942 INFO:tasks.workunit.client.0.smithi043.stdout:8/44: stat d3/d4/db 0 2024-04-25T23:01:04.944 INFO:tasks.workunit.client.0.smithi043.stdout:5/65: write d0/fd [711262,112458] 0 2024-04-25T23:01:04.944 INFO:tasks.workunit.client.0.smithi043.stdout:2/54: fsync d2/d3/f8 0 2024-04-25T23:01:04.944 INFO:tasks.workunit.client.0.smithi043.stdout:9/138: fsync d8/fc 0 2024-04-25T23:01:04.944 INFO:tasks.workunit.client.0.smithi043.stdout:3/109: mkdir d7/d26/d27 0 2024-04-25T23:01:04.945 INFO:tasks.workunit.client.0.smithi043.stdout:8/45: write d3/d4/f8 [5055624,121041] 0 2024-04-25T23:01:04.946 INFO:tasks.workunit.client.0.smithi043.stdout:6/71: link d1/df/f10 d1/d5/d14/f17 0 2024-04-25T23:01:04.946 INFO:tasks.workunit.client.0.smithi043.stdout:0/98: dread f3 [0,4194304] 0 2024-04-25T23:01:04.947 INFO:tasks.workunit.client.0.smithi043.stdout:8/46: rename c2 to d3/cc 0 2024-04-25T23:01:04.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/110: getdents d7/de/d1a 0 2024-04-25T23:01:04.948 INFO:tasks.workunit.client.0.smithi043.stdout:9/139: truncate d8/de/f10 9015320 0 2024-04-25T23:01:04.950 INFO:tasks.workunit.client.0.smithi043.stdout:5/66: write d0/d8/fe [390625,97261] 0 2024-04-25T23:01:04.951 INFO:tasks.workunit.client.0.smithi043.stdout:3/111: mkdir d7/de/d1a/d28 0 2024-04-25T23:01:04.956 INFO:tasks.workunit.client.0.smithi043.stdout:7/36: dwrite d3/f9 [0,4194304] 0 2024-04-25T23:01:04.958 INFO:tasks.workunit.client.0.smithi043.stdout:4/160: dwrite d3/de/f14 [0,4194304] 0 2024-04-25T23:01:04.959 INFO:tasks.workunit.client.0.smithi043.stdout:9/140: dread d8/de/d12/d16/f1f [0,4194304] 0 2024-04-25T23:01:04.959 INFO:tasks.workunit.client.0.smithi043.stdout:7/37: fsync d3/f4 0 2024-04-25T23:01:04.961 INFO:tasks.workunit.client.0.smithi043.stdout:1/61: dwrite d0/f2 [0,4194304] 0 2024-04-25T23:01:04.963 INFO:tasks.workunit.client.0.smithi043.stdout:5/67: write d0/fc [1129395,120017] 0 2024-04-25T23:01:04.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/112: write d7/f20 [2584129,56193] 0 2024-04-25T23:01:04.964 INFO:tasks.workunit.client.0.smithi043.stdout:7/38: mkdir d3/da/df 0 2024-04-25T23:01:04.964 INFO:tasks.workunit.client.0.smithi043.stdout:0/99: dwrite f14 [0,4194304] 0 2024-04-25T23:01:04.964 INFO:tasks.workunit.client.0.smithi043.stdout:1/62: symlink d0/l15 0 2024-04-25T23:01:04.964 INFO:tasks.workunit.client.0.smithi043.stdout:0/100: fdatasync f11 0 2024-04-25T23:01:04.965 INFO:tasks.workunit.client.0.smithi043.stdout:8/47: dwrite d3/d4/f8 [0,4194304] 0 2024-04-25T23:01:04.965 INFO:tasks.workunit.client.0.smithi043.stdout:9/141: creat d8/de/d12/d16/f30 x:0 0 0 2024-04-25T23:01:04.965 INFO:tasks.workunit.client.0.smithi043.stdout:7/39: symlink d3/da/l10 0 2024-04-25T23:01:04.966 INFO:tasks.workunit.client.0.smithi043.stdout:1/63: mkdir d0/d16 0 2024-04-25T23:01:04.966 INFO:tasks.workunit.client.0.smithi043.stdout:9/142: rmdir d8/de 39 2024-04-25T23:01:04.967 INFO:tasks.workunit.client.0.smithi043.stdout:8/48: truncate d3/d4/fa 185405 0 2024-04-25T23:01:04.967 INFO:tasks.workunit.client.0.smithi043.stdout:1/64: fsync d0/f5 0 2024-04-25T23:01:04.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/113: rename d7/fa to d7/de/d1a/d28/f29 0 2024-04-25T23:01:04.968 INFO:tasks.workunit.client.0.smithi043.stdout:0/101: truncate f3 1906559 0 2024-04-25T23:01:04.968 INFO:tasks.workunit.client.0.smithi043.stdout:7/40: mkdir d3/da/df/d11 0 2024-04-25T23:01:04.970 INFO:tasks.workunit.client.0.smithi043.stdout:7/41: rmdir d3 39 2024-04-25T23:01:04.970 INFO:tasks.workunit.client.0.smithi043.stdout:9/143: readlink d8/de/d12/d16/l1a 0 2024-04-25T23:01:04.970 INFO:tasks.workunit.client.0.smithi043.stdout:1/65: truncate d0/f2 4467862 0 2024-04-25T23:01:04.970 INFO:tasks.workunit.client.0.smithi043.stdout:8/49: symlink d3/d4/db/ld 0 2024-04-25T23:01:04.970 INFO:tasks.workunit.client.0.smithi043.stdout:0/102: rename fe to f19 0 2024-04-25T23:01:04.971 INFO:tasks.workunit.client.0.smithi043.stdout:3/114: getdents d7/de 0 2024-04-25T23:01:04.972 INFO:tasks.workunit.client.0.smithi043.stdout:0/103: creat f1a x:0 0 0 2024-04-25T23:01:04.972 INFO:tasks.workunit.client.0.smithi043.stdout:0/104: write f1a [193095,13284] 0 2024-04-25T23:01:04.972 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:04.970+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:04.974 INFO:tasks.workunit.client.0.smithi043.stdout:3/115: creat d7/f2a x:0 0 0 2024-04-25T23:01:04.974 INFO:tasks.workunit.client.0.smithi043.stdout:5/68: dread d0/f5 [0,4194304] 0 2024-04-25T23:01:04.974 INFO:tasks.workunit.client.0.smithi043.stdout:9/144: write d8/de/d12/d16/d26/f20 [242148,77320] 0 2024-04-25T23:01:04.974 INFO:tasks.workunit.client.0.smithi043.stdout:7/42: getdents d3 0 2024-04-25T23:01:04.976 INFO:tasks.workunit.client.0.smithi043.stdout:3/116: truncate d7/de/f17 971517 0 2024-04-25T23:01:04.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/72: sync 2024-04-25T23:01:04.978 INFO:tasks.workunit.client.0.smithi043.stdout:2/55: sync 2024-04-25T23:01:04.978 INFO:tasks.workunit.client.0.smithi043.stdout:4/161: sync 2024-04-25T23:01:04.978 INFO:tasks.workunit.client.0.smithi043.stdout:3/117: creat d7/de/d1a/f2b x:0 0 0 2024-04-25T23:01:04.979 INFO:tasks.workunit.client.0.smithi043.stdout:1/66: dwrite d0/f6 [0,4194304] 0 2024-04-25T23:01:04.979 INFO:tasks.workunit.client.0.smithi043.stdout:6/73: fsync d1/f13 0 2024-04-25T23:01:04.980 INFO:tasks.workunit.client.0.smithi043.stdout:3/118: mknod d7/d26/c2c 0 2024-04-25T23:01:04.981 INFO:tasks.workunit.client.0.smithi043.stdout:7/43: truncate d3/f5 576501 0 2024-04-25T23:01:04.981 INFO:tasks.workunit.client.0.smithi043.stdout:8/50: dwrite d3/d4/fa [0,4194304] 0 2024-04-25T23:01:04.981 INFO:tasks.workunit.client.0.smithi043.stdout:4/162: write d3/d19/f22 [3853072,44371] 0 2024-04-25T23:01:04.983 INFO:tasks.workunit.client.0.smithi043.stdout:2/56: rename d2/d3/ca to d2/d3/c10 0 2024-04-25T23:01:04.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/44: stat d3/l8 0 2024-04-25T23:01:04.983 INFO:tasks.workunit.client.0.smithi043.stdout:3/119: mkdir d7/d26/d2d 0 2024-04-25T23:01:04.984 INFO:tasks.workunit.client.0.smithi043.stdout:6/74: rename d1/l16 to d1/d5/d14/l18 0 2024-04-25T23:01:04.984 INFO:tasks.workunit.client.0.smithi043.stdout:1/67: symlink d0/d16/l17 0 2024-04-25T23:01:04.984 INFO:tasks.workunit.client.0.smithi043.stdout:0/105: fdatasync f1a 0 2024-04-25T23:01:04.984 INFO:tasks.workunit.client.0.smithi043.stdout:8/51: creat d3/d4/fe x:0 0 0 2024-04-25T23:01:04.985 INFO:tasks.workunit.client.0.smithi043.stdout:4/163: mknod d3/d37/c38 0 2024-04-25T23:01:04.985 INFO:tasks.workunit.client.0.smithi043.stdout:0/106: mkdir d1b 0 2024-04-25T23:01:04.985 INFO:tasks.workunit.client.0.smithi043.stdout:1/68: mknod d0/d16/c18 0 2024-04-25T23:01:04.986 INFO:tasks.workunit.client.0.smithi043.stdout:8/52: write d3/d4/f8 [5399625,56619] 0 2024-04-25T23:01:04.986 INFO:tasks.workunit.client.0.smithi043.stdout:3/120: getdents d7 0 2024-04-25T23:01:04.987 INFO:tasks.workunit.client.0.smithi043.stdout:1/69: write d0/f2 [1017168,108079] 0 2024-04-25T23:01:04.987 INFO:tasks.workunit.client.0.smithi043.stdout:5/69: sync 2024-04-25T23:01:04.987 INFO:tasks.workunit.client.0.smithi043.stdout:7/45: sync 2024-04-25T23:01:04.987 INFO:tasks.workunit.client.0.smithi043.stdout:1/70: sync 2024-04-25T23:01:04.988 INFO:tasks.workunit.client.0.smithi043.stdout:4/164: rename d3/de/cc to d3/d37/c39 0 2024-04-25T23:01:04.988 INFO:tasks.workunit.client.0.smithi043.stdout:9/145: dwrite d8/de/d12/d15/f17 [4194304,4194304] 0 2024-04-25T23:01:04.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/53: write d3/d4/fe [393151,102534] 0 2024-04-25T23:01:04.990 INFO:tasks.workunit.client.0.smithi043.stdout:3/121: read d7/de/d1a/d28/f29 [1444796,40813] 0 2024-04-25T23:01:04.991 INFO:tasks.workunit.client.0.smithi043.stdout:5/70: write d0/f7 [882889,85330] 0 2024-04-25T23:01:04.991 INFO:tasks.workunit.client.0.smithi043.stdout:1/71: write d0/d9/f12 [2593867,62150] 0 2024-04-25T23:01:04.992 INFO:tasks.workunit.client.0.smithi043.stdout:3/122: stat d7/f8 0 2024-04-25T23:01:04.993 INFO:tasks.workunit.client.0.smithi043.stdout:9/146: chown d8/de/d12/d16/f1f 15741565 1 2024-04-25T23:01:04.993 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:04.993 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:04.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/165: mknod d3/c3a 0 2024-04-25T23:01:04.995 INFO:tasks.workunit.client.0.smithi043.stdout:5/71: mkdir d0/df 0 2024-04-25T23:01:04.995 INFO:tasks.workunit.client.0.smithi043.stdout:8/54: mkdir d3/d4/db/df 0 2024-04-25T23:01:04.996 INFO:tasks.workunit.client.0.smithi043.stdout:3/123: truncate d7/de/f24 723424 0 2024-04-25T23:01:05.000 INFO:tasks.workunit.client.0.smithi043.stdout:2/57: dwrite d2/d9/fe [0,4194304] 0 2024-04-25T23:01:05.000 INFO:tasks.workunit.client.0.smithi043.stdout:6/75: getdents d1/df 0 2024-04-25T23:01:05.005 INFO:tasks.workunit.client.0.smithi043.stdout:7/46: dwrite d3/f4 [0,4194304] 0 2024-04-25T23:01:05.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/107: dwrite f15 [0,4194304] 0 2024-04-25T23:01:05.008 INFO:tasks.workunit.client.0.smithi043.stdout:6/76: mknod d1/d5/c19 0 2024-04-25T23:01:05.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:05.009 INFO:tasks.workunit.client.0.smithi043.stdout:3/124: link d7/de/c1f d7/d26/d2d/c2e 0 2024-04-25T23:01:05.009 INFO:tasks.workunit.client.0.smithi043.stdout:9/147: getdents d8/de/d12/d16/d24 0 2024-04-25T23:01:05.010 INFO:tasks.workunit.client.0.smithi043.stdout:7/47: unlink d3/l8 0 2024-04-25T23:01:05.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/108: symlink d1b/l1c 0 2024-04-25T23:01:05.010 INFO:tasks.workunit.client.0.smithi043.stdout:2/58: getdents d2 0 2024-04-25T23:01:05.011 INFO:tasks.workunit.client.0.smithi043.stdout:6/77: mkdir d1/df/d1a 0 2024-04-25T23:01:05.014 INFO:tasks.workunit.client.0.smithi043.stdout:1/72: dwrite d0/f5 [0,4194304] 0 2024-04-25T23:01:05.014 INFO:tasks.workunit.client.0.smithi043.stdout:4/166: dwrite d3/de/f32 [0,4194304] 0 2024-04-25T23:01:05.016 INFO:tasks.workunit.client.0.smithi043.stdout:2/59: creat d2/d9/dd/f11 x:0 0 0 2024-04-25T23:01:05.017 INFO:tasks.workunit.client.0.smithi043.stdout:9/148: write d8/de/d12/d16/d24/f2a [1923240,88683] 0 2024-04-25T23:01:05.017 INFO:tasks.workunit.client.0.smithi043.stdout:6/78: getdents d1/df/d1a 0 2024-04-25T23:01:05.017 INFO:tasks.workunit.client.0.smithi043.stdout:2/60: write d2/f4 [1383238,16737] 0 2024-04-25T23:01:05.018 INFO:tasks.workunit.client.0.smithi043.stdout:8/55: dwrite d3/d4/fe [0,4194304] 0 2024-04-25T23:01:05.018 INFO:tasks.workunit.client.0.smithi043.stdout:0/109: link f3 d1b/f1d 0 2024-04-25T23:01:05.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/149: dread - d8/de/d12/d16/f30 zero size 2024-04-25T23:01:05.019 INFO:tasks.workunit.client.0.smithi043.stdout:1/73: link d0/cf d0/d16/c19 0 2024-04-25T23:01:05.020 INFO:tasks.workunit.client.0.smithi043.stdout:6/79: chown d1/l9 171074 1 2024-04-25T23:01:05.020 INFO:tasks.workunit.client.0.smithi043.stdout:2/61: creat d2/d9/f12 x:0 0 0 2024-04-25T23:01:05.020 INFO:tasks.workunit.client.0.smithi043.stdout:0/110: mknod d1b/c1e 0 2024-04-25T23:01:05.021 INFO:tasks.workunit.client.0.smithi043.stdout:8/56: write d3/d4/fe [708601,104190] 0 2024-04-25T23:01:05.022 INFO:tasks.workunit.client.0.smithi043.stdout:1/74: write d0/f11 [1737942,125317] 0 2024-04-25T23:01:05.022 INFO:tasks.workunit.client.0.smithi043.stdout:9/150: mkdir d8/de/d12/d16/d26/d31 0 2024-04-25T23:01:05.022 INFO:tasks.workunit.client.0.smithi043.stdout:1/75: sync 2024-04-25T23:01:05.023 INFO:tasks.workunit.client.0.smithi043.stdout:6/80: creat d1/d5/f1b x:0 0 0 2024-04-25T23:01:05.023 INFO:tasks.workunit.client.0.smithi043.stdout:3/125: dwrite d7/de/f24 [0,4194304] 0 2024-04-25T23:01:05.023 INFO:tasks.workunit.client.0.smithi043.stdout:5/72: dread d0/fd [0,4194304] 0 2024-04-25T23:01:05.023 INFO:tasks.workunit.client.0.smithi043.stdout:8/57: readlink d3/d4/db/ld 0 2024-04-25T23:01:05.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/167: dread d3/de/f14 [0,4194304] 0 2024-04-25T23:01:05.024 INFO:tasks.workunit.client.0.smithi043.stdout:3/126: chown d7/de/f15 63 1 2024-04-25T23:01:05.024 INFO:tasks.workunit.client.0.smithi043.stdout:4/168: fdatasync d3/f24 0 2024-04-25T23:01:05.024 INFO:tasks.workunit.client.0.smithi043.stdout:1/76: creat d0/f1a x:0 0 0 2024-04-25T23:01:05.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/62: fsync d2/d9/fe 0 2024-04-25T23:01:05.025 INFO:tasks.workunit.client.0.smithi043.stdout:5/73: unlink d0/f7 0 2024-04-25T23:01:05.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/63: write d2/d9/dd/f11 [229324,109962] 0 2024-04-25T23:01:05.026 INFO:tasks.workunit.client.0.smithi043.stdout:4/169: mknod d3/d37/c3b 0 2024-04-25T23:01:05.027 INFO:tasks.workunit.client.0.smithi043.stdout:3/127: rename d7/de/d1a/f2b to d7/de/d1a/d28/f2f 0 2024-04-25T23:01:05.027 INFO:tasks.workunit.client.0.smithi043.stdout:5/74: mknod d0/c10 0 2024-04-25T23:01:05.027 INFO:tasks.workunit.client.0.smithi043.stdout:6/81: truncate d1/d5/d14/f17 1798773 0 2024-04-25T23:01:05.027 INFO:tasks.workunit.client.0.smithi043.stdout:8/58: mkdir d3/d4/db/df/d10 0 2024-04-25T23:01:05.027 INFO:tasks.workunit.client.0.smithi043.stdout:3/128: stat d7/f20 0 2024-04-25T23:01:05.028 INFO:tasks.workunit.client.0.smithi043.stdout:2/64: mkdir d2/d3/d13 0 2024-04-25T23:01:05.028 INFO:tasks.workunit.client.0.smithi043.stdout:0/111: dread d1b/f1d [0,4194304] 0 2024-04-25T23:01:05.028 INFO:tasks.workunit.client.0.smithi043.stdout:5/75: mkdir d0/df/d11 0 2024-04-25T23:01:05.028 INFO:tasks.workunit.client.0.smithi043.stdout:0/112: write f12 [1488107,112534] 0 2024-04-25T23:01:05.031 INFO:tasks.workunit.client.0.smithi043.stdout:4/170: link d3/d19/f22 d3/f3c 0 2024-04-25T23:01:05.031 INFO:tasks.workunit.client.0.smithi043.stdout:2/65: write d2/d3/f8 [917046,67474] 0 2024-04-25T23:01:05.032 INFO:tasks.workunit.client.0.smithi043.stdout:5/76: rename d0/l3 to d0/df/l12 0 2024-04-25T23:01:05.032 INFO:tasks.workunit.client.0.smithi043.stdout:0/113: creat d1b/f1f x:0 0 0 2024-04-25T23:01:05.034 INFO:tasks.workunit.client.0.smithi043.stdout:2/66: dread - d2/d9/f12 zero size 2024-04-25T23:01:05.035 INFO:tasks.workunit.client.0.smithi043.stdout:4/171: write d3/de/f14 [1943459,106376] 0 2024-04-25T23:01:05.035 INFO:tasks.workunit.client.0.smithi043.stdout:5/77: write d0/d8/fe [1826007,65643] 0 2024-04-25T23:01:05.035 INFO:tasks.workunit.client.0.smithi043.stdout:1/77: getdents d0 0 2024-04-25T23:01:05.035 INFO:tasks.workunit.client.0.smithi043.stdout:9/151: truncate d8/de/d12/d15/d2f/f2d 70140 0 2024-04-25T23:01:05.037 INFO:tasks.workunit.client.0.smithi043.stdout:0/114: link l10 d1b/l20 0 2024-04-25T23:01:05.037 INFO:tasks.workunit.client.0.smithi043.stdout:1/78: read - d0/f1a zero size 2024-04-25T23:01:05.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/59: dwrite d3/d4/fa [0,4194304] 0 2024-04-25T23:01:05.038 INFO:tasks.workunit.client.0.smithi043.stdout:4/172: creat d3/d21/f3d x:0 0 0 2024-04-25T23:01:05.039 INFO:tasks.workunit.client.0.smithi043.stdout:7/48: fdatasync d3/f4 0 2024-04-25T23:01:05.039 INFO:tasks.workunit.client.0.smithi043.stdout:6/82: dwrite d1/df/f11 [0,4194304] 0 2024-04-25T23:01:05.039 INFO:tasks.workunit.client.0.smithi043.stdout:3/129: dwrite d7/f20 [0,4194304] 0 2024-04-25T23:01:05.042 INFO:tasks.workunit.client.0.smithi043.stdout:9/152: unlink d8/de/d12/d16/d26/f20 0 2024-04-25T23:01:05.042 INFO:tasks.workunit.client.0.smithi043.stdout:2/67: symlink d2/d3/d13/l14 0 2024-04-25T23:01:05.043 INFO:tasks.workunit.client.0.smithi043.stdout:0/115: rename l10 to d1b/l21 0 2024-04-25T23:01:05.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/79: creat d0/d16/f1b x:0 0 0 2024-04-25T23:01:05.043 INFO:tasks.workunit.client.0.smithi043.stdout:4/173: fsync d3/f28 0 2024-04-25T23:01:05.043 INFO:tasks.workunit.client.0.smithi043.stdout:8/60: rename d3 to d3/d4/db/df/d10/d11 22 2024-04-25T23:01:05.043 INFO:tasks.workunit.client.0.smithi043.stdout:2/68: sync 2024-04-25T23:01:05.045 INFO:tasks.workunit.client.0.smithi043.stdout:1/80: mkdir d0/d9/d1c 0 2024-04-25T23:01:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:0/116: rename c2 to d1b/c22 0 2024-04-25T23:01:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:1/81: write d0/f2 [5356977,22197] 0 2024-04-25T23:01:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:9/153: mkdir d8/de/d12/d16/d26/d31/d32 0 2024-04-25T23:01:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:4/174: write d3/fa [3098865,123295] 0 2024-04-25T23:01:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:5/78: link d0/ca d0/df/c13 0 2024-04-25T23:01:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:3/130: link d7/de/c1f d7/de/d1a/c30 0 2024-04-25T23:01:05.047 INFO:tasks.workunit.client.0.smithi043.stdout:4/175: sync 2024-04-25T23:01:05.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/154: rmdir d8 39 2024-04-25T23:01:05.047 INFO:tasks.workunit.client.0.smithi043.stdout:4/176: fdatasync d3/de/fd 0 2024-04-25T23:01:05.047 INFO:tasks.workunit.client.0.smithi043.stdout:5/79: chown d0/f5 71804 1 2024-04-25T23:01:05.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/155: chown d8/de/d12/d16/d26 25877 1 2024-04-25T23:01:05.048 INFO:tasks.workunit.client.0.smithi043.stdout:8/61: dread d3/d4/fa [0,4194304] 0 2024-04-25T23:01:05.048 INFO:tasks.workunit.client.0.smithi043.stdout:2/69: write d2/f4 [1509659,25832] 0 2024-04-25T23:01:05.048 INFO:tasks.workunit.client.0.smithi043.stdout:7/49: truncate d3/f9 1343369 0 2024-04-25T23:01:05.049 INFO:tasks.workunit.client.0.smithi043.stdout:7/50: chown d3/da/l10 48210 1 2024-04-25T23:01:05.050 INFO:tasks.workunit.client.0.smithi043.stdout:6/83: dread d1/fa [0,4194304] 0 2024-04-25T23:01:05.051 INFO:tasks.workunit.client.0.smithi043.stdout:9/156: creat d8/de/d12/d16/d24/f33 x:0 0 0 2024-04-25T23:01:05.051 INFO:tasks.workunit.client.0.smithi043.stdout:8/62: creat d3/d4/db/df/f12 x:0 0 0 2024-04-25T23:01:05.052 INFO:tasks.workunit.client.0.smithi043.stdout:1/82: dread d0/d9/f12 [0,4194304] 0 2024-04-25T23:01:05.052 INFO:tasks.workunit.client.0.smithi043.stdout:9/157: stat d8/c14 0 2024-04-25T23:01:05.052 INFO:tasks.workunit.client.0.smithi043.stdout:5/80: getdents d0/df 0 2024-04-25T23:01:05.053 INFO:tasks.workunit.client.0.smithi043.stdout:1/83: readlink d0/l10 0 2024-04-25T23:01:05.054 INFO:tasks.workunit.client.0.smithi043.stdout:1/84: symlink d0/d9/l1d 0 2024-04-25T23:01:05.054 INFO:tasks.workunit.client.0.smithi043.stdout:7/51: dread d3/f4 [0,4194304] 0 2024-04-25T23:01:05.055 INFO:tasks.workunit.client.0.smithi043.stdout:0/117: read fa [1967357,113315] 0 2024-04-25T23:01:05.055 INFO:tasks.workunit.client.0.smithi043.stdout:8/63: fdatasync d3/d4/f8 0 2024-04-25T23:01:05.056 INFO:tasks.workunit.client.0.smithi043.stdout:1/85: rmdir d0/d9/d1c 0 2024-04-25T23:01:05.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/158: link d8/de/d12/d16/f30 d8/de/d12/d16/d26/d31/d32/f34 0 2024-04-25T23:01:05.056 INFO:tasks.workunit.client.0.smithi043.stdout:4/177: dwrite d3/de/f32 [0,4194304] 0 2024-04-25T23:01:05.057 INFO:tasks.workunit.client.0.smithi043.stdout:8/64: readlink d3/d4/db/ld 0 2024-04-25T23:01:05.058 INFO:tasks.workunit.client.0.smithi043.stdout:9/159: stat d8/c14 0 2024-04-25T23:01:05.058 INFO:tasks.workunit.client.0.smithi043.stdout:0/118: mkdir d1b/d23 0 2024-04-25T23:01:05.058 INFO:tasks.workunit.client.0.smithi043.stdout:1/86: creat d0/d16/f1e x:0 0 0 2024-04-25T23:01:05.058 INFO:tasks.workunit.client.0.smithi043.stdout:8/65: stat d3/d4/db 0 2024-04-25T23:01:05.058 INFO:tasks.workunit.client.0.smithi043.stdout:2/70: truncate d2/d9/fe 2166586 0 2024-04-25T23:01:05.059 INFO:tasks.workunit.client.0.smithi043.stdout:1/87: read d0/d9/f12 [3343186,120712] 0 2024-04-25T23:01:05.059 INFO:tasks.workunit.client.0.smithi043.stdout:8/66: chown d3/d4/fe 1162 1 2024-04-25T23:01:05.059 INFO:tasks.workunit.client.0.smithi043.stdout:2/71: write d2/d9/f12 [697907,19121] 0 2024-04-25T23:01:05.060 INFO:tasks.workunit.client.0.smithi043.stdout:0/119: rename f15 to d1b/f24 0 2024-04-25T23:01:05.061 INFO:tasks.workunit.client.0.smithi043.stdout:9/160: write d8/de/d12/d16/f30 [541714,94638] 0 2024-04-25T23:01:05.061 INFO:tasks.workunit.client.0.smithi043.stdout:8/67: rmdir d3/d4/db/df 39 2024-04-25T23:01:05.061 INFO:tasks.workunit.client.0.smithi043.stdout:0/120: mknod d1b/c25 0 2024-04-25T23:01:05.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/81: dwrite d0/f5 [0,4194304] 0 2024-04-25T23:01:05.062 INFO:tasks.workunit.client.0.smithi043.stdout:0/121: fdatasync f11 0 2024-04-25T23:01:05.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/82: fdatasync d0/fd 0 2024-04-25T23:01:05.066 INFO:tasks.workunit.client.0.smithi043.stdout:9/161: truncate d8/de/d12/d16/f1f 770013 0 2024-04-25T23:01:05.068 INFO:tasks.workunit.client.0.smithi043.stdout:6/84: dwrite d1/df/f10 [0,4194304] 0 2024-04-25T23:01:05.069 INFO:tasks.workunit.client.0.smithi043.stdout:8/68: truncate d3/d4/db/df/f12 295445 0 2024-04-25T23:01:05.069 INFO:tasks.workunit.client.0.smithi043.stdout:4/178: dwrite d3/de/f32 [0,4194304] 0 2024-04-25T23:01:05.070 INFO:tasks.workunit.client.0.smithi043.stdout:1/88: dwrite d0/d16/f1e [0,4194304] 0 2024-04-25T23:01:05.071 INFO:tasks.workunit.client.0.smithi043.stdout:8/69: write d3/d4/fe [2797074,20076] 0 2024-04-25T23:01:05.072 INFO:tasks.workunit.client.0.smithi043.stdout:6/85: truncate d1/f13 243977 0 2024-04-25T23:01:05.072 INFO:tasks.workunit.client.0.smithi043.stdout:1/89: write d0/f6 [889921,93857] 0 2024-04-25T23:01:05.074 INFO:tasks.workunit.client.0.smithi043.stdout:8/70: mkdir d3/d13 0 2024-04-25T23:01:05.074 INFO:tasks.workunit.client.0.smithi043.stdout:7/52: fsync d3/f9 0 2024-04-25T23:01:05.076 INFO:tasks.workunit.client.0.smithi043.stdout:8/71: write d3/d4/f6 [4346126,70620] 0 2024-04-25T23:01:05.077 INFO:tasks.workunit.client.0.smithi043.stdout:6/86: dread d1/d5/fc [0,4194304] 0 2024-04-25T23:01:05.079 INFO:tasks.workunit.client.0.smithi043.stdout:9/162: dwrite d8/de/d12/d15/d2f/f2d [0,4194304] 0 2024-04-25T23:01:05.079 INFO:tasks.workunit.client.0.smithi043.stdout:4/179: dwrite d3/fa [4194304,4194304] 0 2024-04-25T23:01:05.081 INFO:tasks.workunit.client.0.smithi043.stdout:9/163: symlink d8/de/d12/d15/d2f/l35 0 2024-04-25T23:01:05.082 INFO:tasks.workunit.client.0.smithi043.stdout:6/87: dread d1/d5/fc [0,4194304] 0 2024-04-25T23:01:05.082 INFO:tasks.workunit.client.0.smithi043.stdout:9/164: chown d8/de 456 1 2024-04-25T23:01:05.083 INFO:tasks.workunit.client.0.smithi043.stdout:6/88: symlink d1/df/l1c 0 2024-04-25T23:01:05.083 INFO:tasks.workunit.client.0.smithi043.stdout:9/165: write d8/de/d12/d16/d24/f33 [508575,83937] 0 2024-04-25T23:01:05.083 INFO:tasks.workunit.client.0.smithi043.stdout:4/180: symlink d3/l3e 0 2024-04-25T23:01:05.084 INFO:tasks.workunit.client.0.smithi043.stdout:6/89: creat d1/d5/f1d x:0 0 0 2024-04-25T23:01:05.084 INFO:tasks.workunit.client.0.smithi043.stdout:4/181: write d3/de/f35 [2547820,93958] 0 2024-04-25T23:01:05.084 INFO:tasks.workunit.client.0.smithi043.stdout:9/166: getdents d8 0 2024-04-25T23:01:05.091 INFO:tasks.workunit.client.0.smithi043.stdout:6/90: dwrite d1/d5/f7 [0,4194304] 0 2024-04-25T23:01:05.092 INFO:tasks.workunit.client.0.smithi043.stdout:0/122: truncate d1b/f24 813033 0 2024-04-25T23:01:05.092 INFO:tasks.workunit.client.0.smithi043.stdout:5/83: truncate d0/fc 322848 0 2024-04-25T23:01:05.092 INFO:tasks.workunit.client.0.smithi043.stdout:9/167: dwrite d8/de/d12/d16/f1f [0,4194304] 0 2024-04-25T23:01:05.092 INFO:tasks.workunit.client.0.smithi043.stdout:0/123: chown d1b/c1e 486 1 2024-04-25T23:01:05.093 INFO:tasks.workunit.client.0.smithi043.stdout:9/168: chown d8/de/d12/d16/d26/l27 1164 1 2024-04-25T23:01:05.093 INFO:tasks.workunit.client.0.smithi043.stdout:8/72: getdents d3 0 2024-04-25T23:01:05.093 INFO:tasks.workunit.client.0.smithi043.stdout:2/72: write d2/d9/fe [425285,130985] 0 2024-04-25T23:01:05.094 INFO:tasks.workunit.client.0.smithi043.stdout:1/90: truncate d0/f6 2270395 0 2024-04-25T23:01:05.094 INFO:tasks.workunit.client.0.smithi043.stdout:5/84: creat d0/f14 x:0 0 0 2024-04-25T23:01:05.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/73: fsync d2/fc 0 2024-04-25T23:01:05.094 INFO:tasks.workunit.client.0.smithi043.stdout:0/124: link c13 d1b/d23/c26 0 2024-04-25T23:01:05.095 INFO:tasks.workunit.client.0.smithi043.stdout:9/169: readlink d8/de/d12/d16/l2b 0 2024-04-25T23:01:05.097 INFO:tasks.workunit.client.0.smithi043.stdout:8/73: readlink d3/d4/db/ld 0 2024-04-25T23:01:05.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/91: getdents d1/d5/d14 0 2024-04-25T23:01:05.099 INFO:tasks.workunit.client.0.smithi043.stdout:0/125: creat d1b/f27 x:0 0 0 2024-04-25T23:01:05.099 INFO:tasks.workunit.client.0.smithi043.stdout:8/74: dread d3/d4/db/df/f12 [0,4194304] 0 2024-04-25T23:01:05.099 INFO:tasks.workunit.client.0.smithi043.stdout:5/85: getdents d0/d8 0 2024-04-25T23:01:05.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/92: mknod d1/d5/c1e 0 2024-04-25T23:01:05.099 INFO:tasks.workunit.client.0.smithi043.stdout:7/53: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:05.100 INFO:tasks.workunit.client.0.smithi043.stdout:5/86: write d0/f14 [892764,44782] 0 2024-04-25T23:01:05.101 INFO:tasks.workunit.client.0.smithi043.stdout:8/75: mkdir d3/d4/db/d14 0 2024-04-25T23:01:05.103 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:05.100+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:05.103 INFO:tasks.workunit.client.0.smithi043.stdout:2/74: rename d2/d3/f8 to d2/d3/d13/f15 0 2024-04-25T23:01:05.104 INFO:tasks.workunit.client.0.smithi043.stdout:9/170: creat d8/de/d12/d16/f36 x:0 0 0 2024-04-25T23:01:05.104 INFO:tasks.workunit.client.0.smithi043.stdout:7/54: mknod d3/da/df/d11/c12 0 2024-04-25T23:01:05.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/87: getdents d0/df 0 2024-04-25T23:01:05.105 INFO:tasks.workunit.client.0.smithi043.stdout:2/75: unlink d2/f4 0 2024-04-25T23:01:05.105 INFO:tasks.workunit.client.0.smithi043.stdout:3/131: dread d7/de/f13 [0,4194304] 0 2024-04-25T23:01:05.106 INFO:tasks.workunit.client.0.smithi043.stdout:7/55: rename d3/f4 to d3/f13 0 2024-04-25T23:01:05.106 INFO:tasks.workunit.client.0.smithi043.stdout:5/88: chown d0 76004 1 2024-04-25T23:01:05.108 INFO:tasks.workunit.client.0.smithi043.stdout:0/126: dwrite f18 [0,4194304] 0 2024-04-25T23:01:05.108 INFO:tasks.workunit.client.0.smithi043.stdout:3/132: rmdir d7/d26/d2d 39 2024-04-25T23:01:05.108 INFO:tasks.workunit.client.0.smithi043.stdout:7/56: chown d3/f5 468 1 2024-04-25T23:01:05.109 INFO:tasks.workunit.client.0.smithi043.stdout:0/127: chown d1b/l1c 82448958 1 2024-04-25T23:01:05.110 INFO:tasks.workunit.client.0.smithi043.stdout:6/93: dwrite d1/d5/d14/f17 [0,4194304] 0 2024-04-25T23:01:05.110 INFO:tasks.workunit.client.0.smithi043.stdout:7/57: symlink d3/da/df/d11/l14 0 2024-04-25T23:01:05.111 INFO:tasks.workunit.client.0.smithi043.stdout:9/171: getdents d8/de/d12/d15 0 2024-04-25T23:01:05.111 INFO:tasks.workunit.client.0.smithi043.stdout:0/128: rename d1b to d1b/d23/d28 22 2024-04-25T23:01:05.112 INFO:tasks.workunit.client.0.smithi043.stdout:3/133: write d7/f18 [3251399,106464] 0 2024-04-25T23:01:05.113 INFO:tasks.workunit.client.0.smithi043.stdout:8/76: dwrite d3/d4/f8 [4194304,4194304] 0 2024-04-25T23:01:05.114 INFO:tasks.workunit.client.0.smithi043.stdout:8/77: chown d3/d4/db/df 31 1 2024-04-25T23:01:05.114 INFO:tasks.workunit.client.0.smithi043.stdout:4/182: dread d3/f28 [0,4194304] 0 2024-04-25T23:01:05.115 INFO:tasks.workunit.client.0.smithi043.stdout:0/129: symlink d1b/l29 0 2024-04-25T23:01:05.116 INFO:tasks.workunit.client.0.smithi043.stdout:5/89: dread d0/f6 [0,4194304] 0 2024-04-25T23:01:05.117 INFO:tasks.workunit.client.0.smithi043.stdout:2/76: dwrite d2/d9/f12 [0,4194304] 0 2024-04-25T23:01:05.118 INFO:tasks.workunit.client.0.smithi043.stdout:3/134: mknod d7/c31 0 2024-04-25T23:01:05.119 INFO:tasks.workunit.client.0.smithi043.stdout:6/94: sync 2024-04-25T23:01:05.120 INFO:tasks.workunit.client.0.smithi043.stdout:2/77: readlink d2/d3/d13/l14 0 2024-04-25T23:01:05.120 INFO:tasks.workunit.client.0.smithi043.stdout:0/130: creat d1b/d23/f2a x:0 0 0 2024-04-25T23:01:05.125 INFO:tasks.workunit.client.0.smithi043.stdout:5/90: truncate d0/fd 1123823 0 2024-04-25T23:01:05.125 INFO:tasks.workunit.client.0.smithi043.stdout:7/58: dwrite d3/f9 [0,4194304] 0 2024-04-25T23:01:05.126 INFO:tasks.workunit.client.0.smithi043.stdout:2/78: stat d2/d9/fe 0 2024-04-25T23:01:05.126 INFO:tasks.workunit.client.0.smithi043.stdout:9/172: dwrite d8/f2e [4194304,4194304] 0 2024-04-25T23:01:05.126 INFO:tasks.workunit.client.0.smithi043.stdout:6/95: creat d1/f1f x:0 0 0 2024-04-25T23:01:05.127 INFO:tasks.workunit.client.0.smithi043.stdout:5/91: mkdir d0/d8/d15 0 2024-04-25T23:01:05.129 INFO:tasks.workunit.client.0.smithi043.stdout:1/91: dwrite d0/f6 [0,4194304] 0 2024-04-25T23:01:05.129 INFO:tasks.workunit.client.0.smithi043.stdout:8/78: dwrite d3/d4/f8 [0,4194304] 0 2024-04-25T23:01:05.129 INFO:tasks.workunit.client.0.smithi043.stdout:9/173: truncate d8/de/f10 9652503 0 2024-04-25T23:01:05.129 INFO:tasks.workunit.client.0.smithi043.stdout:6/96: truncate d1/d5/f1d 615443 0 2024-04-25T23:01:05.130 INFO:tasks.workunit.client.0.smithi043.stdout:2/79: rename d2/c5 to d2/d3/c16 0 2024-04-25T23:01:05.130 INFO:tasks.workunit.client.0.smithi043.stdout:6/97: chown d1/d5/f1b 5 1 2024-04-25T23:01:05.130 INFO:tasks.workunit.client.0.smithi043.stdout:1/92: mknod d0/d16/c1f 0 2024-04-25T23:01:05.131 INFO:tasks.workunit.client.0.smithi043.stdout:8/79: creat d3/d4/db/df/d10/f15 x:0 0 0 2024-04-25T23:01:05.135 INFO:tasks.workunit.client.0.smithi043.stdout:6/98: truncate d1/d5/f1b 301362 0 2024-04-25T23:01:05.135 INFO:tasks.workunit.client.0.smithi043.stdout:8/80: symlink d3/d4/db/d14/l16 0 2024-04-25T23:01:05.135 INFO:tasks.workunit.client.0.smithi043.stdout:3/135: read d7/de/d1a/d28/f29 [2260180,81371] 0 2024-04-25T23:01:05.136 INFO:tasks.workunit.client.0.smithi043.stdout:8/81: mkdir d3/d17 0 2024-04-25T23:01:05.136 INFO:tasks.workunit.client.0.smithi043.stdout:6/99: creat d1/f20 x:0 0 0 2024-04-25T23:01:05.136 INFO:tasks.workunit.client.0.smithi043.stdout:7/59: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:05.137 INFO:tasks.workunit.client.0.smithi043.stdout:3/136: mkdir d7/d32 0 2024-04-25T23:01:05.137 INFO:tasks.workunit.client.0.smithi043.stdout:6/100: mkdir d1/df/d21 0 2024-04-25T23:01:05.137 INFO:tasks.workunit.client.0.smithi043.stdout:8/82: creat d3/d17/f18 x:0 0 0 2024-04-25T23:01:05.138 INFO:tasks.workunit.client.0.smithi043.stdout:1/93: dread d0/fa [0,4194304] 0 2024-04-25T23:01:05.138 INFO:tasks.workunit.client.0.smithi043.stdout:6/101: creat d1/d5/f22 x:0 0 0 2024-04-25T23:01:05.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/137: dread - d7/de/d1a/d28/f2f zero size 2024-04-25T23:01:05.140 INFO:tasks.workunit.client.0.smithi043.stdout:3/138: mknod d7/d32/c33 0 2024-04-25T23:01:05.140 INFO:tasks.workunit.client.0.smithi043.stdout:8/83: fdatasync d3/d4/db/df/d10/f15 0 2024-04-25T23:01:05.140 INFO:tasks.workunit.client.0.smithi043.stdout:9/174: dwrite d8/de/f10 [8388608,4194304] 0 2024-04-25T23:01:05.141 INFO:tasks.workunit.client.0.smithi043.stdout:5/92: dread d0/f14 [0,4194304] 0 2024-04-25T23:01:05.141 INFO:tasks.workunit.client.0.smithi043.stdout:9/175: fdatasync d8/de/d12/d16/d24/f33 0 2024-04-25T23:01:05.143 INFO:tasks.workunit.client.0.smithi043.stdout:8/84: creat d3/d4/db/d14/f19 x:0 0 0 2024-04-25T23:01:05.143 INFO:tasks.workunit.client.0.smithi043.stdout:5/93: symlink d0/l16 0 2024-04-25T23:01:05.144 INFO:tasks.workunit.client.0.smithi043.stdout:6/102: rename d1/l9 to d1/df/d1a/l23 0 2024-04-25T23:01:05.146 INFO:tasks.workunit.client.0.smithi043.stdout:9/176: rename l2 to d8/de/l37 0 2024-04-25T23:01:05.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/94: dread d0/f5 [0,4194304] 0 2024-04-25T23:01:05.148 INFO:tasks.workunit.client.0.smithi043.stdout:4/183: dwrite d3/de/f13 [0,4194304] 0 2024-04-25T23:01:05.150 INFO:tasks.workunit.client.0.smithi043.stdout:3/139: dread d7/f9 [0,4194304] 0 2024-04-25T23:01:05.150 INFO:tasks.workunit.client.0.smithi043.stdout:4/184: chown d3/d21/f30 1955303 1 2024-04-25T23:01:05.152 INFO:tasks.workunit.client.0.smithi043.stdout:0/131: dread d1b/f24 [0,4194304] 0 2024-04-25T23:01:05.162 INFO:tasks.workunit.client.0.smithi043.stdout:5/94: dwrite d0/fd [0,4194304] 0 2024-04-25T23:01:05.163 INFO:tasks.workunit.client.0.smithi043.stdout:5/95: truncate d0/f14 1150101 0 2024-04-25T23:01:05.164 INFO:tasks.workunit.client.0.smithi043.stdout:8/85: rename d3/d4/db/df/f12 to d3/d17/f1a 0 2024-04-25T23:01:05.164 INFO:tasks.workunit.client.0.smithi043.stdout:1/95: creat d0/d9/f20 x:0 0 0 2024-04-25T23:01:05.168 INFO:tasks.workunit.client.0.smithi043.stdout:0/132: creat d1b/f2b x:0 0 0 2024-04-25T23:01:05.168 INFO:tasks.workunit.client.0.smithi043.stdout:6/103: rename d1/d5/d14/f17 to d1/df/d21/f24 0 2024-04-25T23:01:05.168 INFO:tasks.workunit.client.0.smithi043.stdout:1/96: creat d0/d9/f21 x:0 0 0 2024-04-25T23:01:05.168 INFO:tasks.workunit.client.0.smithi043.stdout:5/96: getdents d0/d8/d15 0 2024-04-25T23:01:05.168 INFO:tasks.workunit.client.0.smithi043.stdout:4/185: link d3/de/l36 d3/d21/l3f 0 2024-04-25T23:01:05.168 INFO:tasks.workunit.client.0.smithi043.stdout:0/133: truncate fb 92084 0 2024-04-25T23:01:05.169 INFO:tasks.workunit.client.0.smithi043.stdout:5/97: truncate d0/f5 4675253 0 2024-04-25T23:01:05.169 INFO:tasks.workunit.client.0.smithi043.stdout:1/97: creat d0/d16/f22 x:0 0 0 2024-04-25T23:01:05.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/177: rename l0 to d8/de/d12/d15/d2f/l38 0 2024-04-25T23:01:05.169 INFO:tasks.workunit.client.0.smithi043.stdout:0/134: chown d1b/d23/c26 331938764 1 2024-04-25T23:01:05.170 INFO:tasks.workunit.client.0.smithi043.stdout:1/98: creat d0/d16/f23 x:0 0 0 2024-04-25T23:01:05.170 INFO:tasks.workunit.client.0.smithi043.stdout:0/135: write d1b/f27 [981176,125831] 0 2024-04-25T23:01:05.171 INFO:tasks.workunit.client.0.smithi043.stdout:3/140: rename d7/de to d7/d26/d27/d34 0 2024-04-25T23:01:05.171 INFO:tasks.workunit.client.0.smithi043.stdout:5/98: dread d0/f14 [0,4194304] 0 2024-04-25T23:01:05.171 INFO:tasks.workunit.client.0.smithi043.stdout:1/99: dread - d0/d16/f23 zero size 2024-04-25T23:01:05.172 INFO:tasks.workunit.client.0.smithi043.stdout:0/136: truncate f11 75658 0 2024-04-25T23:01:05.172 INFO:tasks.workunit.client.0.smithi043.stdout:8/86: rename d3/d4/f6 to d3/f1b 0 2024-04-25T23:01:05.172 INFO:tasks.workunit.client.0.smithi043.stdout:5/99: chown d0/c10 321 1 2024-04-25T23:01:05.173 INFO:tasks.workunit.client.0.smithi043.stdout:7/60: fsync d3/f5 0 2024-04-25T23:01:05.173 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:05.170+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:05.173 INFO:tasks.workunit.client.0.smithi043.stdout:1/100: creat d0/d9/f24 x:0 0 0 2024-04-25T23:01:05.174 INFO:tasks.workunit.client.0.smithi043.stdout:8/87: chown d3/cc 20594 1 2024-04-25T23:01:05.174 INFO:tasks.workunit.client.0.smithi043.stdout:7/61: write d3/f5 [1788998,14416] 0 2024-04-25T23:01:05.174 INFO:tasks.workunit.client.0.smithi043.stdout:5/100: creat d0/f17 x:0 0 0 2024-04-25T23:01:05.175 INFO:tasks.workunit.client.0.smithi043.stdout:1/101: creat d0/d9/f25 x:0 0 0 2024-04-25T23:01:05.175 INFO:tasks.workunit.client.0.smithi043.stdout:8/88: unlink d3/d4/fa 0 2024-04-25T23:01:05.177 INFO:tasks.workunit.client.0.smithi043.stdout:9/178: dread d8/de/d12/d15/f17 [0,4194304] 0 2024-04-25T23:01:05.177 INFO:tasks.workunit.client.0.smithi043.stdout:5/101: creat d0/d8/f18 x:0 0 0 2024-04-25T23:01:05.178 INFO:tasks.workunit.client.0.smithi043.stdout:4/186: dwrite d3/de/f32 [0,4194304] 0 2024-04-25T23:01:05.179 INFO:tasks.workunit.client.0.smithi043.stdout:6/104: dwrite d1/df/d21/f24 [0,4194304] 0 2024-04-25T23:01:05.179 INFO:tasks.workunit.client.0.smithi043.stdout:8/89: symlink d3/d4/db/l1c 0 2024-04-25T23:01:05.179 INFO:tasks.workunit.client.0.smithi043.stdout:5/102: symlink d0/l19 0 2024-04-25T23:01:05.179 INFO:tasks.workunit.client.0.smithi043.stdout:0/137: dread f19 [0,4194304] 0 2024-04-25T23:01:05.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/141: dread d7/f18 [4194304,4194304] 0 2024-04-25T23:01:05.180 INFO:tasks.workunit.client.0.smithi043.stdout:4/187: stat d3/f7 0 2024-04-25T23:01:05.180 INFO:tasks.workunit.client.0.smithi043.stdout:0/138: chown d1b/f2b 79 1 2024-04-25T23:01:05.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/142: fsync d7/d26/d27/d34/f17 0 2024-04-25T23:01:05.183 INFO:tasks.workunit.client.0.smithi043.stdout:7/62: dread d3/f13 [0,4194304] 0 2024-04-25T23:01:05.184 INFO:tasks.workunit.client.0.smithi043.stdout:9/179: mkdir d8/de/d12/d16/d26/d31/d32/d39 0 2024-04-25T23:01:05.187 INFO:tasks.workunit.client.0.smithi043.stdout:1/102: dwrite d0/f11 [0,4194304] 0 2024-04-25T23:01:05.187 INFO:tasks.workunit.client.0.smithi043.stdout:4/188: dread d3/f28 [0,4194304] 0 2024-04-25T23:01:05.189 INFO:tasks.workunit.client.0.smithi043.stdout:0/139: dwrite f8 [0,4194304] 0 2024-04-25T23:01:05.191 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.334062243, 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:05.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3340312569999995, 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.200 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3339888349999995, 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:05.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:05.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:05.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3339580160000004, 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3339283369999997, 2024-04-25T23:01:05.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3196713379999991, 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:05.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:05.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:05.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:05.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3192609710000003, 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:05.218 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.316760274, 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3167076729999998, 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.316674227, 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3093220429999999, 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3092087259999996, 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3091447820000006, 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3090997699999996, 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3090625239999998, 2024-04-25T23:01:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3077286249999993, 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3055678979999996, 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3034219979999992, 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3030559289999992, 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.2996020880000003, 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:05.281 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:05.283 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:05.284 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:05.280+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:2/80: write d2/d9/f12 [4955928,92302] 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:6/105: rename d1/d5/fc to d1/df/f25 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:5/103: creat d0/f1a x:0 0 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:3/143: dread - d7/f8 zero size 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:0/140: rename d1b/f1d to d1b/f2c 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:6/106: dread - d1/f1f zero size 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:9/180: symlink d8/de/d12/d16/l3a 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:7/63: write d3/f13 [4914962,78236] 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/189: truncate d3/f3c 2092144 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/190: chown d3/c3a 4094 1 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:7/64: write d3/f13 [3666616,25705] 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:2/81: rmdir d2/d3/d13 39 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:3/144: unlink d7/f8 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:1/103: rename d0/d9/f12 to d0/f26 0 2024-04-25T23:01:05.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/191: symlink d3/de/l40 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:9/181: write d8/de/d12/d15/f17 [2892900,26768] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:3/145: fsync d7/f2a 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:1/104: write d0/d16/f1b [382275,18581] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:0/141: getdents d1b 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:5/104: dwrite d0/f1a [0,4194304] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:4/192: rename d3/de/f1a to d3/f41 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:1/105: write d0/d9/f24 [40756,30858] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:0/142: dread d1b/f24 [0,4194304] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:6/107: dwrite d1/d5/f22 [0,4194304] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:3/146: read d7/d26/d27/d34/d1a/d28/f29 [7466219,89855] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:9/182: symlink d8/de/d12/d16/d26/d31/d32/d39/l3b 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:4/193: write d3/f4 [175976,115418] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:5/105: write d0/d8/fe [3515627,70356] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:8/90: dwrite d3/d17/f1a [0,4194304] 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:1/106: unlink d0/d16/c19 0 2024-04-25T23:01:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:6/108: stat d1/d5/f22 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:7/65: dwrite d3/f13 [0,4194304] 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:5/106: unlink d0/f1a 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:6/109: read - d1/df/f15 zero size 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:0/143: link c13 d1b/c2d 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:1/107: mkdir d0/d16/d27 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:3/147: fdatasync d7/d26/d27/d34/f13 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:9/183: creat d8/de/d12/d16/d26/d31/d32/f3c x:0 0 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:9/184: fsync d8/f2e 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:1/108: fdatasync d0/d9/f25 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:6/110: chown d1/f13 1332318221 1 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:7/66: creat d3/da/df/d11/f15 x:0 0 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:8/91: truncate d3/d4/db/df/d10/f15 35074 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:8/92: readlink d3/d4/db/l1c 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:4/194: getdents d3/d37 0 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:0/144: chown d1b/d23/c26 2258 1 2024-04-25T23:01:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:7/67: creat d3/da/df/d11/f16 x:0 0 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/148: rename d7/d26/d27/d34/d1a/d28/f2f to d7/d26/d27/d34/f35 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:4/195: fsync d3/d21/f25 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:5/107: link d0/c10 d0/c1b 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:0/145: symlink d1b/d23/l2e 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:9/185: creat d8/de/d12/d16/f3d x:0 0 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:1/109: dwrite d0/f2 [0,4194304] 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:0/146: rmdir d1b/d23 39 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:4/196: write d3/de/f35 [1143236,7141] 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:6/111: dwrite d1/d5/f1b [0,4194304] 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:9/186: rmdir d8/de/d12/d16 39 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:1/110: chown d0/l13 1 1 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/149: truncate d7/d26/d27/d34/d1a/f1d 636034 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:5/108: fsync d0/fc 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:9/187: creat d8/de/f3e x:0 0 0 2024-04-25T23:01:05.306 INFO:tasks.workunit.client.0.smithi043.stdout:4/197: symlink d3/de/l42 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:5/109: truncate d0/fd 5180963 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:1/111: mknod d0/d16/d27/c28 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:0/147: dread d1b/f2c [0,4194304] 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:3/150: unlink d7/l21 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:9/188: dread - d8/de/d12/d16/f36 zero size 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:4/198: mknod d3/de/d27/c43 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:1/112: mknod d0/d16/d27/c29 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:9/189: stat d8/de/f3e 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:5/110: mkdir d0/d8/d15/d1c 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:5/111: stat d0/f6 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:0/148: rename c13 to d1b/c2f 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:7/68: dwrite d3/da/df/d11/f15 [0,4194304] 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:1/113: symlink d0/d9/l2a 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:4/199: mknod d3/c44 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:9/190: chown d8/de/d12/d16/f1f 47 1 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:0/149: write fb [882108,101189] 0 2024-04-25T23:01:05.307 INFO:tasks.workunit.client.0.smithi043.stdout:4/200: chown d3/f41 236377 1 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/69: dread - d3/da/df/d11/f16 zero size 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/70: write d3/f5 [557456,52274] 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:5/112: symlink d0/l1d 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:1/114: mknod d0/c2b 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:4/201: mkdir d3/de/d27/d45 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/71: mknod d3/da/df/d11/c17 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:1/115: mknod d0/c2c 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:4/202: mkdir d3/de/d46 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:5/113: truncate d0/fc 375166 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/72: fdatasync d3/da/df/d11/f16 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:6/112: dwrite d1/df/f25 [0,4194304] 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:1/116: creat d0/d16/f2d x:0 0 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:2/82: dread d2/d9/f12 [4194304,4194304] 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:6/113: write d1/df/d21/f24 [2279754,79433] 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/73: getdents d3/da/df 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:4/203: rename d3/de/d27/l2f to d3/de/d27/l47 0 2024-04-25T23:01:05.308 INFO:tasks.workunit.client.0.smithi043.stdout:1/117: write d0/f6 [4404895,17510] 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/191: dwrite d8/fd [0,4194304] 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:1/118: fdatasync d0/d9/f20 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/114: creat d1/f26 x:0 0 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/192: stat d8/de/l37 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/150: read fb [281398,28395] 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:4/204: link d3/de/f14 d3/d19/f48 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/151: write f11 [376154,88344] 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/115: chown d1/df/d1a/l23 36 1 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:4/205: fdatasync d3/d19/f22 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/114: dwrite d0/d8/fe [0,4194304] 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:4/206: chown d3/c33 6809050 1 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/152: dread d1b/f24 [0,4194304] 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/116: creat d1/df/d1a/f27 x:0 0 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/153: unlink cf 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:4/207: creat d3/de/f49 x:0 0 0 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/117: chown d1/d5/fd 2084025 1 2024-04-25T23:01:05.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/115: truncate d0/d8/f18 14655 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:1/119: dwrite d0/f6 [0,4194304] 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/116: readlink d0/l19 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:2/83: dwrite d2/d9/dd/f11 [0,4194304] 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:7/74: dwrite d3/f13 [0,4194304] 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:8/93: dread d3/f1b [0,4194304] 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:0/154: mknod d1b/d23/c30 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/117: creat d0/df/f1e x:0 0 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:7/75: rmdir d3 39 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:0/155: chown l17 4181985 1 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:8/94: rmdir d3/d4/db/df 39 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:1/120: write d0/f26 [560198,35288] 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:2/84: link d2/d9/dd/lf d2/d3/l17 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:8/95: fsync d3/d4/f8 0 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:3/151: sync 2024-04-25T23:01:05.310 INFO:tasks.workunit.client.0.smithi043.stdout:7/76: unlink d3/f9 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:2/85: rmdir d2 39 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:0/156: mkdir d1b/d31 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:1/121: truncate d0/d16/f22 337111 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/96: mkdir d3/d1d 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:0/157: fsync d1b/f24 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/97: creat d3/d13/f1e x:0 0 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/98: creat d3/d17/f1f x:0 0 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:0/158: rename l17 to d1b/l32 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/77: link d3/le d3/l18 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/99: unlink d3/d4/db/l1c 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/78: creat d3/f19 x:0 0 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:5/118: dwrite d0/d8/f18 [0,4194304] 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:4/208: truncate d3/f24 1694638 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/100: readlink d3/d4/db/ld 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/79: fsync d3/f5 0 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/101: rename d3/d1d to d3/d1d/d20 22 2024-04-25T23:01:05.311 INFO:tasks.workunit.client.0.smithi043.stdout:1/122: dread d0/d9/f24 [0,4194304] 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/118: truncate d1/d5/fd 909534 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:4/209: chown d3/d21/f30 256781 1 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:5/119: symlink d0/df/l1f 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:0/159: dread f11 [0,4194304] 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:1/123: truncate d0/d16/f22 1359600 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:3/152: dwrite d7/d26/d27/d34/d1a/f1e [0,4194304] 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/119: creat d1/df/f28 x:0 0 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:7/80: unlink d3/da/ld 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:2/86: dwrite d2/d9/f12 [0,4194304] 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:8/102: symlink d3/d4/db/l21 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:0/160: rmdir d1b 39 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:7/81: readlink d3/l18 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:5/120: dread d0/d8/f18 [0,4194304] 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:1/124: dread d0/fa [0,4194304] 0 2024-04-25T23:01:05.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/120: link d1/df/f25 d1/f29 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/82: creat d3/da/df/f1a x:0 0 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/125: rename d0/f6 to d0/f2e 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:5/121: symlink d0/d8/d15/d1c/l20 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/126: rmdir d0/d16 39 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/87: getdents d2/d3 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:6/121: mkdir d1/d2a 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/83: mknod d3/da/df/d11/c1b 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:5/122: chown d0/f14 17 1 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/127: mkdir d0/d2f 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/88: write d2/d9/dd/f11 [1977311,43939] 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/84: symlink d3/l1c 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:4/210: truncate d3/f4 1179793 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:3/153: truncate d7/f9 313362 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:0/161: write f3 [2750869,24449] 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/128: creat d0/d16/d27/f30 x:0 0 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/85: unlink d3/f13 0 2024-04-25T23:01:05.313 INFO:tasks.workunit.client.0.smithi043.stdout:4/211: rmdir d3/de/d27 39 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:8/103: dwrite d3/d17/f1a [0,4194304] 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/129: mknod d0/d16/c31 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:4/212: symlink d3/d19/l4a 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/130: symlink d0/l32 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/86: rename d3/da/df/d11/c17 to d3/da/df/d11/c1d 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/131: stat d0/l32 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:4/213: creat d3/de/d46/f4b x:0 0 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/87: mkdir d3/d1e 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/132: symlink d0/l33 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:4/214: write d3/de/f35 [4556474,100953] 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/88: unlink d3/da/df/d11/f16 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/122: truncate d1/f29 3019798 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:4/215: write d3/d21/f25 [824861,53324] 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/89: mkdir d3/d1e/d1f 0 2024-04-25T23:01:05.314 INFO:tasks.workunit.client.0.smithi043.stdout:8/104: dread d3/d4/f8 [0,4194304] 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/89: write d2/d9/fe [2897039,7810] 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/90: chown d2/d3 14403002 1 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:4/216: chown d3/de/d46/f4b 20491 1 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:8/105: dread - d3/d4/db/d14/f19 zero size 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/123: creat d1/df/d21/f2b x:0 0 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:8/106: symlink d3/d17/l22 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/91: unlink d2/d9/dd/lf 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/124: chown d1/d5 2303167 1 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/92: mkdir d2/d3/d13/d18 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/125: creat d1/d5/f2c x:0 0 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:0/162: write fa [2381795,40812] 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/126: truncate d1/f13 777994 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/93: rename d2/d3/d13/f15 to d2/d3/d13/d18/f19 0 2024-04-25T23:01:05.315 INFO:tasks.workunit.client.0.smithi043.stdout:5/123: sync 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:0/163: rename f19 to d1b/d31/f33 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/127: symlink d1/d2a/l2d 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:5/124: chown d0/df/l12 316466339 1 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/90: dwrite d3/da/df/d11/f15 [0,4194304] 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:1/133: dwrite d0/d16/f1b [0,4194304] 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:2/94: creat d2/d9/dd/f1a x:0 0 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/91: sync 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/128: chown d1/d5/f22 950011264 1 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:5/125: write d0/d8/fe [2072573,77681] 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/193: dread d8/f2e [0,4194304] 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:8/107: dwrite d3/d13/f1e [0,4194304] 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/92: write d3/f5 [2634504,85692] 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:5/126: dread d0/f6 [0,4194304] 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/194: dread - d8/de/d12/d16/d26/d31/d32/f3c zero size 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:2/95: symlink d2/d3/d13/d18/l1b 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:5/127: unlink d0/f6 0 2024-04-25T23:01:05.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/93: creat d3/da/df/d11/f20 x:0 0 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:9/195: fdatasync d8/de/d12/d16/d24/f33 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:1/134: symlink d0/d2f/l34 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:5/128: mknod d0/d8/d15/d1c/c21 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:9/196: creat d8/de/d12/d16/d26/d31/f3f x:0 0 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:2/96: write d2/d3/d13/d18/f19 [308494,26109] 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:5/129: rmdir d0/d8 39 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:0/164: getdents d1b/d23 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:2/97: fdatasync d2/fc 0 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:0/165: dread - d1b/d23/f2a zero size 2024-04-25T23:01:05.317 INFO:tasks.workunit.client.0.smithi043.stdout:6/129: dwrite d1/df/f11 [0,4194304] 0 2024-04-25T23:01:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:0/166: symlink d1b/d23/l34 0 2024-04-25T23:01:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:2/98: readlink d2/d3/d13/d18/l1b 0 2024-04-25T23:01:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:7/94: dwrite d3/f19 [0,4194304] 0 2024-04-25T23:01:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:4/217: dwrite d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:9/197: creat d8/de/d12/d16/f40 x:0 0 0 2024-04-25T23:01:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:2/99: dread - d2/d9/dd/f1a zero size 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:5/130: mkdir d0/d22 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:0/167: write d1b/f1f [790788,59353] 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:1/135: getdents d0/d16 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:4/218: symlink d3/d19/l4c 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:9/198: truncate d8/de/d12/d16/d24/f33 64561 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/130: dwrite d1/d5/f1b [0,4194304] 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:5/131: write d0/f14 [106507,81487] 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:3/154: dread d7/d26/d27/d34/f15 [0,4194304] 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:1/136: chown d0/f1a 3277 1 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/131: chown d1/f13 0 1 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:9/199: fsync d8/de/d12/d16/d26/d31/d32/f34 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:9/200: write d8/de/d12/d16/d24/f2a [602545,37012] 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:7/95: dwrite d3/da/df/d11/f15 [0,4194304] 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:0/168: dread d1b/d31/f33 [0,4194304] 0 2024-04-25T23:01:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:2/100: symlink d2/d3/l1c 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/155: creat d7/d26/d2d/f36 x:0 0 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:5/132: unlink d0/f14 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:1/137: rename d0/l33 to d0/d16/d27/l35 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/132: link d1/df/d21/f24 d1/df/d1a/f2e 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:1/138: unlink d0/l32 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:9/201: creat d8/de/d12/d16/d24/f41 x:0 0 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/133: symlink d1/df/d21/l2f 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:2/101: write d2/d9/fe [2895324,114822] 0 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/134: read - d1/df/d1a/f27 zero size 2024-04-25T23:01:05.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/96: dread d3/da/df/d11/f15 [0,4194304] 0 2024-04-25T23:01:05.323 INFO:tasks.workunit.client.0.smithi043.stdout:5/133: rmdir d0/df/d11 0 2024-04-25T23:01:05.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/102: symlink d2/d9/dd/l1d 0 2024-04-25T23:01:05.323 INFO:tasks.workunit.client.0.smithi043.stdout:1/139: rename d0/l15 to d0/l36 0 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/140: dread - d0/d9/f21 zero size 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/135: stat d1/df/f25 0 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:7/97: write d3/da/df/d11/f20 [517950,7225] 0 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:5/134: creat d0/f23 x:0 0 0 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/141: symlink d0/d9/l37 0 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:5/135: dread - d0/f17 zero size 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/136: dread - d1/df/d21/f2b zero size 2024-04-25T23:01:05.324 INFO:tasks.workunit.client.0.smithi043.stdout:9/202: dread d8/de/d12/d16/f1f [0,4194304] 0 2024-04-25T23:01:05.325 INFO:tasks.workunit.client.0.smithi043.stdout:0/169: dwrite f1a [0,4194304] 0 2024-04-25T23:01:05.325 INFO:tasks.workunit.client.0.smithi043.stdout:6/137: write d1/df/d1a/f27 [564670,31018] 0 2024-04-25T23:01:05.325 INFO:tasks.workunit.client.0.smithi043.stdout:5/136: symlink d0/d8/d15/d1c/l24 0 2024-04-25T23:01:05.326 INFO:tasks.workunit.client.0.smithi043.stdout:0/170: mknod d1b/d23/c35 0 2024-04-25T23:01:05.326 INFO:tasks.workunit.client.0.smithi043.stdout:0/171: fdatasync d1b/f1f 0 2024-04-25T23:01:05.327 INFO:tasks.workunit.client.0.smithi043.stdout:8/108: fdatasync d3/d13/f1e 0 2024-04-25T23:01:05.327 INFO:tasks.workunit.client.0.smithi043.stdout:6/138: mkdir d1/d5/d14/d30 0 2024-04-25T23:01:05.327 INFO:tasks.workunit.client.0.smithi043.stdout:0/172: stat l0 0 2024-04-25T23:01:05.327 INFO:tasks.workunit.client.0.smithi043.stdout:5/137: mkdir d0/d8/d15/d1c/d25 0 2024-04-25T23:01:05.328 INFO:tasks.workunit.client.0.smithi043.stdout:3/156: write d7/f9 [928938,124321] 0 2024-04-25T23:01:05.328 INFO:tasks.workunit.client.0.smithi043.stdout:2/103: chown d2/d3/d13 58715438 1 2024-04-25T23:01:05.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/142: dread d0/f11 [0,4194304] 0 2024-04-25T23:01:05.330 INFO:tasks.workunit.client.0.smithi043.stdout:3/157: unlink d7/d26/d27/d34/l22 0 2024-04-25T23:01:05.331 INFO:tasks.workunit.client.0.smithi043.stdout:8/109: symlink d3/d4/db/l23 0 2024-04-25T23:01:05.331 INFO:tasks.workunit.client.0.smithi043.stdout:5/138: write d0/d8/f18 [800337,90010] 0 2024-04-25T23:01:05.331 INFO:tasks.workunit.client.0.smithi043.stdout:6/139: creat d1/f31 x:0 0 0 2024-04-25T23:01:05.331 INFO:tasks.workunit.client.0.smithi043.stdout:7/98: dwrite d3/f19 [4194304,4194304] 0 2024-04-25T23:01:05.332 INFO:tasks.workunit.client.0.smithi043.stdout:1/143: write d0/d16/f23 [598721,65415] 0 2024-04-25T23:01:05.332 INFO:tasks.workunit.client.0.smithi043.stdout:3/158: chown d7/d26/d27/d34/d1a/l1c 607833 1 2024-04-25T23:01:05.333 INFO:tasks.workunit.client.0.smithi043.stdout:0/173: dread f1a [0,4194304] 0 2024-04-25T23:01:05.333 INFO:tasks.workunit.client.0.smithi043.stdout:8/110: creat d3/d4/f24 x:0 0 0 2024-04-25T23:01:05.334 INFO:tasks.workunit.client.0.smithi043.stdout:5/139: creat d0/d8/d15/f26 x:0 0 0 2024-04-25T23:01:05.334 INFO:tasks.workunit.client.0.smithi043.stdout:1/144: fdatasync d0/f2e 0 2024-04-25T23:01:05.334 INFO:tasks.workunit.client.0.smithi043.stdout:3/159: creat d7/d26/d27/d34/f37 x:0 0 0 2024-04-25T23:01:05.335 INFO:tasks.workunit.client.0.smithi043.stdout:0/174: creat d1b/d31/f36 x:0 0 0 2024-04-25T23:01:05.335 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:01:05.336 INFO:tasks.workunit.client.0.smithi043.stdout:1/145: creat d0/f38 x:0 0 0 2024-04-25T23:01:05.336 INFO:tasks.workunit.client.0.smithi043.stdout:5/140: creat d0/d8/d15/d1c/d25/f27 x:0 0 0 2024-04-25T23:01:05.336 INFO:tasks.workunit.client.0.smithi043.stdout:0/175: dread d1b/f24 [0,4194304] 0 2024-04-25T23:01:05.336 INFO:tasks.workunit.client.0.smithi043.stdout:3/160: link d7/fb d7/d32/f38 0 2024-04-25T23:01:05.336 INFO:tasks.workunit.client.0.smithi043.stdout:1/146: mknod d0/c39 0 2024-04-25T23:01:05.337 INFO:tasks.workunit.client.0.smithi043.stdout:5/141: creat d0/d22/f28 x:0 0 0 2024-04-25T23:01:05.337 INFO:tasks.workunit.client.0.smithi043.stdout:3/161: stat d7/d26/d27/d34/d1a/c23 0 2024-04-25T23:01:05.338 INFO:tasks.workunit.client.0.smithi043.stdout:1/147: write d0/d16/f22 [171918,16978] 0 2024-04-25T23:01:05.338 INFO:tasks.workunit.client.0.smithi043.stdout:6/140: read d1/df/d1a/f27 [298190,112005] 0 2024-04-25T23:01:05.338 INFO:tasks.workunit.client.0.smithi043.stdout:5/142: creat d0/df/f29 x:0 0 0 2024-04-25T23:01:05.338 INFO:tasks.workunit.client.0.smithi043.stdout:1/148: rmdir d0/d9 39 2024-04-25T23:01:05.338 INFO:tasks.workunit.client.0.smithi043.stdout:1/149: fdatasync d0/f2e 0 2024-04-25T23:01:05.338 INFO:tasks.workunit.client.0.smithi043.stdout:6/141: fsync d1/df/d21/f2b 0 2024-04-25T23:01:05.339 INFO:tasks.workunit.client.0.smithi043.stdout:1/150: chown d0/c39 64 1 2024-04-25T23:01:05.339 INFO:tasks.workunit.client.0.smithi043.stdout:7/99: truncate d3/da/df/d11/f20 79568 0 2024-04-25T23:01:05.339 INFO:tasks.workunit.client.0.smithi043.stdout:6/142: unlink d1/df/l1c 0 2024-04-25T23:01:05.340 INFO:tasks.workunit.client.0.smithi043.stdout:1/151: write d0/f2 [5396107,22557] 0 2024-04-25T23:01:05.340 INFO:tasks.workunit.client.0.smithi043.stdout:5/143: rename d0/d8/d15/d1c/l24 to d0/d8/l2a 0 2024-04-25T23:01:05.340 INFO:tasks.workunit.client.0.smithi043.stdout:0/176: dread d1b/f2c [0,4194304] 0 2024-04-25T23:01:05.341 INFO:tasks.workunit.client.0.smithi043.stdout:0/177: truncate d1b/d31/f36 881942 0 2024-04-25T23:01:05.342 INFO:tasks.workunit.client.0.smithi043.stdout:0/178: truncate d1b/f2b 1024141 0 2024-04-25T23:01:05.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/100: link d3/f5 d3/f21 0 2024-04-25T23:01:05.342 INFO:tasks.workunit.client.0.smithi043.stdout:1/152: unlink d0/d16/f1e 0 2024-04-25T23:01:05.343 INFO:tasks.workunit.client.0.smithi043.stdout:6/143: rename d1/f26 to d1/df/d1a/f32 0 2024-04-25T23:01:05.344 INFO:tasks.workunit.client.0.smithi043.stdout:6/144: write d1/fe [290546,80754] 0 2024-04-25T23:01:05.344 INFO:tasks.workunit.client.0.smithi043.stdout:1/153: creat d0/f3a x:0 0 0 2024-04-25T23:01:05.346 INFO:tasks.workunit.client.0.smithi043.stdout:1/154: write d0/d9/f24 [250509,23827] 0 2024-04-25T23:01:05.346 INFO:tasks.workunit.client.0.smithi043.stdout:7/101: truncate d3/f19 7833189 0 2024-04-25T23:01:05.347 INFO:tasks.workunit.client.0.smithi043.stdout:6/145: getdents d1/df/d1a 0 2024-04-25T23:01:05.348 INFO:tasks.workunit.client.0.smithi043.stdout:5/144: dwrite d0/d8/f18 [0,4194304] 0 2024-04-25T23:01:05.348 INFO:tasks.workunit.client.0.smithi043.stdout:7/102: mknod d3/da/df/c22 0 2024-04-25T23:01:05.349 INFO:tasks.workunit.client.0.smithi043.stdout:1/155: write d0/d16/d27/f30 [741811,17967] 0 2024-04-25T23:01:05.349 INFO:tasks.workunit.client.0.smithi043.stdout:6/146: stat d1/df/d1a/f27 0 2024-04-25T23:01:05.349 INFO:tasks.workunit.client.0.smithi043.stdout:7/103: fsync d3/da/df/f1a 0 2024-04-25T23:01:05.350 INFO:tasks.workunit.client.0.smithi043.stdout:6/147: truncate d1/df/f28 219654 0 2024-04-25T23:01:05.351 INFO:tasks.workunit.client.0.smithi043.stdout:0/179: dwrite d1b/f2c [0,4194304] 0 2024-04-25T23:01:05.354 INFO:tasks.workunit.client.0.smithi043.stdout:5/145: creat d0/d8/d15/d1c/f2b x:0 0 0 2024-04-25T23:01:05.354 INFO:tasks.workunit.client.0.smithi043.stdout:7/104: unlink d3/da/lc 0 2024-04-25T23:01:05.355 INFO:tasks.workunit.client.0.smithi043.stdout:0/180: readlink d1b/l20 0 2024-04-25T23:01:05.356 INFO:tasks.workunit.client.0.smithi043.stdout:6/148: dread d1/df/d1a/f2e [0,4194304] 0 2024-04-25T23:01:05.357 INFO:tasks.workunit.client.0.smithi043.stdout:7/105: creat d3/da/f23 x:0 0 0 2024-04-25T23:01:05.358 INFO:tasks.workunit.client.0.smithi043.stdout:4/219: sync 2024-04-25T23:01:05.359 INFO:tasks.workunit.client.0.smithi043.stdout:4/220: mkdir d3/d37/d4d 0 2024-04-25T23:01:05.360 INFO:tasks.workunit.client.0.smithi043.stdout:7/106: creat d3/d1e/d1f/f24 x:0 0 0 2024-04-25T23:01:05.361 INFO:tasks.workunit.client.0.smithi043.stdout:4/221: symlink d3/de/d27/l4e 0 2024-04-25T23:01:05.363 INFO:tasks.workunit.client.0.smithi043.stdout:1/156: dwrite d0/f5 [0,4194304] 0 2024-04-25T23:01:05.364 INFO:tasks.workunit.client.0.smithi043.stdout:5/146: dwrite d0/f5 [0,4194304] 0 2024-04-25T23:01:05.364 INFO:tasks.workunit.client.0.smithi043.stdout:6/149: dread d1/d5/f22 [0,4194304] 0 2024-04-25T23:01:05.364 INFO:tasks.workunit.client.0.smithi043.stdout:2/104: dread d2/d9/fe [0,4194304] 0 2024-04-25T23:01:05.365 INFO:tasks.workunit.client.0.smithi043.stdout:0/181: dwrite d1b/d23/f2a [0,4194304] 0 2024-04-25T23:01:05.367 INFO:tasks.workunit.client.0.smithi043.stdout:4/222: rename d3/de/d27/l47 to d3/d19/d34/l4f 0 2024-04-25T23:01:05.369 INFO:tasks.workunit.client.0.smithi043.stdout:2/105: creat d2/d3/d13/f1e x:0 0 0 2024-04-25T23:01:05.369 INFO:tasks.workunit.client.0.smithi043.stdout:6/150: rename d1/d5/l12 to d1/d5/l33 0 2024-04-25T23:01:05.370 INFO:tasks.workunit.client.0.smithi043.stdout:6/151: dread - d1/f20 zero size 2024-04-25T23:01:05.370 INFO:tasks.workunit.client.0.smithi043.stdout:5/147: mkdir d0/d2c 0 2024-04-25T23:01:05.371 INFO:tasks.workunit.client.0.smithi043.stdout:2/106: rmdir d2/d3/d13 39 2024-04-25T23:01:05.371 INFO:tasks.workunit.client.0.smithi043.stdout:6/152: write d1/df/f15 [345509,65210] 0 2024-04-25T23:01:05.371 INFO:tasks.workunit.client.0.smithi043.stdout:1/157: link d0/l13 d0/d16/d27/l3b 0 2024-04-25T23:01:05.371 INFO:tasks.workunit.client.0.smithi043.stdout:0/182: creat d1b/f37 x:0 0 0 2024-04-25T23:01:05.371 INFO:tasks.workunit.client.0.smithi043.stdout:5/148: mkdir d0/df/d2d 0 2024-04-25T23:01:05.371 INFO:tasks.workunit.client.0.smithi043.stdout:2/107: read d2/d9/fe [1475497,117181] 0 2024-04-25T23:01:05.371 INFO:tasks.workunit.client.0.smithi043.stdout:1/158: mkdir d0/d3c 0 2024-04-25T23:01:05.372 INFO:tasks.workunit.client.0.smithi043.stdout:3/162: dread d7/d26/d27/d34/f24 [0,4194304] 0 2024-04-25T23:01:05.373 INFO:tasks.workunit.client.0.smithi043.stdout:0/183: link d1b/c2d d1b/c38 0 2024-04-25T23:01:05.373 INFO:tasks.workunit.client.0.smithi043.stdout:5/149: mknod d0/d22/c2e 0 2024-04-25T23:01:05.377 INFO:tasks.workunit.client.0.smithi043.stdout:0/184: mkdir d1b/d23/d39 0 2024-04-25T23:01:05.378 INFO:tasks.workunit.client.0.smithi043.stdout:7/107: write d3/f19 [756353,15505] 0 2024-04-25T23:01:05.378 INFO:tasks.workunit.client.0.smithi043.stdout:0/185: chown f18 272 1 2024-04-25T23:01:05.378 INFO:tasks.workunit.client.0.smithi043.stdout:3/163: dread d7/f18 [4194304,4194304] 0 2024-04-25T23:01:05.381 INFO:tasks.workunit.client.0.smithi043.stdout:7/108: symlink d3/d1e/d1f/l25 0 2024-04-25T23:01:05.382 INFO:tasks.workunit.client.0.smithi043.stdout:3/164: fsync d7/d26/d27/d34/f13 0 2024-04-25T23:01:05.382 INFO:tasks.workunit.client.0.smithi043.stdout:1/159: dwrite d0/d9/f21 [0,4194304] 0 2024-04-25T23:01:05.383 INFO:tasks.workunit.client.0.smithi043.stdout:4/223: dread d3/f7 [0,4194304] 0 2024-04-25T23:01:05.383 INFO:tasks.workunit.client.0.smithi043.stdout:0/186: rename d1b/f27 to d1b/d31/f3a 0 2024-04-25T23:01:05.384 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:05.380+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:05.384 INFO:tasks.workunit.client.0.smithi043.stdout:2/108: dwrite d2/d9/dd/f11 [0,4194304] 0 2024-04-25T23:01:05.384 INFO:tasks.workunit.client.0.smithi043.stdout:5/150: dwrite d0/fd [0,4194304] 0 2024-04-25T23:01:05.385 INFO:tasks.workunit.client.0.smithi043.stdout:5/151: fdatasync d0/d22/f28 0 2024-04-25T23:01:05.386 INFO:tasks.workunit.client.0.smithi043.stdout:6/153: dwrite d1/f29 [0,4194304] 0 2024-04-25T23:01:05.387 INFO:tasks.workunit.client.0.smithi043.stdout:5/152: write d0/d8/d15/d1c/d25/f27 [658537,129742] 0 2024-04-25T23:01:05.387 INFO:tasks.workunit.client.0.smithi043.stdout:7/109: chown d3/da/df/d11/c1d 488841114 1 2024-04-25T23:01:05.388 INFO:tasks.workunit.client.0.smithi043.stdout:9/203: sync 2024-04-25T23:01:05.388 INFO:tasks.workunit.client.0.smithi043.stdout:8/111: sync 2024-04-25T23:01:05.388 INFO:tasks.workunit.client.0.smithi043.stdout:2/109: write d2/d3/d13/d18/f19 [237392,54670] 0 2024-04-25T23:01:05.389 INFO:tasks.workunit.client.0.smithi043.stdout:4/224: creat d3/de/d27/d45/f50 x:0 0 0 2024-04-25T23:01:05.389 INFO:tasks.workunit.client.0.smithi043.stdout:0/187: mknod d1b/c3b 0 2024-04-25T23:01:05.390 INFO:tasks.workunit.client.0.smithi043.stdout:6/154: symlink d1/df/d1a/l34 0 2024-04-25T23:01:05.390 INFO:tasks.workunit.client.0.smithi043.stdout:9/204: creat d8/de/f42 x:0 0 0 2024-04-25T23:01:05.390 INFO:tasks.workunit.client.0.smithi043.stdout:7/110: mkdir d3/da/df/d11/d26 0 2024-04-25T23:01:05.390 INFO:tasks.workunit.client.0.smithi043.stdout:1/160: rename d0/d16/d27 to d0/d3d 0 2024-04-25T23:01:05.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/112: link d3/d4/f8 d3/d4/f25 0 2024-04-25T23:01:05.391 INFO:tasks.workunit.client.0.smithi043.stdout:0/188: chown d1b/l32 394717902 1 2024-04-25T23:01:05.391 INFO:tasks.workunit.client.0.smithi043.stdout:5/153: symlink d0/d8/d15/d1c/l2f 0 2024-04-25T23:01:05.392 INFO:tasks.workunit.client.0.smithi043.stdout:8/113: chown d3/cc 12715584 1 2024-04-25T23:01:05.393 INFO:tasks.workunit.client.0.smithi043.stdout:6/155: creat d1/d5/d14/d30/f35 x:0 0 0 2024-04-25T23:01:05.393 INFO:tasks.workunit.client.0.smithi043.stdout:7/111: mknod d3/d1e/d1f/c27 0 2024-04-25T23:01:05.394 INFO:tasks.workunit.client.0.smithi043.stdout:0/189: mkdir d1b/d31/d3c 0 2024-04-25T23:01:05.394 INFO:tasks.workunit.client.0.smithi043.stdout:9/205: rename d8/fc to d8/de/d12/d15/d2f/f43 0 2024-04-25T23:01:05.394 INFO:tasks.workunit.client.0.smithi043.stdout:6/156: stat d1/df/d21/f24 0 2024-04-25T23:01:05.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/114: unlink d3/f1b 0 2024-04-25T23:01:05.395 INFO:tasks.workunit.client.0.smithi043.stdout:2/110: dread d2/d9/dd/f11 [0,4194304] 0 2024-04-25T23:01:05.395 INFO:tasks.workunit.client.0.smithi043.stdout:8/115: mknod d3/d17/c26 0 2024-04-25T23:01:05.395 INFO:tasks.workunit.client.0.smithi043.stdout:8/116: write d3/d4/db/df/d10/f15 [414569,23774] 0 2024-04-25T23:01:05.397 INFO:tasks.workunit.client.0.smithi043.stdout:5/154: dread d0/fd [0,4194304] 0 2024-04-25T23:01:05.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/155: rename d0/df to d0/d22/d30 0 2024-04-25T23:01:05.399 INFO:tasks.workunit.client.0.smithi043.stdout:3/165: read d7/f9 [322073,73357] 0 2024-04-25T23:01:05.400 INFO:tasks.workunit.client.0.smithi043.stdout:5/156: link d0/c10 d0/d22/c31 0 2024-04-25T23:01:05.400 INFO:tasks.workunit.client.0.smithi043.stdout:3/166: readlink d7/d26/d27/d34/d1a/l1c 0 2024-04-25T23:01:05.400 INFO:tasks.workunit.client.0.smithi043.stdout:6/157: dwrite d1/fa [8388608,4194304] 0 2024-04-25T23:01:05.402 INFO:tasks.workunit.client.0.smithi043.stdout:5/157: mkdir d0/d8/d15/d1c/d25/d32 0 2024-04-25T23:01:05.403 INFO:tasks.workunit.client.0.smithi043.stdout:3/167: mkdir d7/d39 0 2024-04-25T23:01:05.403 INFO:tasks.workunit.client.0.smithi043.stdout:6/158: unlink d1/d2a/l2d 0 2024-04-25T23:01:05.405 INFO:tasks.workunit.client.0.smithi043.stdout:0/190: truncate fa 999032 0 2024-04-25T23:01:05.405 INFO:tasks.workunit.client.0.smithi043.stdout:8/117: getdents d3/d17 0 2024-04-25T23:01:05.405 INFO:tasks.workunit.client.0.smithi043.stdout:7/112: write d3/f21 [2305970,46100] 0 2024-04-25T23:01:05.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/168: mknod d7/d26/d27/d34/c3a 0 2024-04-25T23:01:05.406 INFO:tasks.workunit.client.0.smithi043.stdout:4/225: read d3/d19/f48 [4018268,111287] 0 2024-04-25T23:01:05.406 INFO:tasks.workunit.client.0.smithi043.stdout:2/111: dwrite d2/d9/fe [0,4194304] 0 2024-04-25T23:01:05.406 INFO:tasks.workunit.client.0.smithi043.stdout:7/113: symlink d3/l28 0 2024-04-25T23:01:05.406 INFO:tasks.workunit.client.0.smithi043.stdout:5/158: rename d0/d8/d15/d1c/d25 to d0/d8/d15/d1c/d25/d32/d33 22 2024-04-25T23:01:05.406 INFO:tasks.workunit.client.0.smithi043.stdout:8/118: unlink d3/d4/f24 0 2024-04-25T23:01:05.408 INFO:tasks.workunit.client.0.smithi043.stdout:9/206: chown d8/de/d12/d16/d26/d31/d32/f3c 243693233 1 2024-04-25T23:01:05.408 INFO:tasks.workunit.client.0.smithi043.stdout:8/119: fsync d3/d17/f1a 0 2024-04-25T23:01:05.408 INFO:tasks.workunit.client.0.smithi043.stdout:4/226: dread d3/f7 [0,4194304] 0 2024-04-25T23:01:05.408 INFO:tasks.workunit.client.0.smithi043.stdout:4/227: fsync d3/f28 0 2024-04-25T23:01:05.409 INFO:tasks.workunit.client.0.smithi043.stdout:0/191: rename d1b/f2c to d1b/d23/f3d 0 2024-04-25T23:01:05.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/114: rmdir d3/da/df/d11 39 2024-04-25T23:01:05.409 INFO:tasks.workunit.client.0.smithi043.stdout:9/207: mkdir d8/de/d44 0 2024-04-25T23:01:05.410 INFO:tasks.workunit.client.0.smithi043.stdout:8/120: creat d3/d1d/f27 x:0 0 0 2024-04-25T23:01:05.410 INFO:tasks.workunit.client.0.smithi043.stdout:5/159: rename d0/d8/f18 to d0/d8/d15/f34 0 2024-04-25T23:01:05.411 INFO:tasks.workunit.client.0.smithi043.stdout:0/192: creat d1b/d23/f3e x:0 0 0 2024-04-25T23:01:05.412 INFO:tasks.workunit.client.0.smithi043.stdout:0/193: stat d1b/c38 0 2024-04-25T23:01:05.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/208: unlink d8/de/d12/d16/d26/l27 0 2024-04-25T23:01:05.413 INFO:tasks.workunit.client.0.smithi043.stdout:7/115: truncate d3/da/df/f1a 754541 0 2024-04-25T23:01:05.413 INFO:tasks.workunit.client.0.smithi043.stdout:5/160: creat d0/f35 x:0 0 0 2024-04-25T23:01:05.415 INFO:tasks.workunit.client.0.smithi043.stdout:4/228: dread d3/f24 [0,4194304] 0 2024-04-25T23:01:05.415 INFO:tasks.workunit.client.0.smithi043.stdout:3/169: dwrite d7/d26/d27/d34/d1a/f1d [0,4194304] 0 2024-04-25T23:01:05.415 INFO:tasks.workunit.client.0.smithi043.stdout:2/112: dwrite d2/d3/d13/d18/f19 [0,4194304] 0 2024-04-25T23:01:05.417 INFO:tasks.workunit.client.0.smithi043.stdout:3/170: chown d7/d32 72024 1 2024-04-25T23:01:05.417 INFO:tasks.workunit.client.0.smithi043.stdout:0/194: rename d1b/d31/f36 to d1b/f3f 0 2024-04-25T23:01:05.417 INFO:tasks.workunit.client.0.smithi043.stdout:4/229: stat d3/fa 0 2024-04-25T23:01:05.420 INFO:tasks.workunit.client.0.smithi043.stdout:9/209: rename d8/de/d12/d16/f3d to d8/de/d44/f45 0 2024-04-25T23:01:05.421 INFO:tasks.workunit.client.0.smithi043.stdout:3/171: symlink d7/d26/d27/d34/l3b 0 2024-04-25T23:01:05.422 INFO:tasks.workunit.client.0.smithi043.stdout:4/230: write d3/f3c [4013499,21163] 0 2024-04-25T23:01:05.422 INFO:tasks.workunit.client.0.smithi043.stdout:0/195: creat d1b/f40 x:0 0 0 2024-04-25T23:01:05.422 INFO:tasks.workunit.client.0.smithi043.stdout:7/116: dwrite d3/f19 [4194304,4194304] 0 2024-04-25T23:01:05.423 INFO:tasks.workunit.client.0.smithi043.stdout:0/196: write f12 [449127,130413] 0 2024-04-25T23:01:05.424 INFO:tasks.workunit.client.0.smithi043.stdout:3/172: fsync d7/f20 0 2024-04-25T23:01:05.424 INFO:tasks.workunit.client.0.smithi043.stdout:4/231: mknod d3/de/d27/d45/c51 0 2024-04-25T23:01:05.424 INFO:tasks.workunit.client.0.smithi043.stdout:9/210: rename d8/de/l37 to d8/l46 0 2024-04-25T23:01:05.424 INFO:tasks.workunit.client.0.smithi043.stdout:5/161: write d0/fc [571105,73852] 0 2024-04-25T23:01:05.425 INFO:tasks.workunit.client.0.smithi043.stdout:4/232: write d3/de/fd [3126554,84006] 0 2024-04-25T23:01:05.425 INFO:tasks.workunit.client.0.smithi043.stdout:2/113: dwrite d2/d3/d13/d18/f19 [0,4194304] 0 2024-04-25T23:01:05.426 INFO:tasks.workunit.client.0.smithi043.stdout:0/197: getdents d1b/d31 0 2024-04-25T23:01:05.427 INFO:tasks.workunit.client.0.smithi043.stdout:0/198: truncate f11 705596 0 2024-04-25T23:01:05.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/211: dread - d8/de/d12/d16/f40 zero size 2024-04-25T23:01:05.428 INFO:tasks.workunit.client.0.smithi043.stdout:3/173: link d7/d26/d27/d34/f24 d7/d26/d27/d34/d1a/d28/f3c 0 2024-04-25T23:01:05.430 INFO:tasks.workunit.client.0.smithi043.stdout:2/114: symlink d2/d9/dd/l1f 0 2024-04-25T23:01:05.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/162: mknod d0/d22/d30/d2d/c36 0 2024-04-25T23:01:05.430 INFO:tasks.workunit.client.0.smithi043.stdout:4/233: creat d3/d37/d4d/f52 x:0 0 0 2024-04-25T23:01:05.430 INFO:tasks.workunit.client.0.smithi043.stdout:0/199: truncate fb 59661 0 2024-04-25T23:01:05.430 INFO:tasks.workunit.client.0.smithi043.stdout:9/212: mkdir d8/de/d44/d47 0 2024-04-25T23:01:05.430 INFO:tasks.workunit.client.0.smithi043.stdout:7/117: dwrite d3/d1e/d1f/f24 [0,4194304] 0 2024-04-25T23:01:05.432 INFO:tasks.workunit.client.0.smithi043.stdout:5/163: fdatasync d0/d8/d15/f26 0 2024-04-25T23:01:05.433 INFO:tasks.workunit.client.0.smithi043.stdout:9/213: symlink d8/de/d12/d15/l48 0 2024-04-25T23:01:05.433 INFO:tasks.workunit.client.0.smithi043.stdout:5/164: write d0/fd [2400256,38928] 0 2024-04-25T23:01:05.434 INFO:tasks.workunit.client.0.smithi043.stdout:7/118: mknod d3/da/df/d11/c29 0 2024-04-25T23:01:05.434 INFO:tasks.workunit.client.0.smithi043.stdout:4/234: dread d3/de/f32 [0,4194304] 0 2024-04-25T23:01:05.435 INFO:tasks.workunit.client.0.smithi043.stdout:7/119: chown d3/da/df/d11/f15 8949217 1 2024-04-25T23:01:05.436 INFO:tasks.workunit.client.0.smithi043.stdout:3/174: dwrite d7/d26/d27/d34/d1a/d28/f29 [4194304,4194304] 0 2024-04-25T23:01:05.437 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:05.437 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:05.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.437 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11106 4.4 4:2190a9bb:::100000031f2.00000001:head [write 0~4194304 [2@3638885] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:05.424137+0000", 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.013137632, 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.013173915, 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:05.438 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11106 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.424137+0000", 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:05.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.424137+0000", 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.424139+0000", 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.31e-06 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:05.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430354+0000", 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062148189999999999 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430378+0000", 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4814999999999999e-05 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430394+0000", 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5619000000000001e-05 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430541+0000", 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000146651 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430767+0000", 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022675500000000001 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11110 4.2e 4:743b433f:::1000000315a.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:05.430666+0000", 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0066091709999999996, 2024-04-25T23:01:05.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0067128700000000001, 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11110 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430666+0000", 2024-04-25T23:01:05.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430666+0000", 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:05.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.430667+0000", 2024-04-25T23:01:05.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6799999999999999e-07 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436034+0000", 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0053674700000000001 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436056+0000", 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1511000000000001e-05 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436068+0000", 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1908e-05 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436152+0000", 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4204999999999998e-05 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:05.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436271+0000", 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119502 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11112 4.3f 4:fdec9c25:::10000003163.00000000:head [write 2400256~38928 [2@1123823] in=38928b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:05.436102+0000", 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.001173335, 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0013365390000000001, 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:05.587 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11112 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436102+0000", 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:05.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436102+0000", 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436103+0000", 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.734e-06 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436131+0000", 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.722e-05 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436139+0000", 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5709999999999998e-06 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436145+0000", 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7440000000000004e-06 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436217+0000", 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1713999999999998e-05 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:05.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:05.436292+0000", 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5654000000000004e-05 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 3 2024-04-25T23:01:05.591 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:05.594 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:05.594 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:05.590+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:7/120: symlink d3/d1e/d1f/l2a 0 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/165: fsync d0/d8/fe 0 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:7/121: chown d3/da/df 57 1 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:3/175: rename d7/d26/d27/d34/f13 to d7/d26/f3d 0 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/166: write d0/d22/d30/f29 [889949,120025] 0 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/167: rename d0/d22/d30 to d0/d8/d15/d37 0 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:9/214: dwrite d8/de/d44/f45 [0,4194304] 0 2024-04-25T23:01:05.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/168: fdatasync d0/f35 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:4/235: dwrite d3/d21/f2e [0,4194304] 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:9/215: write d8/de/f42 [43197,27363] 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:5/169: write d0/fd [3061599,19918] 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:4/236: symlink d3/d37/d4d/l53 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:9/216: mknod d8/de/d12/c49 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:5/170: mknod d0/d2c/c38 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:5/171: stat d0/d8/d15/d37/l12 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:4/237: rename d3/de/f32 to d3/d37/f54 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:9/217: creat d8/de/d12/d16/d26/d31/d32/d39/f4a x:0 0 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:5/172: truncate d0/d22/f28 140064 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:4/238: chown d3/d21/l3f 493 1 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:9/218: write d8/f2e [7967483,65191] 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:3/176: dwrite d7/f20 [0,4194304] 0 2024-04-25T23:01:05.619 INFO:tasks.workunit.client.0.smithi043.stdout:5/173: rename d0/d8/d15 to d0/d2c/d39 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/174: fsync d0/f17 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:9/219: unlink d8/f2e 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/177: unlink d7/d32/c33 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/175: unlink d0/d2c/d39/d37/l12 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:4/239: link d3/de/d27/l4e d3/l55 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/176: write d0/fc [423404,73520] 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/178: creat d7/d32/f3e x:0 0 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:9/220: rename d8/de/d12/d16/l1a to d8/de/l4b 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:4/240: symlink d3/d21/l56 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/179: stat d7/d26/d2d/c2e 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:9/221: truncate d8/de/f3e 321804 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/177: mkdir d0/d8/d3a 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/178: rename d0/fc to d0/d8/f3b 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:9/222: mknod d8/de/d44/d47/c4c 0 2024-04-25T23:01:05.620 INFO:tasks.workunit.client.0.smithi043.stdout:9/223: getdents d8/de/d44 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:3/180: getdents d7/d26/d27/d34 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:9/224: link d8/de/f3e d8/de/d12/d16/d26/f4d 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:3/181: mknod d7/d26/d27/c3f 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/241: dwrite d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:3/182: getdents d7/d26/d27/d34 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/242: creat d3/f57 x:0 0 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/179: dwrite d0/d2c/d39/d37/f1e [0,4194304] 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/180: fsync d0/d2c/d39/d1c/d25/f27 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/243: symlink d3/de/d27/d45/l58 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/181: chown d0/c1b 7 1 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:3/183: dread d7/d26/d27/d34/f24 [0,4194304] 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/244: creat d3/d21/f59 x:0 0 0 2024-04-25T23:01:05.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/182: mknod d0/d2c/d39/d37/c3c 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:3/184: mkdir d7/d26/d27/d34/d1a/d40 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:4/245: readlink d3/de/d27/l4e 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:9/225: dwrite d8/de/d12/d16/d26/d31/f3f [0,4194304] 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:5/183: mknod d0/d8/c3d 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:5/184: dread - d0/f23 zero size 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:3/185: chown d7/l19 53560 1 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:9/226: symlink d8/de/d12/d16/l4e 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:5/185: rename d0/d22/f28 to d0/d8/d3a/f3e 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:4/246: link d3/de/d46/f4b d3/d19/f5a 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:4/247: stat d3/d19/f1e 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:9/227: write d8/de/d12/d16/f36 [571000,119030] 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:3/186: creat d7/d26/f41 x:0 0 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:4/248: fdatasync d3/f7 0 2024-04-25T23:01:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:5/186: dread d0/d8/d3a/f3e [0,4194304] 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:4/249: mkdir d3/d37/d5b 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:3/187: symlink d7/d26/d27/d34/d1a/l42 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:5/187: symlink d0/d2c/d39/l3f 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:9/228: mkdir d8/de/d12/d16/d26/d31/d32/d39/d4f 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:5/188: creat d0/f40 x:0 0 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:9/229: creat d8/de/d12/d15/d2f/f50 x:0 0 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:5/189: fsync d0/f23 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:9/230: readlink d8/lf 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:9/231: unlink d8/de/d12/d16/d26/d31/d32/d39/f4a 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:3/188: dread d7/d26/d27/d34/d1a/f1d [0,4194304] 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:9/232: truncate d8/de/d12/d16/d24/f28 6849549 0 2024-04-25T23:01:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:9/233: symlink d8/de/d12/d15/d2f/l51 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:3/189: dread d7/f20 [0,4194304] 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/234: write d8/de/d12/d15/f17 [4668756,65020] 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/190: dwrite d0/d2c/d39/d37/f1e [0,4194304] 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:3/190: truncate d7/d26/d2d/f36 943247 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/235: getdents d8/de/d12/d16/d24 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/236: rename d8/de/d12/d16/d24/f41 to d8/f52 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/237: creat d8/de/d12/d15/f53 x:0 0 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/191: dwrite d0/d2c/d39/d1c/f2b [0,4194304] 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/192: write d0/fd [945728,102479] 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/193: dread - d0/f35 zero size 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/194: mkdir d0/d2c/d39/d37/d41 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/195: fdatasync d0/d2c/d39/d37/f29 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/238: dwrite d8/de/d12/d15/f17 [4194304,4194304] 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:9/239: truncate d8/de/d12/d15/d2f/f43 1744774 0 2024-04-25T23:01:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/196: dwrite d0/d8/f3b [0,4194304] 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:9/240: getdents d8/de/d12/d16/d26 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:5/197: fdatasync d0/d8/fe 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:7/122: dread d3/f21 [0,4194304] 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:5/198: mknod d0/d22/c42 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:9/241: read d8/fd [2516183,77449] 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:7/123: symlink d3/da/df/l2b 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:9/242: stat d8/de/d12/d15/d2f/l51 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:7/124: chown d3/f5 194872124 1 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:3/191: truncate d7/f20 70774 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:5/199: link d0/d2c/d39/d1c/f2b d0/d8/d3a/f43 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:5/200: read d0/d8/d3a/f3e [35840,13160] 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:7/125: getdents d3/da/df/d11 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:3/192: link d7/f2a d7/d39/f43 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:5/201: rename d0/d2c/d39/f26 to d0/d2c/d39/d37/f44 0 2024-04-25T23:01:05.625 INFO:tasks.workunit.client.0.smithi043.stdout:7/126: getdents d3/d1e 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/202: mknod d0/d2c/d39/d37/c45 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:7/127: read d3/f21 [3365896,6574] 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:7/128: mknod d3/d1e/c2c 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/203: creat d0/d2c/f46 x:0 0 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:7/129: fdatasync d3/f21 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/204: mkdir d0/d2c/d39/d37/d41/d47 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/205: unlink d0/d8/f3b 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:3/193: dread d7/d26/d27/d34/d1a/d28/f29 [4194304,4194304] 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/206: getdents d0 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:3/194: mknod d7/d26/d27/d34/d1a/c44 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/207: truncate d0/f23 50393 0 2024-04-25T23:01:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:3/195: readlink d7/d26/d27/d34/d1a/l42 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:3/196: creat d7/d26/d27/d34/f45 x:0 0 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:5/208: rename d0/d2c/d39/d37/c13 to d0/d2c/d39/d1c/d25/c48 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:7/130: dwrite d3/da/df/d11/f15 [0,4194304] 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:7/131: readlink d3/l28 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:4/250: dread d3/d21/f25 [0,4194304] 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:9/243: truncate d8/fd 2176037 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:3/197: link d7/d26/d27/d34/d1a/d28/f29 d7/d26/d27/d34/d1a/d28/f46 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:7/132: symlink d3/da/df/d11/d26/l2d 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:9/244: write d8/f52 [904022,89909] 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:7/133: creat d3/da/f2e x:0 0 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:5/209: dwrite d0/d2c/d39/d37/f1e [0,4194304] 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:5/210: dread d0/d8/d3a/f3e [0,4194304] 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:7/134: rename d3/da/f2e to d3/da/df/d11/f2f 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:3/198: write d7/d32/f38 [261601,22801] 0 2024-04-25T23:01:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:9/245: truncate d8/de/d12/d15/d2f/f43 313225 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:3/199: read d7/d26/d27/d34/f24 [1347584,109227] 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:5/211: dwrite d0/d2c/d39/d37/f44 [0,4194304] 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:7/135: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:3/200: rename d7/d26/d27/d34/f15 to d7/d26/d27/d34/d1a/d40/f47 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:5/212: mknod d0/d2c/d39/d37/c49 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:9/246: link d8/de/d12/d16/d26/d31/d32/d39/l3b d8/de/d12/d16/d26/d31/d32/d39/l54 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:7/136: truncate d3/da/df/f1a 1537040 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:5/213: rmdir d0/d2c/d39/d37/d2d 39 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:3/201: getdents d7/d26 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:7/137: symlink d3/da/l30 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:9/247: chown d8/de/d12/d15/d2f/l38 7 1 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:5/214: mkdir d0/d2c/d39/d37/d41/d4a 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:9/248: unlink d8/lf 0 2024-04-25T23:01:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:5/215: symlink d0/d2c/d39/d37/d2d/l4b 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:9/249: rename d8/de/d12/d16/d26/d31/d32/f34 to d8/f55 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:7/138: dwrite d3/da/df/d11/f2f [0,4194304] 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:5/216: dwrite d0/d2c/f46 [0,4194304] 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:7/139: rename d3/l18 to d3/d1e/d1f/l31 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:3/202: dwrite d7/d39/f43 [0,4194304] 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:5/217: truncate d0/d8/fe 1085930 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:3/203: creat d7/d26/d27/f48 x:0 0 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:5/218: rmdir d0/d2c/d39/d1c 39 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:5/219: creat d0/d2c/f4c x:0 0 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:9/250: dwrite d8/de/d12/d16/d26/f4d [0,4194304] 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:5/220: mknod d0/d2c/d39/d37/d41/d47/c4d 0 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:5/221: dread - d0/f17 zero size 2024-04-25T23:01:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:9/251: creat d8/de/d12/d15/d2f/f56 x:0 0 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:9/252: symlink d8/de/d12/d15/d2f/l57 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/204: dread d7/d26/d27/d34/d1a/d28/f3c [0,4194304] 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:9/253: getdents d8/de/d12/d16/d24 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/205: symlink d7/d26/d27/d34/l49 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/206: write d7/f2a [3753924,118894] 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/207: rename d7/d39/f43 to d7/d39/f4a 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/208: symlink d7/d39/l4b 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/209: getdents d7/d26/d27/d34/d1a/d40 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:5/222: dread d0/fd [0,4194304] 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/210: creat d7/d26/d27/d34/d1a/d28/f4c x:0 0 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:5/223: getdents d0/d2c/d39/d37/d2d 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:5/224: dread d0/d8/d3a/f43 [0,4194304] 0 2024-04-25T23:01:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:7/140: fsync d3/da/df/d11/f2f 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:4/251: dread d3/de/fd [0,4194304] 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:3/211: dwrite d7/f2a [0,4194304] 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/225: mkdir d0/d2c/d39/d1c/d25/d4e 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:7/141: mknod d3/da/df/d11/d26/c32 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:4/252: mkdir d3/de/d27/d5c 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/226: chown d0/d2c 1650 1 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:7/142: chown d3/da/df/f1a 1256 1 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/227: mknod d0/c4f 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:7/143: write d3/f21 [2675217,128629] 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:3/212: fdatasync d7/d26/d27/d34/d1a/f1d 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:7/144: mknod d3/c33 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:3/213: fdatasync d7/f18 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:7/145: mknod d3/da/df/d11/d26/c34 0 2024-04-25T23:01:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:3/214: chown d7/f25 5 1 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/146: dread - d3/da/f23 zero size 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:3/215: stat d7/d26/d27/d34/l49 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/147: stat d3/da/df/d11/d26/c32 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/148: fdatasync d3/f19 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:3/216: rename d7/d26/d2d/c2e to d7/d26/c4d 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/253: dwrite d3/d21/f59 [0,4194304] 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/149: dread d3/da/df/f1a [0,4194304] 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/254: rename d3/l23 to d3/d19/l5d 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/255: chown d3/f24 5817636 1 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/150: rename d3/d1e to d3/d1e/d35 22 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/151: creat d3/da/f36 x:0 0 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/256: creat d3/d37/d5b/f5e x:0 0 0 2024-04-25T23:01:05.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/152: rmdir d3/d1e 39 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/257: dread - d3/d19/f5a zero size 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/258: dread - d3/d37/d5b/f5e zero size 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/259: chown d3/c33 3239261 1 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/260: creat d3/d19/d34/f5f x:0 0 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/261: readlink d3/de/d27/d45/l58 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/262: mknod d3/de/d27/d45/c60 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/263: chown d3/d21/f25 277258959 1 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/264: fsync d3/de/fd 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/265: rename d3/c3a to d3/d21/c61 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:5/228: fdatasync d0/d2c/f4c 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/266: dwrite d3/f24 [0,4194304] 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:3/217: readlink d7/d26/d27/d34/d1a/l1c 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:4/267: readlink d3/l20 0 2024-04-25T23:01:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:9/254: dwrite d8/de/d12/d16/d24/f2a [0,4194304] 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:3/218: write d7/d26/f41 [234728,16241] 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:4/268: rename d3/d19/d34/l4f to d3/l62 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:9/255: mknod d8/de/d12/c58 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:7/153: dwrite d3/da/df/d11/f20 [0,4194304] 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:4/269: write d3/f28 [726466,21734] 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:4/270: stat d3/de/d27/d45/l58 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:9/256: truncate d8/de/d12/d15/d2f/f50 334352 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:7/154: chown d3/da/df/d11/c29 0 1 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:9/257: creat d8/f59 x:0 0 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:7/155: read d3/d1e/d1f/f24 [1382122,8541] 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:4/271: truncate d3/d37/d5b/f5e 98107 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/229: dwrite d0/f5 [4194304,4194304] 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:7/156: write d3/da/df/d11/f2f [3658831,58539] 0 2024-04-25T23:01:05.634 INFO:tasks.workunit.client.0.smithi043.stdout:4/272: creat d3/d21/f63 x:0 0 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:9/258: creat d8/f5a x:0 0 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:5/230: creat d0/d2c/d39/d1c/d25/d32/f50 x:0 0 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/219: dwrite d7/d26/d27/d34/d1a/f1d [0,4194304] 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:7/157: getdents d3 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:5/231: rmdir d0/d2c/d39/d1c/d25/d32 39 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:4/273: creat d3/d21/f64 x:0 0 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:9/259: creat d8/de/d12/d16/d26/d31/f5b x:0 0 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/220: mknod d7/d32/c4e 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:7/158: readlink d3/da/l30 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:7/159: rmdir d3/da 39 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:9/260: chown d8/de/d44/d47 51725 1 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:4/274: write d3/d19/d34/f5f [952997,3947] 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:5/232: mkdir d0/d2c/d39/d37/d51 0 2024-04-25T23:01:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:4/275: symlink d3/d21/l65 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:9/261: mknod d8/de/d12/d15/c5c 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:7/160: chown d3 1 1 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:5/233: symlink d0/d2c/d39/d37/d2d/l52 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:4/276: mknod d3/de/d27/d45/c66 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:4/277: stat d3/d37/d4d/l53 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:7/161: mknod d3/da/df/c37 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:7/162: fsync d3/da/f36 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:7/163: truncate d3/f5 4626180 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:9/262: dread d8/de/d12/d16/d24/f2a [0,4194304] 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:5/234: dread d0/d2c/d39/d1c/f2b [0,4194304] 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:5/235: chown d0/d2c/d39/d37/f44 1365019201 1 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:5/236: creat d0/d8/f53 x:0 0 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:3/221: write d7/d26/d27/d34/d1a/d28/f29 [3986437,80426] 0 2024-04-25T23:01:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:3/222: chown d7/d26/d27/d34/d1a/d40 246 1 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:7/164: truncate d3/da/df/d11/f20 1058700 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:3/223: dread d7/d32/f38 [0,4194304] 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:7/165: dread d3/da/df/f1a [0,4194304] 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:5/237: dwrite d0/d2c/d39/d1c/d25/f27 [0,4194304] 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:3/224: link d7/d26/f41 d7/d32/f4f 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:4/278: dwrite d3/f4 [0,4194304] 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:7/166: write d3/da/f23 [725663,128009] 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:9/263: dread d8/de/d12/d16/f30 [0,4194304] 0 2024-04-25T23:01:05.637 INFO:tasks.workunit.client.0.smithi043.stdout:4/279: unlink d3/l20 0 2024-04-25T23:01:05.641 INFO:tasks.workunit.client.0.smithi043.stdout:5/238: link d0/d2c/f4c d0/d2c/d39/d37/d41/d47/f54 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:4/280: write d3/d37/d5b/f5e [488719,5622] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:1/161: sync 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:1/162: getdents d0/d9 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/264: write d8/de/d12/d16/d24/f33 [578340,14345] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:7/167: dwrite d3/f21 [0,4194304] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/265: rename d8/de/d12/d16/d26/d31/d32/d39 to d8/de/d44/d5d 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:5/239: dwrite d0/d2c/d39/d1c/f2b [0,4194304] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:5/240: chown d0/d2c/d39/d37/d2d/l4b 11 1 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:7/168: read d3/da/df/d11/f15 [1631897,7884] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:1/163: dwrite d0/f26 [0,4194304] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:7/169: write d3/da/f36 [517322,67837] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:1/164: write d0/d3d/f30 [12671,2937] 0 2024-04-25T23:01:05.642 INFO:tasks.workunit.client.0.smithi043.stdout:5/241: truncate d0/d8/fe 2092394 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/165: write d0/d16/f1b [4120470,110516] 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/166: mknod d0/c3e 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:5/242: write d0/d8/d3a/f3e [912883,41973] 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/167: chown d0/d9/l37 166 1 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/168: write d0/d9/f24 [503598,125694] 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/266: dwrite d8/de/d12/d15/d2f/f56 [0,4194304] 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/169: chown d0/d9/l14 2 1 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/170: mknod d0/c3f 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/267: link d8/l46 d8/de/l5e 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/171: symlink d0/d2f/l40 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/268: truncate d8/f5a 829575 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/172: symlink d0/d9/l41 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:7/170: write d3/da/df/f1a [81194,50165] 0 2024-04-25T23:01:05.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/269: rename d8/de/d44/d5d/l54 to d8/de/d44/d5d/l5f 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:1/173: getdents d0/d16 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:7/171: mknod d3/da/c38 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:1/174: stat d0/d9/l1d 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/270: creat d8/de/d44/f60 x:0 0 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:1/175: write d0/f2 [1694467,6626] 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:7/172: rmdir d3/da/df/d11/d26 39 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/271: write d8/de/d12/d15/f2c [985953,12404] 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:7/173: creat d3/d1e/f39 x:0 0 0 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/272: chown d8/de/d44/d5d/d4f 3354811 1 2024-04-25T23:01:05.644 INFO:tasks.workunit.client.0.smithi043.stdout:1/176: link d0/ld d0/d3c/l42 0 2024-04-25T23:01:05.646 INFO:tasks.workunit.client.0.smithi043.stdout:7/174: truncate d3/da/df/d11/f2f 4888032 0 2024-04-25T23:01:05.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/115: sync 2024-04-25T23:01:05.646 INFO:tasks.workunit.client.0.smithi043.stdout:0/200: sync 2024-04-25T23:01:05.646 INFO:tasks.workunit.client.0.smithi043.stdout:6/159: sync 2024-04-25T23:01:05.646 INFO:tasks.workunit.client.0.smithi043.stdout:8/121: sync 2024-04-25T23:01:05.646 INFO:tasks.workunit.client.0.smithi043.stdout:7/175: fdatasync d3/f19 0 2024-04-25T23:01:05.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/122: fdatasync d3/d13/f1e 0 2024-04-25T23:01:05.647 INFO:tasks.workunit.client.0.smithi043.stdout:2/116: write d2/d3/d13/f1e [913599,99165] 0 2024-04-25T23:01:05.647 INFO:tasks.workunit.client.0.smithi043.stdout:6/160: creat d1/d5/d14/f36 x:0 0 0 2024-04-25T23:01:05.647 INFO:tasks.workunit.client.0.smithi043.stdout:7/176: symlink d3/da/df/d11/l3a 0 2024-04-25T23:01:05.647 INFO:tasks.workunit.client.0.smithi043.stdout:6/161: symlink d1/d2a/l37 0 2024-04-25T23:01:05.648 INFO:tasks.workunit.client.0.smithi043.stdout:7/177: rmdir d3/da/df/d11/d26 39 2024-04-25T23:01:05.648 INFO:tasks.workunit.client.0.smithi043.stdout:6/162: rmdir d1/d5 39 2024-04-25T23:01:05.649 INFO:tasks.workunit.client.0.smithi043.stdout:7/178: stat d3/f19 0 2024-04-25T23:01:05.650 INFO:tasks.workunit.client.0.smithi043.stdout:6/163: chown d1/f13 84882 1 2024-04-25T23:01:05.650 INFO:tasks.workunit.client.0.smithi043.stdout:0/201: dwrite f12 [0,4194304] 0 2024-04-25T23:01:05.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/202: chown d1b/f37 395984 1 2024-04-25T23:01:05.652 INFO:tasks.workunit.client.0.smithi043.stdout:9/273: dwrite d8/de/d12/d15/f17 [0,4194304] 0 2024-04-25T23:01:05.653 INFO:tasks.workunit.client.0.smithi043.stdout:6/164: mkdir d1/df/d21/d38 0 2024-04-25T23:01:05.654 INFO:tasks.workunit.client.0.smithi043.stdout:0/203: rename d1b/d23/l2e to d1b/d23/l41 0 2024-04-25T23:01:05.656 INFO:tasks.workunit.client.0.smithi043.stdout:2/117: dwrite d2/fc [0,4194304] 0 2024-04-25T23:01:05.657 INFO:tasks.workunit.client.0.smithi043.stdout:1/177: dread d0/d16/f22 [0,4194304] 0 2024-04-25T23:01:05.658 INFO:tasks.workunit.client.0.smithi043.stdout:1/178: chown d0/c3f 5116194 1 2024-04-25T23:01:05.658 INFO:tasks.workunit.client.0.smithi043.stdout:7/179: dread d3/da/df/d11/f2f [0,4194304] 0 2024-04-25T23:01:05.660 INFO:tasks.workunit.client.0.smithi043.stdout:6/165: mknod d1/c39 0 2024-04-25T23:01:05.661 INFO:tasks.workunit.client.0.smithi043.stdout:0/204: mkdir d1b/d42 0 2024-04-25T23:01:05.661 INFO:tasks.workunit.client.0.smithi043.stdout:2/118: chown d2/d3/c16 48675257 1 2024-04-25T23:01:05.661 INFO:tasks.workunit.client.0.smithi043.stdout:7/180: mknod d3/c3b 0 2024-04-25T23:01:05.662 INFO:tasks.workunit.client.0.smithi043.stdout:9/274: dwrite d8/de/d12/d16/d24/f33 [0,4194304] 0 2024-04-25T23:01:05.663 INFO:tasks.workunit.client.0.smithi043.stdout:0/205: fdatasync d1b/f3f 0 2024-04-25T23:01:05.663 INFO:tasks.workunit.client.0.smithi043.stdout:3/225: sync 2024-04-25T23:01:05.664 INFO:tasks.workunit.client.0.smithi043.stdout:3/226: readlink d7/l19 0 2024-04-25T23:01:05.665 INFO:tasks.workunit.client.0.smithi043.stdout:6/166: rename d1/d5/c1e to d1/c3a 0 2024-04-25T23:01:05.665 INFO:tasks.workunit.client.0.smithi043.stdout:7/181: symlink d3/d1e/d1f/l3c 0 2024-04-25T23:01:05.665 INFO:tasks.workunit.client.0.smithi043.stdout:9/275: chown d8/de/d12/d15/c5c 1785077 1 2024-04-25T23:01:05.666 INFO:tasks.workunit.client.0.smithi043.stdout:6/167: mkdir d1/d5/d3b 0 2024-04-25T23:01:05.667 INFO:tasks.workunit.client.0.smithi043.stdout:0/206: truncate d1b/f3f 1440790 0 2024-04-25T23:01:05.667 INFO:tasks.workunit.client.0.smithi043.stdout:5/243: dwrite d0/fd [0,4194304] 0 2024-04-25T23:01:05.669 INFO:tasks.workunit.client.0.smithi043.stdout:0/207: chown d1b/l29 264616 1 2024-04-25T23:01:05.669 INFO:tasks.workunit.client.0.smithi043.stdout:1/179: dwrite d0/f5 [0,4194304] 0 2024-04-25T23:01:05.669 INFO:tasks.workunit.client.0.smithi043.stdout:2/119: dread d2/d9/fe [0,4194304] 0 2024-04-25T23:01:05.671 INFO:tasks.workunit.client.0.smithi043.stdout:5/244: rmdir d0/d2c/d39 39 2024-04-25T23:01:05.671 INFO:tasks.workunit.client.0.smithi043.stdout:6/168: creat d1/d5/d3b/f3c x:0 0 0 2024-04-25T23:01:05.674 INFO:tasks.workunit.client.0.smithi043.stdout:2/120: unlink d2/d9/f12 0 2024-04-25T23:01:05.674 INFO:tasks.workunit.client.0.smithi043.stdout:3/227: link d7/d26/d27/d34/d1a/d28/f3c d7/d26/d27/d34/d1a/f50 0 2024-04-25T23:01:05.674 INFO:tasks.workunit.client.0.smithi043.stdout:1/180: link d0/d9/l37 d0/d16/l43 0 2024-04-25T23:01:05.674 INFO:tasks.workunit.client.0.smithi043.stdout:6/169: read d1/df/d21/f24 [2685136,90681] 0 2024-04-25T23:01:05.674 INFO:tasks.workunit.client.0.smithi043.stdout:0/208: rename f14 to d1b/d31/d3c/f43 0 2024-04-25T23:01:05.674 INFO:tasks.workunit.client.0.smithi043.stdout:2/121: read d2/d3/d13/d18/f19 [860860,101376] 0 2024-04-25T23:01:05.675 INFO:tasks.workunit.client.0.smithi043.stdout:1/181: write d0/f26 [4672327,2720] 0 2024-04-25T23:01:05.675 INFO:tasks.workunit.client.0.smithi043.stdout:3/228: mkdir d7/d32/d51 0 2024-04-25T23:01:05.675 INFO:tasks.workunit.client.0.smithi043.stdout:0/209: truncate fa 1874885 0 2024-04-25T23:01:05.676 INFO:tasks.workunit.client.0.smithi043.stdout:6/170: write d1/d5/f7 [2825644,109049] 0 2024-04-25T23:01:05.676 INFO:tasks.workunit.client.0.smithi043.stdout:5/245: rename d0/d2c/f46 to d0/d2c/d39/d1c/f55 0 2024-04-25T23:01:05.677 INFO:tasks.workunit.client.0.smithi043.stdout:4/281: dread d3/fa [4194304,4194304] 0 2024-04-25T23:01:05.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/182: rmdir d0/d9 39 2024-04-25T23:01:05.677 INFO:tasks.workunit.client.0.smithi043.stdout:3/229: mkdir d7/d39/d52 0 2024-04-25T23:01:05.677 INFO:tasks.workunit.client.0.smithi043.stdout:7/182: dwrite d3/da/f23 [0,4194304] 0 2024-04-25T23:01:05.677 INFO:tasks.workunit.client.0.smithi043.stdout:6/171: readlink d1/df/d1a/l34 0 2024-04-25T23:01:05.678 INFO:tasks.workunit.client.0.smithi043.stdout:0/210: write d1b/f1f [638526,59247] 0 2024-04-25T23:01:05.678 INFO:tasks.workunit.client.0.smithi043.stdout:2/122: write d2/d3/d13/f1e [1323948,32073] 0 2024-04-25T23:01:05.678 INFO:tasks.workunit.client.0.smithi043.stdout:0/211: chown d1b/d31 489878078 1 2024-04-25T23:01:05.678 INFO:tasks.workunit.client.0.smithi043.stdout:6/172: dread - d1/d5/d14/f36 zero size 2024-04-25T23:01:05.679 INFO:tasks.workunit.client.0.smithi043.stdout:5/246: creat d0/d2c/d39/d1c/d25/f56 x:0 0 0 2024-04-25T23:01:05.679 INFO:tasks.workunit.client.0.smithi043.stdout:4/282: mkdir d3/de/d27/d5c/d67 0 2024-04-25T23:01:05.679 INFO:tasks.workunit.client.0.smithi043.stdout:6/173: chown d1/f20 540 1 2024-04-25T23:01:05.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/183: symlink d3/da/df/l3d 0 2024-04-25T23:01:05.680 INFO:tasks.workunit.client.0.smithi043.stdout:3/230: creat d7/d26/d2d/f53 x:0 0 0 2024-04-25T23:01:05.681 INFO:tasks.workunit.client.0.smithi043.stdout:0/212: creat d1b/d23/d39/f44 x:0 0 0 2024-04-25T23:01:05.681 INFO:tasks.workunit.client.0.smithi043.stdout:4/283: creat d3/d19/d34/f68 x:0 0 0 2024-04-25T23:01:05.681 INFO:tasks.workunit.client.0.smithi043.stdout:6/174: creat d1/d5/d14/d30/f3d x:0 0 0 2024-04-25T23:01:05.681 INFO:tasks.workunit.client.0.smithi043.stdout:3/231: creat d7/d26/d27/f54 x:0 0 0 2024-04-25T23:01:05.681 INFO:tasks.workunit.client.0.smithi043.stdout:5/247: symlink d0/d2c/d39/d37/d51/l57 0 2024-04-25T23:01:05.682 INFO:tasks.workunit.client.0.smithi043.stdout:7/184: mknod d3/d1e/c3e 0 2024-04-25T23:01:05.682 INFO:tasks.workunit.client.0.smithi043.stdout:2/123: rename d2/d3/l6 to d2/l20 0 2024-04-25T23:01:05.682 INFO:tasks.workunit.client.0.smithi043.stdout:4/284: symlink d3/de/d46/l69 0 2024-04-25T23:01:05.683 INFO:tasks.workunit.client.0.smithi043.stdout:6/175: symlink d1/df/l3e 0 2024-04-25T23:01:05.683 INFO:tasks.workunit.client.0.smithi043.stdout:3/232: mknod d7/d26/d27/c55 0 2024-04-25T23:01:05.683 INFO:tasks.workunit.client.0.smithi043.stdout:2/124: symlink d2/d3/d13/l21 0 2024-04-25T23:01:05.683 INFO:tasks.workunit.client.0.smithi043.stdout:4/285: mkdir d3/de/d46/d6a 0 2024-04-25T23:01:05.684 INFO:tasks.workunit.client.0.smithi043.stdout:6/176: link d1/f31 d1/d5/f3f 0 2024-04-25T23:01:05.684 INFO:tasks.workunit.client.0.smithi043.stdout:5/248: creat d0/d2c/d39/d1c/d25/d4e/f58 x:0 0 0 2024-04-25T23:01:05.684 INFO:tasks.workunit.client.0.smithi043.stdout:3/233: readlink d7/d26/d27/d34/d1a/l1c 0 2024-04-25T23:01:05.684 INFO:tasks.workunit.client.0.smithi043.stdout:7/185: chown d3/da/df/d11/l3a 1833342441 1 2024-04-25T23:01:05.685 INFO:tasks.workunit.client.0.smithi043.stdout:6/177: unlink d1/c39 0 2024-04-25T23:01:05.686 INFO:tasks.workunit.client.0.smithi043.stdout:6/178: chown d1/d5/d14/d30/f3d 218675 1 2024-04-25T23:01:05.686 INFO:tasks.workunit.client.0.smithi043.stdout:0/213: dread d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:05.686 INFO:tasks.workunit.client.0.smithi043.stdout:5/249: truncate d0/d2c/d39/d37/f44 5138361 0 2024-04-25T23:01:05.686 INFO:tasks.workunit.client.0.smithi043.stdout:3/234: dread - d7/d26/d27/d34/d1a/d28/f4c zero size 2024-04-25T23:01:05.687 INFO:tasks.workunit.client.0.smithi043.stdout:7/186: creat d3/da/df/f3f x:0 0 0 2024-04-25T23:01:05.687 INFO:tasks.workunit.client.0.smithi043.stdout:6/179: symlink d1/d5/d14/d30/l40 0 2024-04-25T23:01:05.687 INFO:tasks.workunit.client.0.smithi043.stdout:1/183: read d0/f2 [1841244,114290] 0 2024-04-25T23:01:05.688 INFO:tasks.workunit.client.0.smithi043.stdout:6/180: fdatasync d1/d5/f1b 0 2024-04-25T23:01:05.688 INFO:tasks.workunit.client.0.smithi043.stdout:3/235: dread d7/d32/f38 [0,4194304] 0 2024-04-25T23:01:05.688 INFO:tasks.workunit.client.0.smithi043.stdout:7/187: write d3/da/df/f1a [648066,71950] 0 2024-04-25T23:01:05.689 INFO:tasks.workunit.client.0.smithi043.stdout:4/286: dread d3/f3c [0,4194304] 0 2024-04-25T23:01:05.689 INFO:tasks.workunit.client.0.smithi043.stdout:6/181: rmdir d1/d5/d14/d30 39 2024-04-25T23:01:05.689 INFO:tasks.workunit.client.0.smithi043.stdout:3/236: chown d7/d26/d27/d34/d1a/l1c 322 1 2024-04-25T23:01:05.690 INFO:tasks.workunit.client.0.smithi043.stdout:4/287: mkdir d3/d21/d6b 0 2024-04-25T23:01:05.690 INFO:tasks.workunit.client.0.smithi043.stdout:6/182: rename d1/df to d1/df/d41 22 2024-04-25T23:01:05.690 INFO:tasks.workunit.client.0.smithi043.stdout:3/237: mkdir d7/d26/d27/d56 0 2024-04-25T23:01:05.690 INFO:tasks.workunit.client.0.smithi043.stdout:4/288: symlink d3/d37/d5b/l6c 0 2024-04-25T23:01:05.691 INFO:tasks.workunit.client.0.smithi043.stdout:1/184: read d0/f2e [2444047,105703] 0 2024-04-25T23:01:05.691 INFO:tasks.workunit.client.0.smithi043.stdout:4/289: readlink d3/d37/d4d/l53 0 2024-04-25T23:01:05.691 INFO:tasks.workunit.client.0.smithi043.stdout:5/250: dread d0/d8/d3a/f43 [0,4194304] 0 2024-04-25T23:01:05.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/183: write d1/df/f10 [1643182,107410] 0 2024-04-25T23:01:05.692 INFO:tasks.workunit.client.0.smithi043.stdout:1/185: rmdir d0/d3c 39 2024-04-25T23:01:05.693 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:05.690+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:05.693 INFO:tasks.workunit.client.0.smithi043.stdout:1/186: dread - d0/d9/f20 zero size 2024-04-25T23:01:05.694 INFO:tasks.workunit.client.0.smithi043.stdout:4/290: link d3/de/l40 d3/d21/d6b/l6d 0 2024-04-25T23:01:05.694 INFO:tasks.workunit.client.0.smithi043.stdout:1/187: dread - d0/f38 zero size 2024-04-25T23:01:05.694 INFO:tasks.workunit.client.0.smithi043.stdout:6/184: link d1/d5/f3f d1/d5/d14/f42 0 2024-04-25T23:01:05.695 INFO:tasks.workunit.client.0.smithi043.stdout:1/188: creat d0/d9/f44 x:0 0 0 2024-04-25T23:01:05.695 INFO:tasks.workunit.client.0.smithi043.stdout:4/291: symlink d3/de/d46/l6e 0 2024-04-25T23:01:05.695 INFO:tasks.workunit.client.0.smithi043.stdout:3/238: dread d7/d39/f4a [0,4194304] 0 2024-04-25T23:01:05.696 INFO:tasks.workunit.client.0.smithi043.stdout:6/185: mknod d1/d5/d3b/c43 0 2024-04-25T23:01:05.696 INFO:tasks.workunit.client.0.smithi043.stdout:1/189: mknod d0/d3d/c45 0 2024-04-25T23:01:05.696 INFO:tasks.workunit.client.0.smithi043.stdout:4/292: symlink d3/d19/d34/l6f 0 2024-04-25T23:01:05.697 INFO:tasks.workunit.client.0.smithi043.stdout:3/239: write d7/d32/f3e [543894,107275] 0 2024-04-25T23:01:05.698 INFO:tasks.workunit.client.0.smithi043.stdout:0/214: getdents d1b/d23/d39 0 2024-04-25T23:01:05.698 INFO:tasks.workunit.client.0.smithi043.stdout:7/188: getdents d3/d1e 0 2024-04-25T23:01:05.699 INFO:tasks.workunit.client.0.smithi043.stdout:1/190: creat d0/d9/f46 x:0 0 0 2024-04-25T23:01:05.699 INFO:tasks.workunit.client.0.smithi043.stdout:2/125: truncate d2/fc 2030947 0 2024-04-25T23:01:05.699 INFO:tasks.workunit.client.0.smithi043.stdout:4/293: rename d3/d37/c39 to d3/d19/d34/c70 0 2024-04-25T23:01:05.701 INFO:tasks.workunit.client.0.smithi043.stdout:1/191: dread - d0/d9/f44 zero size 2024-04-25T23:01:05.701 INFO:tasks.workunit.client.0.smithi043.stdout:7/189: write d3/f19 [9026509,21908] 0 2024-04-25T23:01:05.701 INFO:tasks.workunit.client.0.smithi043.stdout:2/126: fdatasync d2/fc 0 2024-04-25T23:01:05.702 INFO:tasks.workunit.client.0.smithi043.stdout:3/240: fsync d7/d26/d27/d34/d1a/d28/f3c 0 2024-04-25T23:01:05.702 INFO:tasks.workunit.client.0.smithi043.stdout:4/294: mknod d3/d37/c71 0 2024-04-25T23:01:05.702 INFO:tasks.workunit.client.0.smithi043.stdout:0/215: creat d1b/f45 x:0 0 0 2024-04-25T23:01:05.702 INFO:tasks.workunit.client.0.smithi043.stdout:3/241: read - d7/f25 zero size 2024-04-25T23:01:05.702 INFO:tasks.workunit.client.0.smithi043.stdout:5/251: dwrite d0/d2c/d39/d1c/d25/d32/f50 [0,4194304] 0 2024-04-25T23:01:05.702 INFO:tasks.workunit.client.0.smithi043.stdout:0/216: chown d1b/d31/d3c 7136 1 2024-04-25T23:01:05.703 INFO:tasks.workunit.client.0.smithi043.stdout:6/186: dread d1/df/d21/f24 [0,4194304] 0 2024-04-25T23:01:05.704 INFO:tasks.workunit.client.0.smithi043.stdout:3/242: mknod d7/d26/d2d/c57 0 2024-04-25T23:01:05.704 INFO:tasks.workunit.client.0.smithi043.stdout:4/295: mknod d3/d37/d5b/c72 0 2024-04-25T23:01:05.704 INFO:tasks.workunit.client.0.smithi043.stdout:1/192: rename d0/d9/l41 to d0/d3d/l47 0 2024-04-25T23:01:05.705 INFO:tasks.workunit.client.0.smithi043.stdout:5/252: read - d0/f35 zero size 2024-04-25T23:01:05.705 INFO:tasks.workunit.client.0.smithi043.stdout:8/123: dread d3/d4/fe [0,4194304] 0 2024-04-25T23:01:05.706 INFO:tasks.workunit.client.0.smithi043.stdout:3/243: truncate d7/d32/f38 436142 0 2024-04-25T23:01:05.706 INFO:tasks.workunit.client.0.smithi043.stdout:9/276: dread d8/de/d12/d16/d24/f28 [4194304,4194304] 0 2024-04-25T23:01:05.710 INFO:tasks.workunit.client.0.smithi043.stdout:4/296: rmdir d3/d21 39 2024-04-25T23:01:05.710 INFO:tasks.workunit.client.0.smithi043.stdout:2/127: rename d2/d9 to d2/d3/d22 0 2024-04-25T23:01:05.710 INFO:tasks.workunit.client.0.smithi043.stdout:0/217: link fb d1b/d23/d39/f46 0 2024-04-25T23:01:05.710 INFO:tasks.workunit.client.0.smithi043.stdout:3/244: creat d7/d39/d52/f58 x:0 0 0 2024-04-25T23:01:05.710 INFO:tasks.workunit.client.0.smithi043.stdout:0/218: chown f3 2643774 1 2024-04-25T23:01:05.710 INFO:tasks.workunit.client.0.smithi043.stdout:9/277: getdents d8/de/d12/d16/d26 0 2024-04-25T23:01:05.711 INFO:tasks.workunit.client.0.smithi043.stdout:9/278: mknod d8/c61 0 2024-04-25T23:01:05.712 INFO:tasks.workunit.client.0.smithi043.stdout:2/128: truncate d2/fc 629833 0 2024-04-25T23:01:05.712 INFO:tasks.workunit.client.0.smithi043.stdout:3/245: mkdir d7/d26/d59 0 2024-04-25T23:01:05.715 INFO:tasks.workunit.client.0.smithi043.stdout:6/187: dwrite d1/f1f [0,4194304] 0 2024-04-25T23:01:05.715 INFO:tasks.workunit.client.0.smithi043.stdout:7/190: dwrite d3/da/df/d11/f20 [0,4194304] 0 2024-04-25T23:01:05.716 INFO:tasks.workunit.client.0.smithi043.stdout:7/191: read d3/f21 [2616322,38889] 0 2024-04-25T23:01:05.717 INFO:tasks.workunit.client.0.smithi043.stdout:5/253: dread d0/d8/d3a/f43 [0,4194304] 0 2024-04-25T23:01:05.719 INFO:tasks.workunit.client.0.smithi043.stdout:7/192: chown d3/d1e/d1f/l25 712 1 2024-04-25T23:01:05.720 INFO:tasks.workunit.client.0.smithi043.stdout:4/297: dwrite d3/de/fd [0,4194304] 0 2024-04-25T23:01:05.720 INFO:tasks.workunit.client.0.smithi043.stdout:3/246: write d7/d26/d27/f48 [384854,20934] 0 2024-04-25T23:01:05.721 INFO:tasks.workunit.client.0.smithi043.stdout:5/254: write d0/d8/fe [3176676,46104] 0 2024-04-25T23:01:05.722 INFO:tasks.workunit.client.0.smithi043.stdout:9/279: dwrite d8/f5a [0,4194304] 0 2024-04-25T23:01:05.722 INFO:tasks.workunit.client.0.smithi043.stdout:0/219: dwrite d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:05.724 INFO:tasks.workunit.client.0.smithi043.stdout:7/193: symlink d3/da/df/d11/l40 0 2024-04-25T23:01:05.724 INFO:tasks.workunit.client.0.smithi043.stdout:4/298: truncate d3/de/d46/f4b 625936 0 2024-04-25T23:01:05.724 INFO:tasks.workunit.client.0.smithi043.stdout:2/129: rename d2/d3/d22/dd to d2/d3/d22/d23 0 2024-04-25T23:01:05.725 INFO:tasks.workunit.client.0.smithi043.stdout:7/194: write d3/da/df/f1a [1522148,116549] 0 2024-04-25T23:01:05.725 INFO:tasks.workunit.client.0.smithi043.stdout:3/247: getdents d7/d26/d27/d34 0 2024-04-25T23:01:05.725 INFO:tasks.workunit.client.0.smithi043.stdout:4/299: rename d3/f4 to d3/de/f73 0 2024-04-25T23:01:05.728 INFO:tasks.workunit.client.0.smithi043.stdout:4/300: rename d3/de to d3/de/d74 22 2024-04-25T23:01:05.728 INFO:tasks.workunit.client.0.smithi043.stdout:2/130: link d2/c7 d2/d3/d22/c24 0 2024-04-25T23:01:05.728 INFO:tasks.workunit.client.0.smithi043.stdout:3/248: mkdir d7/d32/d51/d5a 0 2024-04-25T23:01:05.729 INFO:tasks.workunit.client.0.smithi043.stdout:3/249: chown d7/f9 28188 1 2024-04-25T23:01:05.730 INFO:tasks.workunit.client.0.smithi043.stdout:6/188: truncate d1/df/f10 1198398 0 2024-04-25T23:01:05.731 INFO:tasks.workunit.client.0.smithi043.stdout:2/131: link d2/d3/d22/cb d2/d3/d13/d18/c25 0 2024-04-25T23:01:05.731 INFO:tasks.workunit.client.0.smithi043.stdout:3/250: symlink d7/d26/d27/d34/d1a/d28/l5b 0 2024-04-25T23:01:05.732 INFO:tasks.workunit.client.0.smithi043.stdout:5/255: dwrite d0/d2c/d39/d1c/d25/f27 [4194304,4194304] 0 2024-04-25T23:01:05.732 INFO:tasks.workunit.client.0.smithi043.stdout:6/189: write d1/d5/d14/d30/f3d [447814,9154] 0 2024-04-25T23:01:05.733 INFO:tasks.workunit.client.0.smithi043.stdout:3/251: dread - d7/d26/d27/d34/f45 zero size 2024-04-25T23:01:05.733 INFO:tasks.workunit.client.0.smithi043.stdout:6/190: chown d1/d5/f1d 567 1 2024-04-25T23:01:05.734 INFO:tasks.workunit.client.0.smithi043.stdout:2/132: creat d2/d3/d22/f26 x:0 0 0 2024-04-25T23:01:05.734 INFO:tasks.workunit.client.0.smithi043.stdout:5/256: mknod d0/d2c/d39/d37/c59 0 2024-04-25T23:01:05.735 INFO:tasks.workunit.client.0.smithi043.stdout:2/133: creat d2/d3/f27 x:0 0 0 2024-04-25T23:01:05.736 INFO:tasks.workunit.client.0.smithi043.stdout:5/257: write d0/d2c/d39/d37/f1e [4001496,23477] 0 2024-04-25T23:01:05.737 INFO:tasks.workunit.client.0.smithi043.stdout:5/258: readlink d0/d2c/d39/d37/d2d/l52 0 2024-04-25T23:01:05.737 INFO:tasks.workunit.client.0.smithi043.stdout:2/134: mkdir d2/d3/d28 0 2024-04-25T23:01:05.737 INFO:tasks.workunit.client.0.smithi043.stdout:1/193: sync 2024-04-25T23:01:05.737 INFO:tasks.workunit.client.0.smithi043.stdout:9/280: sync 2024-04-25T23:01:05.739 INFO:tasks.workunit.client.0.smithi043.stdout:2/135: write d2/d3/d22/d23/f1a [635326,25720] 0 2024-04-25T23:01:05.739 INFO:tasks.workunit.client.0.smithi043.stdout:7/195: dread d3/da/f36 [0,4194304] 0 2024-04-25T23:01:05.739 INFO:tasks.workunit.client.0.smithi043.stdout:1/194: truncate d0/f26 5106559 0 2024-04-25T23:01:05.739 INFO:tasks.workunit.client.0.smithi043.stdout:9/281: unlink d8/de/d44/d47/c4c 0 2024-04-25T23:01:05.739 INFO:tasks.workunit.client.0.smithi043.stdout:3/252: write d7/d32/f4f [448316,89466] 0 2024-04-25T23:01:05.740 INFO:tasks.workunit.client.0.smithi043.stdout:6/191: dwrite d1/df/f25 [4194304,4194304] 0 2024-04-25T23:01:05.741 INFO:tasks.workunit.client.0.smithi043.stdout:6/192: fdatasync d1/fe 0 2024-04-25T23:01:05.742 INFO:tasks.workunit.client.0.smithi043.stdout:9/282: unlink d8/de/d12/d15/f2c 0 2024-04-25T23:01:05.742 INFO:tasks.workunit.client.0.smithi043.stdout:1/195: rename d0/f11 to d0/d2f/f48 0 2024-04-25T23:01:05.743 INFO:tasks.workunit.client.0.smithi043.stdout:7/196: truncate d3/da/df/d11/f2f 3326282 0 2024-04-25T23:01:05.743 INFO:tasks.workunit.client.0.smithi043.stdout:3/253: creat d7/d32/f5c x:0 0 0 2024-04-25T23:01:05.743 INFO:tasks.workunit.client.0.smithi043.stdout:6/193: creat d1/d5/d3b/f44 x:0 0 0 2024-04-25T23:01:05.744 INFO:tasks.workunit.client.0.smithi043.stdout:5/259: dwrite d0/d2c/d39/d37/f1e [4194304,4194304] 0 2024-04-25T23:01:05.744 INFO:tasks.workunit.client.0.smithi043.stdout:9/283: creat d8/de/d12/d16/d24/f62 x:0 0 0 2024-04-25T23:01:05.745 INFO:tasks.workunit.client.0.smithi043.stdout:6/194: write d1/d5/f1b [2901519,65386] 0 2024-04-25T23:01:05.745 INFO:tasks.workunit.client.0.smithi043.stdout:7/197: mkdir d3/d1e/d41 0 2024-04-25T23:01:05.745 INFO:tasks.workunit.client.0.smithi043.stdout:6/195: rmdir d1/d2a 39 2024-04-25T23:01:05.746 INFO:tasks.workunit.client.0.smithi043.stdout:9/284: write d8/de/d12/d16/f36 [1136526,112205] 0 2024-04-25T23:01:05.746 INFO:tasks.workunit.client.0.smithi043.stdout:7/198: fsync d3/f21 0 2024-04-25T23:01:05.747 INFO:tasks.workunit.client.0.smithi043.stdout:3/254: dread d7/d26/d2d/f36 [0,4194304] 0 2024-04-25T23:01:05.747 INFO:tasks.workunit.client.0.smithi043.stdout:7/199: chown d3/f19 10 1 2024-04-25T23:01:05.747 INFO:tasks.workunit.client.0.smithi043.stdout:8/124: dread d3/d4/f8 [4194304,4194304] 0 2024-04-25T23:01:05.747 INFO:tasks.workunit.client.0.smithi043.stdout:7/200: chown d3/da/df/c37 56 1 2024-04-25T23:01:05.749 INFO:tasks.workunit.client.0.smithi043.stdout:8/125: mknod d3/d4/db/df/c28 0 2024-04-25T23:01:05.749 INFO:tasks.workunit.client.0.smithi043.stdout:9/285: creat d8/f63 x:0 0 0 2024-04-25T23:01:05.750 INFO:tasks.workunit.client.0.smithi043.stdout:3/255: link d7/d32/f5c d7/d39/d52/f5d 0 2024-04-25T23:01:05.750 INFO:tasks.workunit.client.0.smithi043.stdout:8/126: fdatasync d3/d4/db/df/d10/f15 0 2024-04-25T23:01:05.752 INFO:tasks.workunit.client.0.smithi043.stdout:9/286: symlink d8/de/d12/d16/d26/d31/d32/l64 0 2024-04-25T23:01:05.752 INFO:tasks.workunit.client.0.smithi043.stdout:8/127: mknod d3/d4/c29 0 2024-04-25T23:01:05.752 INFO:tasks.workunit.client.0.smithi043.stdout:3/256: fsync d7/d26/d27/d34/d1a/d28/f3c 0 2024-04-25T23:01:05.752 INFO:tasks.workunit.client.0.smithi043.stdout:9/287: read - d8/f63 zero size 2024-04-25T23:01:05.753 INFO:tasks.workunit.client.0.smithi043.stdout:7/201: dread d3/da/df/d11/f20 [0,4194304] 0 2024-04-25T23:01:05.753 INFO:tasks.workunit.client.0.smithi043.stdout:3/257: chown d7/fb 1613381 1 2024-04-25T23:01:05.753 INFO:tasks.workunit.client.0.smithi043.stdout:8/128: unlink d3/d4/fe 0 2024-04-25T23:01:05.754 INFO:tasks.workunit.client.0.smithi043.stdout:6/196: dwrite d1/d5/d3b/f3c [0,4194304] 0 2024-04-25T23:01:05.756 INFO:tasks.workunit.client.0.smithi043.stdout:7/202: mknod d3/da/df/d11/c42 0 2024-04-25T23:01:05.756 INFO:tasks.workunit.client.0.smithi043.stdout:8/129: creat d3/d17/f2a x:0 0 0 2024-04-25T23:01:05.756 INFO:tasks.workunit.client.0.smithi043.stdout:3/258: creat d7/d26/f5e x:0 0 0 2024-04-25T23:01:05.756 INFO:tasks.workunit.client.0.smithi043.stdout:6/197: creat d1/df/d21/d38/f45 x:0 0 0 2024-04-25T23:01:05.757 INFO:tasks.workunit.client.0.smithi043.stdout:7/203: fdatasync d3/f5 0 2024-04-25T23:01:05.758 INFO:tasks.workunit.client.0.smithi043.stdout:8/130: creat d3/d13/f2b x:0 0 0 2024-04-25T23:01:05.758 INFO:tasks.workunit.client.0.smithi043.stdout:6/198: mkdir d1/df/d21/d46 0 2024-04-25T23:01:05.758 INFO:tasks.workunit.client.0.smithi043.stdout:8/131: stat d3/d13/f2b 0 2024-04-25T23:01:05.758 INFO:tasks.workunit.client.0.smithi043.stdout:3/259: creat d7/d26/d27/d34/d1a/f5f x:0 0 0 2024-04-25T23:01:05.758 INFO:tasks.workunit.client.0.smithi043.stdout:7/204: chown d3/l1c 1759 1 2024-04-25T23:01:05.758 INFO:tasks.workunit.client.0.smithi043.stdout:8/132: chown d3/d17 31197386 1 2024-04-25T23:01:05.759 INFO:tasks.workunit.client.0.smithi043.stdout:8/133: readlink d3/d17/l22 0 2024-04-25T23:01:05.759 INFO:tasks.workunit.client.0.smithi043.stdout:3/260: creat d7/d39/d52/f60 x:0 0 0 2024-04-25T23:01:05.759 INFO:tasks.workunit.client.0.smithi043.stdout:8/134: dread - d3/d17/f1f zero size 2024-04-25T23:01:05.759 INFO:tasks.workunit.client.0.smithi043.stdout:8/135: truncate d3/d17/f18 702358 0 2024-04-25T23:01:05.760 INFO:tasks.workunit.client.0.smithi043.stdout:8/136: creat d3/d4/db/d14/f2c x:0 0 0 2024-04-25T23:01:05.761 INFO:tasks.workunit.client.0.smithi043.stdout:8/137: write d3/d17/f2a [788720,72279] 0 2024-04-25T23:01:05.762 INFO:tasks.workunit.client.0.smithi043.stdout:8/138: creat d3/d4/db/f2d x:0 0 0 2024-04-25T23:01:05.763 INFO:tasks.workunit.client.0.smithi043.stdout:8/139: write d3/d17/f1a [1243351,40769] 0 2024-04-25T23:01:05.763 INFO:tasks.workunit.client.0.smithi043.stdout:6/199: dwrite d1/df/f28 [0,4194304] 0 2024-04-25T23:01:05.766 INFO:tasks.workunit.client.0.smithi043.stdout:2/136: getdents d2/d3 0 2024-04-25T23:01:05.766 INFO:tasks.workunit.client.0.smithi043.stdout:3/261: dread d7/fb [0,4194304] 0 2024-04-25T23:01:05.767 INFO:tasks.workunit.client.0.smithi043.stdout:5/260: truncate d0/d8/fe 3075611 0 2024-04-25T23:01:05.768 INFO:tasks.workunit.client.0.smithi043.stdout:3/262: rmdir d7/d26/d27/d34/d1a 39 2024-04-25T23:01:05.768 INFO:tasks.workunit.client.0.smithi043.stdout:5/261: creat d0/d2c/d39/d37/d2d/f5a x:0 0 0 2024-04-25T23:01:05.769 INFO:tasks.workunit.client.0.smithi043.stdout:5/262: chown d0/ca 401917042 1 2024-04-25T23:01:05.770 INFO:tasks.workunit.client.0.smithi043.stdout:9/288: rename d8/de/d12/d16/d26/d31/d32 to d8/de/d44/d65 0 2024-04-25T23:01:05.771 INFO:tasks.workunit.client.0.smithi043.stdout:3/263: truncate d7/d26/d27/d34/d1a/d28/f3c 2277580 0 2024-04-25T23:01:05.772 INFO:tasks.workunit.client.0.smithi043.stdout:6/200: write d1/d5/f3f [821760,69956] 0 2024-04-25T23:01:05.773 INFO:tasks.workunit.client.0.smithi043.stdout:2/137: rename d2/d3/l17 to d2/d3/d13/l29 0 2024-04-25T23:01:05.773 INFO:tasks.workunit.client.0.smithi043.stdout:5/263: write d0/d2c/d39/d1c/f2b [819700,77297] 0 2024-04-25T23:01:05.773 INFO:tasks.workunit.client.0.smithi043.stdout:9/289: chown d8/de/d12/d15/f53 3877554 1 2024-04-25T23:01:05.773 INFO:tasks.workunit.client.0.smithi043.stdout:6/201: symlink d1/df/d21/d38/l47 0 2024-04-25T23:01:05.774 INFO:tasks.workunit.client.0.smithi043.stdout:5/264: write d0/f5 [7907867,5040] 0 2024-04-25T23:01:05.774 INFO:tasks.workunit.client.0.smithi043.stdout:9/290: dread - d8/de/d44/d65/f3c zero size 2024-04-25T23:01:05.775 INFO:tasks.workunit.client.0.smithi043.stdout:6/202: unlink d1/d5/l6 0 2024-04-25T23:01:05.775 INFO:tasks.workunit.client.0.smithi043.stdout:5/265: chown d0/d2c/d39/d37/d2d/c36 7 1 2024-04-25T23:01:05.775 INFO:tasks.workunit.client.0.smithi043.stdout:8/140: dread d3/d4/db/df/d10/f15 [0,4194304] 0 2024-04-25T23:01:05.775 INFO:tasks.workunit.client.0.smithi043.stdout:9/291: rename d8/f52 to d8/de/d12/d16/d26/f66 0 2024-04-25T23:01:05.775 INFO:tasks.workunit.client.0.smithi043.stdout:8/141: mkdir d3/d13/d2e 0 2024-04-25T23:01:05.776 INFO:tasks.workunit.client.0.smithi043.stdout:9/292: readlink d8/de/d12/d16/l2b 0 2024-04-25T23:01:05.776 INFO:tasks.workunit.client.0.smithi043.stdout:6/203: rename d1/f31 to d1/df/d21/f48 0 2024-04-25T23:01:05.776 INFO:tasks.workunit.client.0.smithi043.stdout:8/142: dread - d3/d1d/f27 zero size 2024-04-25T23:01:05.777 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:05.777 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:05.777 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:05.777 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:05.777 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:05.777 INFO:tasks.workunit.client.0.smithi043.stdout:5/266: creat d0/d2c/d39/f5b x:0 0 0 2024-04-25T23:01:05.778 INFO:tasks.workunit.client.0.smithi043.stdout:6/204: stat d1/d5/f2c 0 2024-04-25T23:01:05.778 INFO:tasks.workunit.client.0.smithi043.stdout:6/205: stat d1/df/d21/f48 0 2024-04-25T23:01:05.778 INFO:tasks.workunit.client.0.smithi043.stdout:5/267: creat d0/d8/d3a/f5c x:0 0 0 2024-04-25T23:01:05.779 INFO:tasks.workunit.client.0.smithi043.stdout:9/293: rename d8/de/d12/d15/d2f/l38 to d8/de/d12/d15/l67 0 2024-04-25T23:01:05.780 INFO:tasks.workunit.client.0.smithi043.stdout:6/206: mknod d1/c49 0 2024-04-25T23:01:05.781 INFO:tasks.workunit.client.0.smithi043.stdout:4/301: dread d3/d19/f48 [0,4194304] 0 2024-04-25T23:01:05.781 INFO:tasks.workunit.client.0.smithi043.stdout:9/294: mkdir d8/de/d12/d15/d68 0 2024-04-25T23:01:05.781 INFO:tasks.workunit.client.0.smithi043.stdout:6/207: unlink d1/df/d1a/f32 0 2024-04-25T23:01:05.783 INFO:tasks.workunit.client.0.smithi043.stdout:9/295: read d8/de/d12/d16/d26/f4d [2536111,47027] 0 2024-04-25T23:01:05.783 INFO:tasks.workunit.client.0.smithi043.stdout:6/208: creat d1/df/d21/d46/f4a x:0 0 0 2024-04-25T23:01:05.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/220: dread f8 [0,4194304] 0 2024-04-25T23:01:05.784 INFO:tasks.workunit.client.0.smithi043.stdout:8/143: dwrite d3/d17/f18 [0,4194304] 0 2024-04-25T23:01:05.784 INFO:tasks.workunit.client.0.smithi043.stdout:6/209: chown d1/df/l3e 45955 1 2024-04-25T23:01:05.786 INFO:tasks.workunit.client.0.smithi043.stdout:9/296: mkdir d8/de/d12/d16/d26/d69 0 2024-04-25T23:01:05.787 INFO:tasks.workunit.client.0.smithi043.stdout:0/221: chown d1b/d23/d39/f46 92 1 2024-04-25T23:01:05.787 INFO:tasks.workunit.client.0.smithi043.stdout:7/205: dread d3/f19 [0,4194304] 0 2024-04-25T23:01:05.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/144: unlink d3/d17/f18 0 2024-04-25T23:01:05.787 INFO:tasks.workunit.client.0.smithi043.stdout:6/210: symlink d1/df/d1a/l4b 0 2024-04-25T23:01:05.787 INFO:tasks.workunit.client.0.smithi043.stdout:6/211: readlink d1/df/l3e 0 2024-04-25T23:01:05.788 INFO:tasks.workunit.client.0.smithi043.stdout:6/212: readlink d1/df/d21/d38/l47 0 2024-04-25T23:01:05.789 INFO:tasks.workunit.client.0.smithi043.stdout:9/297: mkdir d8/de/d44/d47/d6a 0 2024-04-25T23:01:05.790 INFO:tasks.workunit.client.0.smithi043.stdout:3/264: read d7/d26/d27/d34/d1a/f50 [1199564,89469] 0 2024-04-25T23:01:05.790 INFO:tasks.workunit.client.0.smithi043.stdout:1/196: dread d0/fa [0,4194304] 0 2024-04-25T23:01:05.791 INFO:tasks.workunit.client.0.smithi043.stdout:8/145: write d3/d4/f8 [8850516,59795] 0 2024-04-25T23:01:05.791 INFO:tasks.workunit.client.0.smithi043.stdout:8/146: sync 2024-04-25T23:01:05.792 INFO:tasks.workunit.client.0.smithi043.stdout:9/298: write d8/de/d44/f60 [34501,69153] 0 2024-04-25T23:01:05.792 INFO:tasks.workunit.client.0.smithi043.stdout:4/302: truncate d3/f28 3752192 0 2024-04-25T23:01:05.792 INFO:tasks.workunit.client.0.smithi043.stdout:7/206: creat d3/da/df/d11/d26/f43 x:0 0 0 2024-04-25T23:01:05.792 INFO:tasks.workunit.client.0.smithi043.stdout:2/138: rmdir d2/d3/d22/d23 39 2024-04-25T23:01:05.793 INFO:tasks.workunit.client.0.smithi043.stdout:3/265: mknod d7/d39/c61 0 2024-04-25T23:01:05.794 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:05.790+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:05.794 INFO:tasks.workunit.client.0.smithi043.stdout:7/207: readlink d3/da/df/l3d 0 2024-04-25T23:01:05.795 INFO:tasks.workunit.client.0.smithi043.stdout:6/213: write d1/df/d1a/f2e [768000,89691] 0 2024-04-25T23:01:05.795 INFO:tasks.workunit.client.0.smithi043.stdout:1/197: creat d0/f49 x:0 0 0 2024-04-25T23:01:05.795 INFO:tasks.workunit.client.0.smithi043.stdout:3/266: fsync d7/d32/f38 0 2024-04-25T23:01:05.795 INFO:tasks.workunit.client.0.smithi043.stdout:5/268: dread d0/d2c/d39/d37/f29 [0,4194304] 0 2024-04-25T23:01:05.796 INFO:tasks.workunit.client.0.smithi043.stdout:4/303: creat d3/d21/d6b/f75 x:0 0 0 2024-04-25T23:01:05.796 INFO:tasks.workunit.client.0.smithi043.stdout:2/139: write d2/d3/d22/d23/f11 [256062,39243] 0 2024-04-25T23:01:05.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/222: dwrite d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:05.797 INFO:tasks.workunit.client.0.smithi043.stdout:4/304: readlink d3/de/l36 0 2024-04-25T23:01:05.797 INFO:tasks.workunit.client.0.smithi043.stdout:1/198: stat d0/f5 0 2024-04-25T23:01:05.799 INFO:tasks.workunit.client.0.smithi043.stdout:1/199: truncate d0/d9/f46 372597 0 2024-04-25T23:01:05.799 INFO:tasks.workunit.client.0.smithi043.stdout:6/214: rename d1/df to d1/d5/d3b/d4c 0 2024-04-25T23:01:05.800 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:05.801 INFO:tasks.workunit.client.0.smithi043.stdout:8/147: dwrite d3/d4/db/df/d10/f15 [0,4194304] 0 2024-04-25T23:01:05.802 INFO:tasks.workunit.client.0.smithi043.stdout:1/200: fdatasync d0/f2 0 2024-04-25T23:01:05.802 INFO:tasks.workunit.client.0.smithi043.stdout:4/305: unlink d3/de/d27/l4e 0 2024-04-25T23:01:05.803 INFO:tasks.workunit.client.0.smithi043.stdout:6/215: mknod d1/d2a/c4d 0 2024-04-25T23:01:05.804 INFO:tasks.workunit.client.0.smithi043.stdout:7/208: dwrite d3/da/df/f1a [0,4194304] 0 2024-04-25T23:01:05.804 INFO:tasks.workunit.client.0.smithi043.stdout:4/306: mkdir d3/d19/d34/d76 0 2024-04-25T23:01:05.805 INFO:tasks.workunit.client.0.smithi043.stdout:5/269: dread d0/d2c/d39/d1c/f2b [0,4194304] 0 2024-04-25T23:01:05.805 INFO:tasks.workunit.client.0.smithi043.stdout:1/201: fdatasync d0/fa 0 2024-04-25T23:01:05.805 INFO:tasks.workunit.client.0.smithi043.stdout:9/299: truncate d8/de/d12/d16/d26/d31/f3f 3320467 0 2024-04-25T23:01:05.806 INFO:tasks.workunit.client.0.smithi043.stdout:8/148: mknod d3/d4/db/df/d10/c2f 0 2024-04-25T23:01:05.806 INFO:tasks.workunit.client.0.smithi043.stdout:8/149: sync 2024-04-25T23:01:05.806 INFO:tasks.workunit.client.0.smithi043.stdout:9/300: readlink d8/de/d12/d16/l3a 0 2024-04-25T23:01:05.806 INFO:tasks.workunit.client.0.smithi043.stdout:8/150: sync 2024-04-25T23:01:05.806 INFO:tasks.workunit.client.0.smithi043.stdout:5/270: dread - d0/d2c/d39/d1c/d25/f56 zero size 2024-04-25T23:01:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:8/151: stat d3/d17 0 2024-04-25T23:01:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:6/216: creat d1/d2a/f4e x:0 0 0 2024-04-25T23:01:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:4/307: rmdir d3/d19/d34 39 2024-04-25T23:01:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:1/202: rename d0/f49 to d0/d16/f4a 0 2024-04-25T23:01:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:5/271: rmdir d0/d2c/d39/d37 39 2024-04-25T23:01:05.808 INFO:tasks.workunit.client.0.smithi043.stdout:8/152: mknod d3/d4/db/df/d10/c30 0 2024-04-25T23:01:05.809 INFO:tasks.workunit.client.0.smithi043.stdout:4/308: mknod d3/de/d27/c77 0 2024-04-25T23:01:05.809 INFO:tasks.workunit.client.0.smithi043.stdout:1/203: write d0/d3d/f30 [194561,128998] 0 2024-04-25T23:01:05.809 INFO:tasks.workunit.client.0.smithi043.stdout:5/272: mknod d0/d2c/c5d 0 2024-04-25T23:01:05.810 INFO:tasks.workunit.client.0.smithi043.stdout:8/153: rmdir d3/d4/db/df 39 2024-04-25T23:01:05.810 INFO:tasks.workunit.client.0.smithi043.stdout:1/204: truncate d0/d9/f25 408203 0 2024-04-25T23:01:05.810 INFO:tasks.workunit.client.0.smithi043.stdout:7/209: dread d3/f21 [0,4194304] 0 2024-04-25T23:01:05.811 INFO:tasks.workunit.client.0.smithi043.stdout:7/210: sync 2024-04-25T23:01:05.811 INFO:tasks.workunit.client.0.smithi043.stdout:5/273: write d0/d8/f53 [365309,130636] 0 2024-04-25T23:01:05.812 INFO:tasks.workunit.client.0.smithi043.stdout:9/301: dread d8/fd [0,4194304] 0 2024-04-25T23:01:05.812 INFO:tasks.workunit.client.0.smithi043.stdout:8/154: mknod d3/d1d/c31 0 2024-04-25T23:01:05.812 INFO:tasks.workunit.client.0.smithi043.stdout:2/140: dread d2/d3/d13/f1e [0,4194304] 0 2024-04-25T23:01:05.813 INFO:tasks.workunit.client.0.smithi043.stdout:7/211: dread - d3/da/df/d11/d26/f43 zero size 2024-04-25T23:01:05.813 INFO:tasks.workunit.client.0.smithi043.stdout:8/155: write d3/d4/db/f2d [718383,76427] 0 2024-04-25T23:01:05.813 INFO:tasks.workunit.client.0.smithi043.stdout:2/141: symlink d2/l2a 0 2024-04-25T23:01:05.813 INFO:tasks.workunit.client.0.smithi043.stdout:9/302: write d8/de/f3e [1870222,37294] 0 2024-04-25T23:01:05.814 INFO:tasks.workunit.client.0.smithi043.stdout:7/212: creat d3/da/f44 x:0 0 0 2024-04-25T23:01:05.815 INFO:tasks.workunit.client.0.smithi043.stdout:2/142: rename d2/d3/d13/l29 to d2/d3/d13/d18/l2b 0 2024-04-25T23:01:05.815 INFO:tasks.workunit.client.0.smithi043.stdout:7/213: chown d3/da/f23 1 1 2024-04-25T23:01:05.817 INFO:tasks.workunit.client.0.smithi043.stdout:9/303: rename d8/de/d44/d5d/l5f to d8/de/d12/d15/d68/l6b 0 2024-04-25T23:01:05.817 INFO:tasks.workunit.client.0.smithi043.stdout:2/143: creat d2/d3/f2c x:0 0 0 2024-04-25T23:01:05.818 INFO:tasks.workunit.client.0.smithi043.stdout:7/214: mknod d3/d1e/d41/c45 0 2024-04-25T23:01:05.820 INFO:tasks.workunit.client.0.smithi043.stdout:9/304: chown d8/de/d12/c49 150214 1 2024-04-25T23:01:05.820 INFO:tasks.workunit.client.0.smithi043.stdout:2/144: truncate d2/d3/f2c 248065 0 2024-04-25T23:01:05.821 INFO:tasks.workunit.client.0.smithi043.stdout:8/156: dread d3/d4/db/df/d10/f15 [0,4194304] 0 2024-04-25T23:01:05.821 INFO:tasks.workunit.client.0.smithi043.stdout:6/217: dread d1/d5/d3b/d4c/f15 [0,4194304] 0 2024-04-25T23:01:05.822 INFO:tasks.workunit.client.0.smithi043.stdout:9/305: dread d8/de/d12/d15/d2f/f50 [0,4194304] 0 2024-04-25T23:01:05.822 INFO:tasks.workunit.client.0.smithi043.stdout:8/157: rename d3/d13 to d3/d32 0 2024-04-25T23:01:05.824 INFO:tasks.workunit.client.0.smithi043.stdout:3/267: dread d7/d26/d27/d34/d1a/d40/f47 [0,4194304] 0 2024-04-25T23:01:05.824 INFO:tasks.workunit.client.0.smithi043.stdout:6/218: creat d1/d5/d3b/d4c/d21/f4f x:0 0 0 2024-04-25T23:01:05.824 INFO:tasks.workunit.client.0.smithi043.stdout:9/306: mkdir d8/de/d12/d15/d6c 0 2024-04-25T23:01:05.825 INFO:tasks.workunit.client.0.smithi043.stdout:5/274: dwrite d0/fd [0,4194304] 0 2024-04-25T23:01:05.825 INFO:tasks.workunit.client.0.smithi043.stdout:7/215: dread d3/f21 [0,4194304] 0 2024-04-25T23:01:05.826 INFO:tasks.workunit.client.0.smithi043.stdout:6/219: dread - d1/d5/d3b/d4c/d21/f4f zero size 2024-04-25T23:01:05.827 INFO:tasks.workunit.client.0.smithi043.stdout:2/145: rename d2/d3/d22/cb to d2/d3/d13/d18/c2d 0 2024-04-25T23:01:05.828 INFO:tasks.workunit.client.0.smithi043.stdout:9/307: creat d8/de/d12/d15/d2f/f6d x:0 0 0 2024-04-25T23:01:05.828 INFO:tasks.workunit.client.0.smithi043.stdout:7/216: fsync d3/d1e/d1f/f24 0 2024-04-25T23:01:05.829 INFO:tasks.workunit.client.0.smithi043.stdout:3/268: link d7/c31 d7/d26/d27/d34/d1a/c62 0 2024-04-25T23:01:05.829 INFO:tasks.workunit.client.0.smithi043.stdout:5/275: readlink d0/d2c/d39/d37/l1f 0 2024-04-25T23:01:05.829 INFO:tasks.workunit.client.0.smithi043.stdout:0/223: dread d1b/d31/f33 [0,4194304] 0 2024-04-25T23:01:05.831 INFO:tasks.workunit.client.0.smithi043.stdout:3/269: chown d7/d39/l4b 494 1 2024-04-25T23:01:05.832 INFO:tasks.workunit.client.0.smithi043.stdout:9/308: write d8/de/d12/d15/d2f/f6d [485773,60613] 0 2024-04-25T23:01:05.832 INFO:tasks.workunit.client.0.smithi043.stdout:3/270: readlink d7/d26/d27/d34/d1a/l1c 0 2024-04-25T23:01:05.833 INFO:tasks.workunit.client.0.smithi043.stdout:7/217: mknod d3/d1e/d41/c46 0 2024-04-25T23:01:05.835 INFO:tasks.workunit.client.0.smithi043.stdout:6/220: dread d1/d5/d3b/d4c/d21/f48 [0,4194304] 0 2024-04-25T23:01:05.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/218: dread - d3/da/df/f3f zero size 2024-04-25T23:01:05.836 INFO:tasks.workunit.client.0.smithi043.stdout:8/158: dwrite d3/d4/f8 [0,4194304] 0 2024-04-25T23:01:05.838 INFO:tasks.workunit.client.0.smithi043.stdout:3/271: creat d7/d26/d27/d34/d1a/d28/f63 x:0 0 0 2024-04-25T23:01:05.839 INFO:tasks.workunit.client.0.smithi043.stdout:1/205: dread d0/d16/f1b [0,4194304] 0 2024-04-25T23:01:05.840 INFO:tasks.workunit.client.0.smithi043.stdout:2/146: dwrite d2/d3/f27 [0,4194304] 0 2024-04-25T23:01:05.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/219: creat d3/d1e/f47 x:0 0 0 2024-04-25T23:01:05.842 INFO:tasks.workunit.client.0.smithi043.stdout:5/276: dwrite d0/d2c/d39/d37/f44 [0,4194304] 0 2024-04-25T23:01:05.843 INFO:tasks.workunit.client.0.smithi043.stdout:0/224: dwrite d1b/f40 [0,4194304] 0 2024-04-25T23:01:05.843 INFO:tasks.workunit.client.0.smithi043.stdout:9/309: dwrite d8/de/d44/f60 [0,4194304] 0 2024-04-25T23:01:05.844 INFO:tasks.workunit.client.0.smithi043.stdout:4/309: dread d3/de/f13 [0,4194304] 0 2024-04-25T23:01:05.845 INFO:tasks.workunit.client.0.smithi043.stdout:6/221: creat d1/d5/d14/f50 x:0 0 0 2024-04-25T23:01:05.845 INFO:tasks.workunit.client.0.smithi043.stdout:3/272: creat d7/d26/d27/d34/d1a/d40/f64 x:0 0 0 2024-04-25T23:01:05.846 INFO:tasks.workunit.client.0.smithi043.stdout:2/147: rmdir d2/d3/d22/d23 39 2024-04-25T23:01:05.846 INFO:tasks.workunit.client.0.smithi043.stdout:5/277: rename d0/d2c/d39/d37/d51 to d0/d2c/d39/d1c/d5e 0 2024-04-25T23:01:05.846 INFO:tasks.workunit.client.0.smithi043.stdout:0/225: mknod d1b/d31/c47 0 2024-04-25T23:01:05.846 INFO:tasks.workunit.client.0.smithi043.stdout:7/220: creat d3/da/df/f48 x:0 0 0 2024-04-25T23:01:05.846 INFO:tasks.workunit.client.0.smithi043.stdout:0/226: fsync d1b/f1f 0 2024-04-25T23:01:05.846 INFO:tasks.workunit.client.0.smithi043.stdout:3/273: creat d7/f65 x:0 0 0 2024-04-25T23:01:05.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/278: readlink d0/d2c/d39/d1c/l20 0 2024-04-25T23:01:05.847 INFO:tasks.workunit.client.0.smithi043.stdout:2/148: write d2/d3/d22/d23/f11 [3157489,94610] 0 2024-04-25T23:01:05.847 INFO:tasks.workunit.client.0.smithi043.stdout:0/227: write d1b/f45 [577458,129359] 0 2024-04-25T23:01:05.848 INFO:tasks.workunit.client.0.smithi043.stdout:7/221: write d3/f19 [7865554,121767] 0 2024-04-25T23:01:05.848 INFO:tasks.workunit.client.0.smithi043.stdout:5/279: chown d0/d2c/d39/d1c/d25 9325 1 2024-04-25T23:01:05.849 INFO:tasks.workunit.client.0.smithi043.stdout:6/222: rename d1/d5/d14/f50 to d1/d5/d3b/d4c/d21/d46/f51 0 2024-04-25T23:01:05.849 INFO:tasks.workunit.client.0.smithi043.stdout:2/149: fdatasync d2/d3/d13/f1e 0 2024-04-25T23:01:05.849 INFO:tasks.workunit.client.0.smithi043.stdout:7/222: creat d3/da/df/d11/d26/f49 x:0 0 0 2024-04-25T23:01:05.850 INFO:tasks.workunit.client.0.smithi043.stdout:2/150: chown d2/d3/f2c 11 1 2024-04-25T23:01:05.850 INFO:tasks.workunit.client.0.smithi043.stdout:3/274: creat d7/d26/d27/f66 x:0 0 0 2024-04-25T23:01:05.850 INFO:tasks.workunit.client.0.smithi043.stdout:5/280: rename d0/d8 to d0/d2c/d39/d37/d2d/d5f 0 2024-04-25T23:01:05.851 INFO:tasks.workunit.client.0.smithi043.stdout:6/223: rename d1/fa to d1/d5/d14/d30/f52 0 2024-04-25T23:01:05.851 INFO:tasks.workunit.client.0.smithi043.stdout:7/223: creat d3/d1e/d41/f4a x:0 0 0 2024-04-25T23:01:05.851 INFO:tasks.workunit.client.0.smithi043.stdout:3/275: creat d7/d26/d2d/f67 x:0 0 0 2024-04-25T23:01:05.852 INFO:tasks.workunit.client.0.smithi043.stdout:2/151: rename d2/d3/c16 to d2/d3/c2e 0 2024-04-25T23:01:05.852 INFO:tasks.workunit.client.0.smithi043.stdout:7/224: read - d3/da/df/f48 zero size 2024-04-25T23:01:05.853 INFO:tasks.workunit.client.0.smithi043.stdout:0/228: dread d1b/d31/f33 [0,4194304] 0 2024-04-25T23:01:05.854 INFO:tasks.workunit.client.0.smithi043.stdout:1/206: dread d0/d3d/f30 [0,4194304] 0 2024-04-25T23:01:05.855 INFO:tasks.workunit.client.0.smithi043.stdout:0/229: link d1b/f37 d1b/d31/d3c/f48 0 2024-04-25T23:01:05.855 INFO:tasks.workunit.client.0.smithi043.stdout:7/225: rename d3/d1e/c3e to d3/da/df/d11/c4b 0 2024-04-25T23:01:05.856 INFO:tasks.workunit.client.0.smithi043.stdout:4/310: dwrite d3/de/d27/d45/f50 [0,4194304] 0 2024-04-25T23:01:05.857 INFO:tasks.workunit.client.0.smithi043.stdout:0/230: unlink d1b/d23/c35 0 2024-04-25T23:01:05.858 INFO:tasks.workunit.client.0.smithi043.stdout:4/311: creat d3/de/d46/d6a/f78 x:0 0 0 2024-04-25T23:01:05.859 INFO:tasks.workunit.client.0.smithi043.stdout:6/224: dwrite d1/d5/d3b/d4c/d21/f2b [0,4194304] 0 2024-04-25T23:01:05.859 INFO:tasks.workunit.client.0.smithi043.stdout:4/312: stat d3/d19/d34/f5f 0 2024-04-25T23:01:05.860 INFO:tasks.workunit.client.0.smithi043.stdout:3/276: dwrite d7/d26/f41 [0,4194304] 0 2024-04-25T23:01:05.862 INFO:tasks.workunit.client.0.smithi043.stdout:6/225: creat d1/f53 x:0 0 0 2024-04-25T23:01:05.863 INFO:tasks.workunit.client.0.smithi043.stdout:4/313: getdents d3/d37/d4d 0 2024-04-25T23:01:05.863 INFO:tasks.workunit.client.0.smithi043.stdout:6/226: readlink d1/d5/d3b/d4c/d21/l2f 0 2024-04-25T23:01:05.863 INFO:tasks.workunit.client.0.smithi043.stdout:6/227: chown d1/d5/c19 220366 1 2024-04-25T23:01:05.863 INFO:tasks.workunit.client.0.smithi043.stdout:4/314: chown d3/d21/f3d 8233 1 2024-04-25T23:01:05.863 INFO:tasks.workunit.client.0.smithi043.stdout:3/277: creat d7/d26/d27/d34/f68 x:0 0 0 2024-04-25T23:01:05.864 INFO:tasks.workunit.client.0.smithi043.stdout:6/228: creat d1/d5/d3b/d4c/d1a/f54 x:0 0 0 2024-04-25T23:01:05.864 INFO:tasks.workunit.client.0.smithi043.stdout:4/315: chown d3/d21/l3f 1437 1 2024-04-25T23:01:05.865 INFO:tasks.workunit.client.0.smithi043.stdout:6/229: mkdir d1/d5/d3b/d4c/d21/d55 0 2024-04-25T23:01:05.865 INFO:tasks.workunit.client.0.smithi043.stdout:4/316: creat d3/d21/f79 x:0 0 0 2024-04-25T23:01:05.871 INFO:tasks.workunit.client.0.smithi043.stdout:6/230: dwrite d1/d5/d3b/d4c/f15 [0,4194304] 0 2024-04-25T23:01:05.872 INFO:tasks.workunit.client.0.smithi043.stdout:6/231: chown d1/d5/f1b 227063 1 2024-04-25T23:01:05.872 INFO:tasks.workunit.client.0.smithi043.stdout:6/232: fsync d1/d5/f3f 0 2024-04-25T23:01:05.873 INFO:tasks.workunit.client.0.smithi043.stdout:6/233: chown d1/c3a 515425835 1 2024-04-25T23:01:05.874 INFO:tasks.workunit.client.0.smithi043.stdout:6/234: chown d1/d5/f1b 186 1 2024-04-25T23:01:05.874 INFO:tasks.workunit.client.0.smithi043.stdout:0/231: write fb [827323,73282] 0 2024-04-25T23:01:05.874 INFO:tasks.workunit.client.0.smithi043.stdout:7/226: write d3/da/df/d11/f15 [4523000,7981] 0 2024-04-25T23:01:05.875 INFO:tasks.workunit.client.0.smithi043.stdout:2/152: read d2/d3/d22/d23/f11 [986293,37740] 0 2024-04-25T23:01:05.877 INFO:tasks.workunit.client.0.smithi043.stdout:6/235: chown d1/d5/d3b/d4c/d1a/f2e 17 1 2024-04-25T23:01:05.877 INFO:tasks.workunit.client.0.smithi043.stdout:0/232: truncate fa 472427 0 2024-04-25T23:01:05.877 INFO:tasks.workunit.client.0.smithi043.stdout:0/233: fdatasync d1b/f45 0 2024-04-25T23:01:05.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/236: fsync d1/d5/d14/f42 0 2024-04-25T23:01:05.878 INFO:tasks.workunit.client.0.smithi043.stdout:0/234: stat d1b/d42 0 2024-04-25T23:01:05.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/317: read d3/f28 [2113308,4103] 0 2024-04-25T23:01:05.880 INFO:tasks.workunit.client.0.smithi043.stdout:5/281: dread d0/d2c/d39/d37/d2d/d5f/d3a/f43 [0,4194304] 0 2024-04-25T23:01:05.880 INFO:tasks.workunit.client.0.smithi043.stdout:6/237: creat d1/d5/f56 x:0 0 0 2024-04-25T23:01:05.880 INFO:tasks.workunit.client.0.smithi043.stdout:0/235: creat d1b/d31/f49 x:0 0 0 2024-04-25T23:01:05.880 INFO:tasks.workunit.client.0.smithi043.stdout:3/278: dwrite d7/d26/d27/d34/d1a/f50 [0,4194304] 0 2024-04-25T23:01:05.881 INFO:tasks.workunit.client.0.smithi043.stdout:6/238: write d1/f20 [769431,35739] 0 2024-04-25T23:01:05.881 INFO:tasks.workunit.client.0.smithi043.stdout:7/227: dread d3/da/f23 [0,4194304] 0 2024-04-25T23:01:05.884 INFO:tasks.workunit.client.0.smithi043.stdout:0/236: unlink d1b/c1e 0 2024-04-25T23:01:05.884 INFO:tasks.workunit.client.0.smithi043.stdout:7/228: rmdir d3 39 2024-04-25T23:01:05.884 INFO:tasks.workunit.client.0.smithi043.stdout:4/318: mkdir d3/d37/d7a 0 2024-04-25T23:01:05.884 INFO:tasks.workunit.client.0.smithi043.stdout:5/282: mkdir d0/d2c/d39/d37/d41/d4a/d60 0 2024-04-25T23:01:05.884 INFO:tasks.workunit.client.0.smithi043.stdout:6/239: mkdir d1/d5/d3b/d4c/d21/d55/d57 0 2024-04-25T23:01:05.885 INFO:tasks.workunit.client.0.smithi043.stdout:0/237: chown d1b/l1c 202 1 2024-04-25T23:01:05.885 INFO:tasks.workunit.client.0.smithi043.stdout:6/240: rmdir d1 39 2024-04-25T23:01:05.885 INFO:tasks.workunit.client.0.smithi043.stdout:7/229: creat d3/d1e/f4c x:0 0 0 2024-04-25T23:01:05.886 INFO:tasks.workunit.client.0.smithi043.stdout:5/283: creat d0/d2c/d39/d1c/f61 x:0 0 0 2024-04-25T23:01:05.886 INFO:tasks.workunit.client.0.smithi043.stdout:0/238: write f11 [785744,20042] 0 2024-04-25T23:01:05.886 INFO:tasks.workunit.client.0.smithi043.stdout:6/241: chown d1/d5/d3b/d4c/d21/d38/l47 763 1 2024-04-25T23:01:05.886 INFO:tasks.workunit.client.0.smithi043.stdout:7/230: fdatasync d3/da/df/d11/f2f 0 2024-04-25T23:01:05.887 INFO:tasks.workunit.client.0.smithi043.stdout:5/284: write d0/d2c/d39/f5b [702075,50068] 0 2024-04-25T23:01:05.887 INFO:tasks.workunit.client.0.smithi043.stdout:0/239: link d1b/d23/d39/f46 d1b/f4a 0 2024-04-25T23:01:05.887 INFO:tasks.workunit.client.0.smithi043.stdout:7/231: readlink d3/da/l10 0 2024-04-25T23:01:05.887 INFO:tasks.workunit.client.0.smithi043.stdout:3/279: dwrite d7/f18 [0,4194304] 0 2024-04-25T23:01:05.888 INFO:tasks.workunit.client.0.smithi043.stdout:3/280: chown d7/d39/d52/f5d 22 1 2024-04-25T23:01:05.888 INFO:tasks.workunit.client.0.smithi043.stdout:7/232: write d3/da/df/d11/f15 [807984,32286] 0 2024-04-25T23:01:05.889 INFO:tasks.workunit.client.0.smithi043.stdout:3/281: write d7/d32/f4f [4037936,102213] 0 2024-04-25T23:01:05.889 INFO:tasks.workunit.client.0.smithi043.stdout:0/240: creat d1b/d23/d39/f4b x:0 0 0 2024-04-25T23:01:05.890 INFO:tasks.workunit.client.0.smithi043.stdout:7/233: creat d3/d1e/f4d x:0 0 0 2024-04-25T23:01:05.890 INFO:tasks.workunit.client.0.smithi043.stdout:5/285: write d0/d2c/d39/d1c/f2b [3194537,2167] 0 2024-04-25T23:01:05.890 INFO:tasks.workunit.client.0.smithi043.stdout:0/241: readlink d1b/l29 0 2024-04-25T23:01:05.890 INFO:tasks.workunit.client.0.smithi043.stdout:7/234: write d3/d1e/f39 [555314,25299] 0 2024-04-25T23:01:05.891 INFO:tasks.workunit.client.0.smithi043.stdout:3/282: truncate d7/d26/d27/d34/f45 635700 0 2024-04-25T23:01:05.891 INFO:tasks.workunit.client.0.smithi043.stdout:0/242: mknod d1b/d42/c4c 0 2024-04-25T23:01:05.892 INFO:tasks.workunit.client.0.smithi043.stdout:0/243: rename d1b/f24 to d1b/d42/f4d 0 2024-04-25T23:01:05.892 INFO:tasks.workunit.client.0.smithi043.stdout:0/244: readlink d1b/l20 0 2024-04-25T23:01:05.894 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:05.888+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:05.894 INFO:tasks.workunit.client.0.smithi043.stdout:2/153: dread d2/d3/f2c [0,4194304] 0 2024-04-25T23:01:05.896 INFO:tasks.workunit.client.0.smithi043.stdout:2/154: write d2/d3/d13/f1e [1782178,106952] 0 2024-04-25T23:01:05.898 INFO:tasks.workunit.client.0.smithi043.stdout:9/310: fdatasync d8/de/d44/f60 0 2024-04-25T23:01:05.898 INFO:tasks.workunit.client.0.smithi043.stdout:2/155: chown d2/d3/c10 1652335 1 2024-04-25T23:01:05.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/283: dwrite d7/d26/f41 [0,4194304] 0 2024-04-25T23:01:05.899 INFO:tasks.workunit.client.0.smithi043.stdout:7/235: dwrite d3/d1e/d41/f4a [0,4194304] 0 2024-04-25T23:01:05.900 INFO:tasks.workunit.client.0.smithi043.stdout:0/245: dwrite d1b/d23/d39/f46 [0,4194304] 0 2024-04-25T23:01:05.901 INFO:tasks.workunit.client.0.smithi043.stdout:3/284: rename d7/d26/d27/f54 to d7/d26/d59/f69 0 2024-04-25T23:01:05.901 INFO:tasks.workunit.client.0.smithi043.stdout:3/285: stat d7/d26/d27/d34/d1a/d28 0 2024-04-25T23:01:05.903 INFO:tasks.workunit.client.0.smithi043.stdout:6/242: truncate d1/d5/f1b 2159441 0 2024-04-25T23:01:05.903 INFO:tasks.workunit.client.0.smithi043.stdout:7/236: rename d3/d1e/d1f/c27 to d3/da/c4e 0 2024-04-25T23:01:05.904 INFO:tasks.workunit.client.0.smithi043.stdout:2/156: link d2/d3/d22/d23/f11 d2/d3/f2f 0 2024-04-25T23:01:05.906 INFO:tasks.workunit.client.0.smithi043.stdout:3/286: symlink d7/d26/d27/d34/l6a 0 2024-04-25T23:01:05.906 INFO:tasks.workunit.client.0.smithi043.stdout:6/243: truncate d1/d5/d3b/d4c/d1a/f54 505647 0 2024-04-25T23:01:05.907 INFO:tasks.workunit.client.0.smithi043.stdout:0/246: rename d1b/d31/f3a to d1b/d23/f4e 0 2024-04-25T23:01:05.907 INFO:tasks.workunit.client.0.smithi043.stdout:7/237: symlink d3/d1e/l4f 0 2024-04-25T23:01:05.907 INFO:tasks.workunit.client.0.smithi043.stdout:2/157: mknod d2/d3/d22/d23/c30 0 2024-04-25T23:01:05.907 INFO:tasks.workunit.client.0.smithi043.stdout:0/247: stat d1b/d23/f3d 0 2024-04-25T23:01:05.907 INFO:tasks.workunit.client.0.smithi043.stdout:3/287: truncate d7/fb 876557 0 2024-04-25T23:01:05.908 INFO:tasks.workunit.client.0.smithi043.stdout:9/311: dwrite d8/de/d44/f60 [0,4194304] 0 2024-04-25T23:01:05.908 INFO:tasks.workunit.client.0.smithi043.stdout:0/248: chown d1b/c22 702506509 1 2024-04-25T23:01:05.909 INFO:tasks.workunit.client.0.smithi043.stdout:5/286: dwrite d0/d2c/d39/d37/d41/d47/f54 [0,4194304] 0 2024-04-25T23:01:05.909 INFO:tasks.workunit.client.0.smithi043.stdout:7/238: link d3/d1e/d41/f4a d3/d1e/f50 0 2024-04-25T23:01:05.909 INFO:tasks.workunit.client.0.smithi043.stdout:0/249: write f12 [5123863,4899] 0 2024-04-25T23:01:05.910 INFO:tasks.workunit.client.0.smithi043.stdout:0/250: chown d1b/d31/d3c/f48 46989 1 2024-04-25T23:01:05.914 INFO:tasks.workunit.client.0.smithi043.stdout:6/244: truncate d1/f29 2644894 0 2024-04-25T23:01:05.914 INFO:tasks.workunit.client.0.smithi043.stdout:2/158: rename d2/d3/d22/d23/c30 to d2/d3/d13/d18/c31 0 2024-04-25T23:01:05.914 INFO:tasks.workunit.client.0.smithi043.stdout:7/239: rmdir d3 39 2024-04-25T23:01:05.914 INFO:tasks.workunit.client.0.smithi043.stdout:8/159: dread d3/d17/f1a [0,4194304] 0 2024-04-25T23:01:05.914 INFO:tasks.workunit.client.0.smithi043.stdout:0/251: creat d1b/d23/d39/f4f x:0 0 0 2024-04-25T23:01:05.914 INFO:tasks.workunit.client.0.smithi043.stdout:5/287: write d0/f40 [568132,24093] 0 2024-04-25T23:01:05.915 INFO:tasks.workunit.client.0.smithi043.stdout:8/160: readlink d3/d4/db/d14/l16 0 2024-04-25T23:01:05.915 INFO:tasks.workunit.client.0.smithi043.stdout:2/159: write d2/d3/d22/d23/f1a [280048,123308] 0 2024-04-25T23:01:05.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/252: mkdir d1b/d31/d3c/d50 0 2024-04-25T23:01:05.917 INFO:tasks.workunit.client.0.smithi043.stdout:1/207: dread d0/d9/f21 [0,4194304] 0 2024-04-25T23:01:05.917 INFO:tasks.workunit.client.0.smithi043.stdout:8/161: rename d3/d17 to d3/d4/db/df/d10/d33 0 2024-04-25T23:01:05.918 INFO:tasks.workunit.client.0.smithi043.stdout:8/162: rmdir d3 39 2024-04-25T23:01:05.918 INFO:tasks.workunit.client.0.smithi043.stdout:9/312: getdents d8/de/d12/d16 0 2024-04-25T23:01:05.919 INFO:tasks.workunit.client.0.smithi043.stdout:1/208: readlink d0/l36 0 2024-04-25T23:01:05.920 INFO:tasks.workunit.client.0.smithi043.stdout:6/245: fsync d1/f29 0 2024-04-25T23:01:05.921 INFO:tasks.workunit.client.0.smithi043.stdout:9/313: getdents d8 0 2024-04-25T23:01:05.921 INFO:tasks.workunit.client.0.smithi043.stdout:5/288: dread d0/d2c/d39/d37/d41/d47/f54 [0,4194304] 0 2024-04-25T23:01:05.921 INFO:tasks.workunit.client.0.smithi043.stdout:8/163: creat d3/d4/db/df/d10/d33/f34 x:0 0 0 2024-04-25T23:01:05.922 INFO:tasks.workunit.client.0.smithi043.stdout:5/289: dread - d0/d2c/d39/d37/d2d/f5a zero size 2024-04-25T23:01:05.924 INFO:tasks.workunit.client.0.smithi043.stdout:7/240: dwrite d3/da/df/d11/f15 [0,4194304] 0 2024-04-25T23:01:05.924 INFO:tasks.workunit.client.0.smithi043.stdout:5/290: mkdir d0/d2c/d39/d1c/d25/d32/d62 0 2024-04-25T23:01:05.925 INFO:tasks.workunit.client.0.smithi043.stdout:2/160: dwrite d2/d3/f2f [0,4194304] 0 2024-04-25T23:01:05.927 INFO:tasks.workunit.client.0.smithi043.stdout:5/291: rmdir d0/d2c/d39/d37 39 2024-04-25T23:01:05.928 INFO:tasks.workunit.client.0.smithi043.stdout:7/241: unlink d3/da/df/d11/c12 0 2024-04-25T23:01:05.929 INFO:tasks.workunit.client.0.smithi043.stdout:1/209: truncate d0/d9/f21 3498770 0 2024-04-25T23:01:05.929 INFO:tasks.workunit.client.0.smithi043.stdout:1/210: fdatasync d0/f26 0 2024-04-25T23:01:05.929 INFO:tasks.workunit.client.0.smithi043.stdout:5/292: chown d0/d2c/d39/f5b 277 1 2024-04-25T23:01:05.932 INFO:tasks.workunit.client.0.smithi043.stdout:6/246: dwrite d1/f53 [0,4194304] 0 2024-04-25T23:01:05.932 INFO:tasks.workunit.client.0.smithi043.stdout:5/293: chown d0/d2c/d39/d37/d2d/d5f/d3a/f3e 2413 1 2024-04-25T23:01:05.933 INFO:tasks.workunit.client.0.smithi043.stdout:9/314: write d8/de/d12/d15/d2f/f50 [1371192,79052] 0 2024-04-25T23:01:05.933 INFO:tasks.workunit.client.0.smithi043.stdout:6/247: fsync d1/d5/d3b/f3c 0 2024-04-25T23:01:05.934 INFO:tasks.workunit.client.0.smithi043.stdout:6/248: chown d1 182791587 1 2024-04-25T23:01:05.934 INFO:tasks.workunit.client.0.smithi043.stdout:5/294: chown d0/d2c/d39/d37/d41/d47 64905 1 2024-04-25T23:01:05.936 INFO:tasks.workunit.client.0.smithi043.stdout:6/249: readlink d1/d5/d3b/d4c/d21/l2f 0 2024-04-25T23:01:05.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/295: mkdir d0/d2c/d39/d63 0 2024-04-25T23:01:05.939 INFO:tasks.workunit.client.0.smithi043.stdout:1/211: dwrite d0/d16/f1b [0,4194304] 0 2024-04-25T23:01:05.939 INFO:tasks.workunit.client.0.smithi043.stdout:7/242: dwrite d3/da/f44 [0,4194304] 0 2024-04-25T23:01:05.940 INFO:tasks.workunit.client.0.smithi043.stdout:2/161: dwrite d2/d3/f2c [0,4194304] 0 2024-04-25T23:01:05.940 INFO:tasks.workunit.client.0.smithi043.stdout:1/212: rmdir d0/d16 39 2024-04-25T23:01:05.941 INFO:tasks.workunit.client.0.smithi043.stdout:7/243: fdatasync d3/d1e/f47 0 2024-04-25T23:01:05.943 INFO:tasks.workunit.client.0.smithi043.stdout:3/288: dread d7/d26/d27/d34/d1a/f1d [0,4194304] 0 2024-04-25T23:01:05.943 INFO:tasks.workunit.client.0.smithi043.stdout:1/213: getdents d0 0 2024-04-25T23:01:05.944 INFO:tasks.workunit.client.0.smithi043.stdout:9/315: dwrite d8/de/d12/d15/d2f/f2d [4194304,4194304] 0 2024-04-25T23:01:05.945 INFO:tasks.workunit.client.0.smithi043.stdout:1/214: mkdir d0/d2f/d4b 0 2024-04-25T23:01:05.945 INFO:tasks.workunit.client.0.smithi043.stdout:3/289: mknod d7/d26/d27/d34/d1a/c6b 0 2024-04-25T23:01:05.945 INFO:tasks.workunit.client.0.smithi043.stdout:1/215: fsync d0/d9/f24 0 2024-04-25T23:01:05.946 INFO:tasks.workunit.client.0.smithi043.stdout:3/290: stat d7/d26/d27/d34/d1a/d40/f47 0 2024-04-25T23:01:05.946 INFO:tasks.workunit.client.0.smithi043.stdout:9/316: mknod d8/de/d12/d15/d6c/c6e 0 2024-04-25T23:01:05.947 INFO:tasks.workunit.client.0.smithi043.stdout:3/291: stat d7/d26/d27/d34 0 2024-04-25T23:01:05.947 INFO:tasks.workunit.client.0.smithi043.stdout:1/216: truncate d0/d9/f46 459460 0 2024-04-25T23:01:05.947 INFO:tasks.workunit.client.0.smithi043.stdout:7/244: dread d3/d1e/d41/f4a [0,4194304] 0 2024-04-25T23:01:05.947 INFO:tasks.workunit.client.0.smithi043.stdout:9/317: mknod d8/c6f 0 2024-04-25T23:01:05.948 INFO:tasks.workunit.client.0.smithi043.stdout:1/217: symlink d0/d16/l4c 0 2024-04-25T23:01:05.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/292: getdents d7/d32/d51/d5a 0 2024-04-25T23:01:05.948 INFO:tasks.workunit.client.0.smithi043.stdout:1/218: write d0/d9/f44 [950295,9455] 0 2024-04-25T23:01:05.949 INFO:tasks.workunit.client.0.smithi043.stdout:3/293: write d7/f25 [981587,73064] 0 2024-04-25T23:01:05.950 INFO:tasks.workunit.client.0.smithi043.stdout:3/294: stat d7/d26/d27/d34/d1a/d28/f63 0 2024-04-25T23:01:05.950 INFO:tasks.workunit.client.0.smithi043.stdout:3/295: dread - d7/d26/d2d/f53 zero size 2024-04-25T23:01:05.951 INFO:tasks.workunit.client.0.smithi043.stdout:3/296: stat d7/d26/d27/d34/c3a 0 2024-04-25T23:01:05.952 INFO:tasks.workunit.client.0.smithi043.stdout:3/297: creat d7/d26/d27/d56/f6c x:0 0 0 2024-04-25T23:01:05.953 INFO:tasks.workunit.client.0.smithi043.stdout:3/298: symlink d7/d39/l6d 0 2024-04-25T23:01:05.953 INFO:tasks.workunit.client.0.smithi043.stdout:3/299: mknod d7/d26/d27/d34/d1a/c6e 0 2024-04-25T23:01:05.954 INFO:tasks.workunit.client.0.smithi043.stdout:0/253: sync 2024-04-25T23:01:05.954 INFO:tasks.workunit.client.0.smithi043.stdout:8/164: sync 2024-04-25T23:01:05.955 INFO:tasks.workunit.client.0.smithi043.stdout:0/254: fsync d1b/d23/f3e 0 2024-04-25T23:01:05.955 INFO:tasks.workunit.client.0.smithi043.stdout:5/296: dread d0/d2c/d39/d37/d2d/d5f/f53 [0,4194304] 0 2024-04-25T23:01:05.955 INFO:tasks.workunit.client.0.smithi043.stdout:8/165: write d3/d4/db/df/d10/d33/f1f [936144,8027] 0 2024-04-25T23:01:05.955 INFO:tasks.workunit.client.0.smithi043.stdout:0/255: symlink d1b/d31/d3c/d50/l51 0 2024-04-25T23:01:05.956 INFO:tasks.workunit.client.0.smithi043.stdout:8/166: dread - d3/d1d/f27 zero size 2024-04-25T23:01:05.956 INFO:tasks.workunit.client.0.smithi043.stdout:5/297: creat d0/d2c/d39/d1c/d25/d32/d62/f64 x:0 0 0 2024-04-25T23:01:05.957 INFO:tasks.workunit.client.0.smithi043.stdout:8/167: creat d3/f35 x:0 0 0 2024-04-25T23:01:05.958 INFO:tasks.workunit.client.0.smithi043.stdout:5/298: rename d0/d2c/d39/d37/f29 to d0/d2c/d39/d37/d2d/d5f/d3a/f65 0 2024-04-25T23:01:05.959 INFO:tasks.workunit.client.0.smithi043.stdout:3/300: dwrite d7/d32/f3e [0,4194304] 0 2024-04-25T23:01:05.961 INFO:tasks.workunit.client.0.smithi043.stdout:3/301: symlink d7/d32/d51/l6f 0 2024-04-25T23:01:05.962 INFO:tasks.workunit.client.0.smithi043.stdout:5/299: rename d0/d2c/d39/d37/d2d/d5f/l2a to d0/d22/l66 0 2024-04-25T23:01:05.963 INFO:tasks.workunit.client.0.smithi043.stdout:3/302: write d7/d26/d27/d34/f45 [1377012,89333] 0 2024-04-25T23:01:05.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/303: dread - d7/d39/d52/f58 zero size 2024-04-25T23:01:05.964 INFO:tasks.workunit.client.0.smithi043.stdout:5/300: unlink d0/c1b 0 2024-04-25T23:01:05.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/304: readlink d7/d26/d27/d34/d1a/d28/l5b 0 2024-04-25T23:01:05.966 INFO:tasks.workunit.client.0.smithi043.stdout:1/219: getdents d0/d2f 0 2024-04-25T23:01:05.966 INFO:tasks.workunit.client.0.smithi043.stdout:7/245: write d3/f21 [582586,47505] 0 2024-04-25T23:01:05.966 INFO:tasks.workunit.client.0.smithi043.stdout:5/301: fdatasync d0/d2c/d39/d37/d2d/d5f/d3a/f43 0 2024-04-25T23:01:05.966 INFO:tasks.workunit.client.0.smithi043.stdout:0/256: getdents d1b/d31/d3c/d50 0 2024-04-25T23:01:05.967 INFO:tasks.workunit.client.0.smithi043.stdout:4/319: dread d3/f41 [4194304,4194304] 0 2024-04-25T23:01:05.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/305: write d7/d26/d27/d34/d1a/d40/f47 [5222770,82737] 0 2024-04-25T23:01:05.967 INFO:tasks.workunit.client.0.smithi043.stdout:0/257: fdatasync d1b/d31/f33 0 2024-04-25T23:01:05.967 INFO:tasks.workunit.client.0.smithi043.stdout:1/220: symlink d0/d2f/d4b/l4d 0 2024-04-25T23:01:05.967 INFO:tasks.workunit.client.0.smithi043.stdout:7/246: chown d3/da/df/d11/f20 144 1 2024-04-25T23:01:05.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/306: fdatasync d7/d39/d52/f5d 0 2024-04-25T23:01:05.968 INFO:tasks.workunit.client.0.smithi043.stdout:5/302: mknod d0/d2c/d39/d1c/d25/d32/c67 0 2024-04-25T23:01:05.968 INFO:tasks.workunit.client.0.smithi043.stdout:7/247: fdatasync d3/f5 0 2024-04-25T23:01:05.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/307: symlink d7/d26/d2d/l70 0 2024-04-25T23:01:05.969 INFO:tasks.workunit.client.0.smithi043.stdout:7/248: creat d3/d1e/d1f/f51 x:0 0 0 2024-04-25T23:01:05.969 INFO:tasks.workunit.client.0.smithi043.stdout:5/303: dread - d0/d2c/d39/d37/d2d/d5f/d3a/f5c zero size 2024-04-25T23:01:05.969 INFO:tasks.workunit.client.0.smithi043.stdout:8/168: read d3/d4/db/df/d10/d33/f1f [553349,50821] 0 2024-04-25T23:01:05.971 INFO:tasks.workunit.client.0.smithi043.stdout:8/169: mkdir d3/d4/d36 0 2024-04-25T23:01:05.972 INFO:tasks.workunit.client.0.smithi043.stdout:1/221: dread d0/fa [0,4194304] 0 2024-04-25T23:01:05.972 INFO:tasks.workunit.client.0.smithi043.stdout:8/170: creat d3/d1d/f37 x:0 0 0 2024-04-25T23:01:05.974 INFO:tasks.workunit.client.0.smithi043.stdout:5/304: getdents d0/d2c/d39/d37/d41 0 2024-04-25T23:01:05.974 INFO:tasks.workunit.client.0.smithi043.stdout:6/250: sync 2024-04-25T23:01:05.974 INFO:tasks.workunit.client.0.smithi043.stdout:9/318: sync 2024-04-25T23:01:05.975 INFO:tasks.workunit.client.0.smithi043.stdout:0/258: dwrite d1b/f1f [0,4194304] 0 2024-04-25T23:01:05.976 INFO:tasks.workunit.client.0.smithi043.stdout:1/222: getdents d0/d2f 0 2024-04-25T23:01:05.976 INFO:tasks.workunit.client.0.smithi043.stdout:5/305: readlink d0/d2c/d39/d37/l1f 0 2024-04-25T23:01:05.977 INFO:tasks.workunit.client.0.smithi043.stdout:6/251: chown d1/d5/d3b/d4c/d21/f24 3810 1 2024-04-25T23:01:05.978 INFO:tasks.workunit.client.0.smithi043.stdout:3/308: dwrite d7/d26/d27/d34/f17 [0,4194304] 0 2024-04-25T23:01:05.980 INFO:tasks.workunit.client.0.smithi043.stdout:9/319: creat d8/de/d12/d15/d6c/f70 x:0 0 0 2024-04-25T23:01:05.980 INFO:tasks.workunit.client.0.smithi043.stdout:5/306: mknod d0/d2c/d39/d37/d2d/d5f/c68 0 2024-04-25T23:01:05.980 INFO:tasks.workunit.client.0.smithi043.stdout:6/252: creat d1/d5/d3b/d4c/f58 x:0 0 0 2024-04-25T23:01:05.980 INFO:tasks.workunit.client.0.smithi043.stdout:7/249: dwrite d3/d1e/f50 [0,4194304] 0 2024-04-25T23:01:05.981 INFO:tasks.workunit.client.0.smithi043.stdout:3/309: creat d7/d26/d59/f71 x:0 0 0 2024-04-25T23:01:05.981 INFO:tasks.workunit.client.0.smithi043.stdout:1/223: rename d0/d3d/l3b to d0/d3c/l4e 0 2024-04-25T23:01:05.981 INFO:tasks.workunit.client.0.smithi043.stdout:7/250: fdatasync d3/f21 0 2024-04-25T23:01:05.981 INFO:tasks.workunit.client.0.smithi043.stdout:3/310: readlink d7/d26/d27/d34/l3b 0 2024-04-25T23:01:05.982 INFO:tasks.workunit.client.0.smithi043.stdout:7/251: truncate d3/d1e/f4d 30044 0 2024-04-25T23:01:05.982 INFO:tasks.workunit.client.0.smithi043.stdout:0/259: write d1b/d31/d3c/f48 [996620,877] 0 2024-04-25T23:01:05.983 INFO:tasks.workunit.client.0.smithi043.stdout:9/320: symlink d8/de/d12/d15/d2f/l71 0 2024-04-25T23:01:05.986 INFO:tasks.workunit.client.0.smithi043.stdout:1/224: unlink d0/d9/f24 0 2024-04-25T23:01:05.986 INFO:tasks.workunit.client.0.smithi043.stdout:5/307: creat d0/d2c/d39/d37/d41/d4a/f69 x:0 0 0 2024-04-25T23:01:05.986 INFO:tasks.workunit.client.0.smithi043.stdout:8/171: dwrite d3/d4/db/df/d10/d33/f1a [0,4194304] 0 2024-04-25T23:01:05.986 INFO:tasks.workunit.client.0.smithi043.stdout:6/253: write d1/d5/f22 [1986520,114727] 0 2024-04-25T23:01:05.986 INFO:tasks.workunit.client.0.smithi043.stdout:1/225: chown d0/d2f 17175 1 2024-04-25T23:01:05.987 INFO:tasks.workunit.client.0.smithi043.stdout:7/252: unlink d3/da/df/d11/c1b 0 2024-04-25T23:01:05.987 INFO:tasks.workunit.client.0.smithi043.stdout:4/320: dread d3/f28 [0,4194304] 0 2024-04-25T23:01:05.987 INFO:tasks.workunit.client.0.smithi043.stdout:8/172: mkdir d3/d32/d38 0 2024-04-25T23:01:05.987 INFO:tasks.workunit.client.0.smithi043.stdout:0/260: creat d1b/d31/d3c/f52 x:0 0 0 2024-04-25T23:01:05.987 INFO:tasks.workunit.client.0.smithi043.stdout:9/321: mknod d8/de/d12/d16/d26/d31/c72 0 2024-04-25T23:01:05.987 INFO:tasks.workunit.client.0.smithi043.stdout:8/173: fdatasync d3/d4/f8 0 2024-04-25T23:01:05.989 INFO:tasks.workunit.client.0.smithi043.stdout:0/261: creat d1b/d23/f53 x:0 0 0 2024-04-25T23:01:05.989 INFO:tasks.workunit.client.0.smithi043.stdout:9/322: creat d8/de/d44/d5d/d4f/f73 x:0 0 0 2024-04-25T23:01:05.990 INFO:tasks.workunit.client.0.smithi043.stdout:6/254: chown d1/d5/d3b/d4c/d1a/f2e 4 1 2024-04-25T23:01:05.990 INFO:tasks.workunit.client.0.smithi043.stdout:0/262: creat d1b/d42/f54 x:0 0 0 2024-04-25T23:01:05.990 INFO:tasks.workunit.client.0.smithi043.stdout:9/323: symlink d8/de/d44/d5d/d4f/l74 0 2024-04-25T23:01:05.992 INFO:tasks.workunit.client.0.smithi043.stdout:4/321: write d3/d37/f54 [2742470,61858] 0 2024-04-25T23:01:05.995 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:05.992+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:05.997 INFO:tasks.workunit.client.0.smithi043.stdout:3/311: dwrite d7/d26/d27/d34/f35 [0,4194304] 0 2024-04-25T23:01:05.998 INFO:tasks.workunit.client.0.smithi043.stdout:6/255: creat d1/d5/d3b/d4c/d21/d38/f59 x:0 0 0 2024-04-25T23:01:05.998 INFO:tasks.workunit.client.0.smithi043.stdout:1/226: read d0/f2e [769543,109723] 0 2024-04-25T23:01:06.001 INFO:tasks.workunit.client.0.smithi043.stdout:5/308: dwrite d0/d2c/d39/d1c/d25/d32/d62/f64 [0,4194304] 0 2024-04-25T23:01:06.001 INFO:tasks.workunit.client.0.smithi043.stdout:8/174: dwrite d3/d4/db/f2d [0,4194304] 0 2024-04-25T23:01:06.001 INFO:tasks.workunit.client.0.smithi043.stdout:7/253: dwrite d3/d1e/f4d [0,4194304] 0 2024-04-25T23:01:06.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/263: dread d1b/f1f [0,4194304] 0 2024-04-25T23:01:06.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/254: chown d3/da/l30 851 1 2024-04-25T23:01:06.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/264: fsync d1b/d23/d39/f46 0 2024-04-25T23:01:06.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/227: read d0/d3d/f30 [48515,63455] 0 2024-04-25T23:01:06.003 INFO:tasks.workunit.client.0.smithi043.stdout:6/256: creat d1/d5/d3b/d4c/d1a/f5a x:0 0 0 2024-04-25T23:01:06.003 INFO:tasks.workunit.client.0.smithi043.stdout:8/175: write d3/d1d/f27 [946689,97602] 0 2024-04-25T23:01:06.003 INFO:tasks.workunit.client.0.smithi043.stdout:2/162: dread d2/d3/d22/fe [0,4194304] 0 2024-04-25T23:01:06.004 INFO:tasks.workunit.client.0.smithi043.stdout:1/228: chown d0/d16 0 1 2024-04-25T23:01:06.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/309: unlink d0/d2c/d39/d37/d2d/d5f/c68 0 2024-04-25T23:01:06.004 INFO:tasks.workunit.client.0.smithi043.stdout:7/255: rmdir d3/d1e/d41 39 2024-04-25T23:01:06.005 INFO:tasks.workunit.client.0.smithi043.stdout:9/324: link d8/fd d8/de/d12/d16/f75 0 2024-04-25T23:01:06.005 INFO:tasks.workunit.client.0.smithi043.stdout:2/163: readlink d2/d3/d13/d18/l2b 0 2024-04-25T23:01:06.005 INFO:tasks.workunit.client.0.smithi043.stdout:6/257: chown d1/d5/d3b/d4c/d1a/l4b 9 1 2024-04-25T23:01:06.006 INFO:tasks.workunit.client.0.smithi043.stdout:0/265: mkdir d1b/d55 0 2024-04-25T23:01:06.006 INFO:tasks.workunit.client.0.smithi043.stdout:1/229: mkdir d0/d3d/d4f 0 2024-04-25T23:01:06.006 INFO:tasks.workunit.client.0.smithi043.stdout:4/322: dwrite d3/f57 [0,4194304] 0 2024-04-25T23:01:06.007 INFO:tasks.workunit.client.0.smithi043.stdout:5/310: mkdir d0/d6a 0 2024-04-25T23:01:06.007 INFO:tasks.workunit.client.0.smithi043.stdout:2/164: rename d2/d3/d22/d23/f1a to d2/d3/d13/f32 0 2024-04-25T23:01:06.007 INFO:tasks.workunit.client.0.smithi043.stdout:3/312: dread d7/d32/f4f [0,4194304] 0 2024-04-25T23:01:06.007 INFO:tasks.workunit.client.0.smithi043.stdout:1/230: fsync d0/f38 0 2024-04-25T23:01:06.008 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:06.008 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:06.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:06.008 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.154180504999999, 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:06.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.154106166, 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.154072792999999, 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:06.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:06.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.15399489, 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:06.024 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:06.029 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.153943604, 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.031 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.034 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.153913571, 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:06.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:06.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:06.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.039 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.153873998, 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:06.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:06.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:06.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.044 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.153844305, 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:06.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:06.049 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.153772418999999, 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.153738039, 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.055 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.060 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.153708282, 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.065 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.146441597999999, 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:06.066 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.070 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 1159841~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.136556016, 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052040279000000002, 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:06.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869084+0000", 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869085+0000", 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869096+0000", 2024-04-25T23:01:06.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.116e-05 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869105+0000", 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5829999999999996e-06 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869115+0000", 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8300000000000008e-06 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915654+0000", 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046539035999999999 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915763+0000", 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000108386 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.915936+0000", 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00017375499999999999 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919499+0000", 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003562352 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.920932+0000", 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001433272 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921061+0000", 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000128782 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921124+0000", 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3423000000000006e-05 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.136514253, 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.076 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:06.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.133194273000001, 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:06.081 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.133046211, 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.086 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.091 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.132503379999999, 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.096 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 1176983~12745 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.128149233, 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.052162238, 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:06.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877491+0000", 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877501+0000", 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.8470000000000008e-06 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877538+0000", 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7246000000000002e-05 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877568+0000", 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9799999999999999e-05 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.877605+0000", 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7506000000000003e-05 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923423+0000", 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045818151000000001 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923549+0000", 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012604700000000001 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.923732+0000", 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018251300000000001 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926357+0000", 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026246160000000002 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929490+0000", 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031331610000000002 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929575+0000", 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5575999999999995e-05 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.929653+0000", 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7775000000000007e-05 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 14.126511730000001, 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.102 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:06.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:06.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:06.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:06.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 1.3184070700000001, 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:06.107 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:06.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:06.111 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:06.115 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:06.110+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:06.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:4/323: dread - d3/d37/d4d/f52 zero size 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:1/231: dread - d0/f38 zero size 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:5/311: write d0/d2c/d39/d1c/d25/d4e/f58 [512567,11586] 0 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:9/325: creat d8/de/d44/d47/d6a/f76 x:0 0 0 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:6/258: creat d1/d5/d3b/d4c/d1a/f5b x:0 0 0 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:6/259: chown d1/d5/d3b/f44 3917 1 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:4/324: mknod d3/de/c7b 0 2024-04-25T23:01:06.134 INFO:tasks.workunit.client.0.smithi043.stdout:7/256: write d3/da/df/d11/f2f [1378785,58533] 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:1/232: getdents d0/d3d 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:0/266: rename fa to d1b/f56 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:4/325: write d3/d19/f22 [4032920,58653] 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:7/257: unlink d3/da/c4e 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:6/260: rename d1/d5/l33 to d1/d5/d3b/d4c/l5c 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:0/267: rename d1b/f1f to d1b/f57 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:4/326: chown d3/de/d27/d45/c60 11080 1 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:3/313: dwrite d7/d26/d27/d34/f68 [0,4194304] 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:6/261: mknod d1/d5/c5d 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:7/258: write d3/da/df/d11/f15 [381622,129872] 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:0/268: write f11 [1061848,86407] 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:4/327: stat d3/de/f35 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:4/328: sync 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:2/165: dread d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:5/312: dwrite d0/f5 [8388608,4194304] 0 2024-04-25T23:01:06.135 INFO:tasks.workunit.client.0.smithi043.stdout:5/313: sync 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:8/176: fdatasync d3/d1d/f27 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:0/269: write fb [1392374,27513] 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:3/314: creat d7/d26/d59/f72 x:0 0 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:2/166: chown d2/l2a 4175840 1 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:6/262: fsync d1/d5/d3b/d4c/d1a/f27 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/326: dwrite d8/de/d44/d65/f3c [0,4194304] 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:7/259: mkdir d3/d52 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:0/270: write d1b/f3f [433535,34529] 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:4/329: write d3/de/f13 [1418626,87657] 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/327: dread - d8/de/d12/d15/d6c/f70 zero size 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:7/260: chown d3/da/df/d11/l14 0 1 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:3/315: symlink d7/d32/l73 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:2/167: mknod d2/d3/d22/c33 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:5/314: creat d0/d2c/f6b x:0 0 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/328: fdatasync d8/f5a 0 2024-04-25T23:01:06.136 INFO:tasks.workunit.client.0.smithi043.stdout:4/330: truncate d3/d19/f5a 1458722 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:4/331: sync 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:7/261: mknod d3/c53 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:3/316: chown d7/d26/d27/d34/d1a/d28/f3c 1541375 1 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:5/315: stat d0/d2c/d39/d1c/d25/d32/f50 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:2/168: creat d2/d3/f34 x:0 0 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:8/177: dwrite d3/d4/db/df/d10/d33/f1a [0,4194304] 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:7/262: mkdir d3/d1e/d1f/d54 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:3/317: write d7/f20 [1543197,71233] 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:2/169: chown d2/d3/f2f 1 1 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:0/271: dwrite d1b/f4a [4194304,4194304] 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:6/263: dwrite d1/d5/d3b/d4c/d21/d38/f45 [0,4194304] 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:3/318: chown d7/fb 116 1 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:7/263: dread - d3/da/df/d11/d26/f49 zero size 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:3/319: write d7/d26/d27/d34/d1a/f1e [2044461,72713] 0 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:7/264: chown d3/da/df/d11/f15 0 1 2024-04-25T23:01:06.137 INFO:tasks.workunit.client.0.smithi043.stdout:6/264: creat d1/d2a/f5e x:0 0 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:7/265: symlink d3/da/df/d11/d26/l55 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/320: creat d7/d26/d2d/f74 x:0 0 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:9/329: truncate d8/de/d12/d16/d24/f2a 6627338 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:7/266: fdatasync d3/da/df/f1a 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/321: readlink d7/d26/d27/d34/l49 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/322: dread - d7/d26/d27/d56/f6c zero size 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:7/267: write d3/da/f44 [4107160,103722] 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:7/268: symlink d3/da/l56 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:0/272: dwrite f11 [0,4194304] 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/323: mknod d7/d26/d27/d34/d1a/d40/c75 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:2/170: dwrite d2/d3/f2f [0,4194304] 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/324: rename d7/d39/l4b to d7/d26/d2d/l76 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:7/269: truncate d3/da/df/d11/f2f 3761038 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:0/273: getdents d1b/d31/d3c 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:2/171: creat d2/d3/d22/f35 x:0 0 0 2024-04-25T23:01:06.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/325: unlink d7/f25 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:3/326: sync 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:6/265: dwrite d1/f13 [0,4194304] 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:9/330: dwrite d8/de/d44/f60 [0,4194304] 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:2/172: creat d2/d3/d22/d23/f36 x:0 0 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:7/270: truncate d3/da/df/f3f 379346 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:5/316: truncate d0/f40 251954 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:8/178: truncate d3/d4/db/f2d 2678034 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:9/331: write d8/de/d44/f60 [1729046,129745] 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:6/266: symlink d1/d5/d3b/d4c/d21/d55/d57/l5f 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:2/173: creat d2/d3/d22/d23/f37 x:0 0 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:6/267: sync 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:8/179: chown d3/d4/db/l23 223546729 1 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:7/271: rename d3/d1e/d1f/l31 to d3/da/l57 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:3/327: rename d7/d26/d27/d34/l6a to d7/d26/d27/d34/l77 0 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:5/317: rename d0/d2c to d0/d2c/d39/d1c/d25/d32/d62/d6c 22 2024-04-25T23:01:06.139 INFO:tasks.workunit.client.0.smithi043.stdout:6/268: mkdir d1/d5/d3b/d4c/d21/d38/d60 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:3/328: dread - d7/d26/d27/d34/d1a/d40/f64 zero size 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:5/318: creat d0/d22/f6d x:0 0 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/174: getdents d2 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:9/332: link d8/de/d44/d65/l64 d8/de/d12/d15/d6c/l77 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:5/319: write d0/f17 [546639,47894] 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/175: fsync d2/d3/d13/d18/f19 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:3/329: getdents d7/d39 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:9/333: rename d8/de/d12/d16/d26/f4d to d8/de/f78 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/176: rename d2/d3/d28 to d2/d3/d38 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:8/180: dwrite d3/d1d/f37 [0,4194304] 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:5/320: link d0/l19 d0/d2c/d39/d37/d41/l6e 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/177: creat d2/d3/d22/f39 x:0 0 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:5/321: sync 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:8/181: read - d3/d4/db/df/d10/d33/f34 zero size 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:5/322: unlink d0/l19 0 2024-04-25T23:01:06.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/178: write d2/d3/f34 [921666,21492] 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:5/323: chown d0/d22 14011180 1 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:7/272: dread d3/da/f36 [0,4194304] 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/182: rename d3/d4/db/ld to d3/d4/db/df/d10/d33/l39 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:5/324: readlink d0/d2c/d39/d37/d2d/l4b 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:7/273: unlink d3/c33 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/183: chown d3/d1d/f27 1479 1 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:5/325: creat d0/d2c/d39/d37/f6f x:0 0 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/330: dwrite d7/d26/d27/d34/d1a/d28/f29 [0,4194304] 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:0/274: truncate d1b/d23/f2a 934911 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/184: truncate d3/d4/db/d14/f2c 234863 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:5/326: dread - d0/d2c/d39/d1c/f61 zero size 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:7/274: symlink d3/d1e/d1f/d54/l58 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:0/275: symlink d1b/d31/l58 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/185: mknod d3/d4/db/df/d10/c3a 0 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/186: chown d3/d1d 46 1 2024-04-25T23:01:06.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/187: write d3/d4/f25 [82126,33611] 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:8/188: creat d3/d4/db/df/d10/f3b x:0 0 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/331: rename d7/d32/f4f to d7/d26/f78 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:7/275: dread d3/d1e/d41/f4a [0,4194304] 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:7/276: readlink d3/da/df/d11/l14 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:8/189: read d3/d4/f8 [5342112,34361] 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:5/327: dwrite d0/f17 [0,4194304] 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:9/334: truncate d8/de/d12/d16/d24/f33 2507609 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:7/277: write d3/d1e/f4c [898524,37031] 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/269: dwrite d1/d5/d3b/d4c/f25 [0,4194304] 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:8/190: mknod d3/c3c 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/179: fdatasync d2/d3/d22/d23/f11 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:9/335: creat d8/de/f79 x:0 0 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/270: fdatasync d1/d5/d14/d30/f3d 0 2024-04-25T23:01:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/332: dwrite d7/f65 [0,4194304] 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/336: unlink d8/de/c13 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:5/328: getdents d0/d2c/d39/d1c/d25/d32 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/278: link d3/da/l57 d3/d1e/d1f/l59 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:6/271: symlink d1/d5/d3b/d4c/l61 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/233: dread d0/f5 [0,4194304] 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:3/333: write d7/f9 [1470895,96645] 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/337: mkdir d8/de/d12/d7a 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/279: mknod d3/d1e/c5a 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/234: creat d0/d3d/f50 x:0 0 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:3/334: read d7/d26/d27/d34/f17 [2746465,130502] 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/338: rename d8/c14 to d8/de/c7b 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/235: mknod d0/c51 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/236: chown d0/c3f 16254 1 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/280: truncate d3/da/df/d11/d26/f49 833011 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:6/272: write d1/d5/d3b/d4c/d21/d38/f45 [2774078,82087] 0 2024-04-25T23:01:06.143 INFO:tasks.workunit.client.0.smithi043.stdout:2/180: read d2/d3/d13/d18/f19 [2172897,104768] 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:1/237: mknod d0/d16/c52 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:0/276: truncate d1b/f57 3488693 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:8/191: dwrite d3/f35 [0,4194304] 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:1/238: truncate d0/d9/f46 1169717 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/332: dread d3/de/f14 [0,4194304] 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/333: sync 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/334: readlink d3/d37/d5b/l6c 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/181: mkdir d2/d3/d22/d23/d3a 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:6/273: unlink d1/d5/d3b/d4c/d21/f2b 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:8/192: symlink d3/d1d/l3d 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/335: write d3/d21/f63 [736405,66793] 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:5/329: readlink d0/d2c/d39/d37/d41/l6e 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:7/281: link d3/l1c d3/d1e/d1f/l5b 0 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/182: rmdir d2/d3/d13 39 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/183: read - d2/d3/d22/d23/f37 zero size 2024-04-25T23:01:06.144 INFO:tasks.workunit.client.0.smithi043.stdout:3/335: dwrite d7/d26/d27/d34/d1a/f1d [0,4194304] 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:5/330: mknod d0/d2c/d39/c70 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/239: dread d0/d2f/f48 [0,4194304] 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:9/339: getdents d8 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:0/277: truncate d1b/d23/d39/f46 1978823 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:8/193: dread d3/d1d/f27 [0,4194304] 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:9/340: stat d8/de/d12/d16/d24 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/240: rename d0/d9/l1d to d0/l53 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:7/282: getdents d3/d1e/d41 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:6/274: dwrite d1/f1f [0,4194304] 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:4/336: dwrite d3/d21/f30 [0,4194304] 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:7/283: rmdir d3/da/df/d11 39 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:2/184: rename d2/d3/d13/d18/l2b to d2/d3/l3b 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:0/278: link d1b/d23/c26 d1b/c59 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/241: unlink d0/d2f/d4b/l4d 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:6/275: stat d1/d5/d3b/d4c/d21/d46/f4a 0 2024-04-25T23:01:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:7/284: fsync d3/da/f23 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/185: mknod d2/d3/d22/d23/c3c 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:1/242: readlink d0/d16/l4c 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/186: sync 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:7/285: chown d3/f5 318 1 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:6/276: readlink d1/d5/d3b/d4c/d1a/l34 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:5/331: truncate d0/d2c/d39/d37/d2d/d5f/d3a/f3e 270123 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:3/336: dwrite d7/d26/d27/d34/f17 [0,4194304] 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:8/194: truncate d3/d1d/f37 3798319 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/187: rmdir d2/d3/d38 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:1/243: chown d0/fa 0 1 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:9/341: dwrite d8/de/d44/f60 [0,4194304] 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:4/337: dread d3/f57 [0,4194304] 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:8/195: dread - d3/d32/f2b zero size 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:5/332: rename d0/d2c/c5d to d0/d2c/d39/d1c/d5e/c71 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/188: symlink d2/d3/d22/l3d 0 2024-04-25T23:01:06.146 INFO:tasks.workunit.client.0.smithi043.stdout:9/342: stat d8/de/d12/d16/d24 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:4/338: creat d3/d21/f7c x:0 0 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:5/333: mknod d0/d2c/d39/d1c/d25/c72 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:8/196: getdents d3/d4 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:0/279: dwrite f1a [4194304,4194304] 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:0/280: rmdir d1b/d23 39 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:9/343: symlink d8/de/d12/d15/d6c/l7c 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:7/286: dwrite d3/da/df/d11/d26/f49 [0,4194304] 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:7/287: chown d3/da/l30 0 1 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:8/197: truncate d3/d4/db/df/d10/d33/f2a 1431549 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:2/189: dwrite d2/d3/f34 [0,4194304] 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:2/190: mkdir d2/d3e 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:8/198: fdatasync d3/d4/db/df/d10/f15 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:7/288: symlink d3/l5c 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:5/334: rename d0/d2c/d39/d1c/d25/d32/d62/f64 to d0/d2c/d39/d37/d41/d4a/f73 0 2024-04-25T23:01:06.147 INFO:tasks.workunit.client.0.smithi043.stdout:7/289: chown d3/da/f23 3566437 1 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:2/191: creat d2/d3e/f3f x:0 0 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:2/192: mkdir d2/d3/d13/d40 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:7/290: write d3/d1e/f39 [1484585,34888] 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:5/335: rename d0/d2c/d39/d1c/f61 to d0/d2c/d39/d37/d2d/f74 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:2/193: write d2/d3/d22/d23/f36 [930271,72856] 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:2/194: fsync d2/d3/d22/f26 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:3/337: dwrite d7/d39/d52/f5d [0,4194304] 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:7/291: readlink d3/d1e/d1f/d54/l58 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:2/195: readlink d2/l20 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:6/277: truncate d1/f29 3620525 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:3/338: symlink d7/d26/d2d/l79 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:7/292: rename d3/da/df/f1a to d3/d1e/d41/f5d 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:2/196: symlink d2/d3/d22/d23/d3a/l41 0 2024-04-25T23:01:06.148 INFO:tasks.workunit.client.0.smithi043.stdout:6/278: chown d1/d5/d3b/d4c/f58 1175434 1 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:7/293: mknod d3/d52/c5e 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/339: dread - d7/d26/d27/d34/d1a/d28/f4c zero size 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/279: truncate d1/d5/d3b/f44 941653 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:7/294: creat d3/d1e/d1f/f5f x:0 0 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/197: chown d2/d3/d13/d40 10 1 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/340: chown d7/d26/d27/d34/l77 12765 1 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/280: fdatasync d1/d5/d3b/d4c/d21/d46/f4a 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/198: creat d2/d3/f42 x:0 0 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/341: creat d7/d26/d59/f7a x:0 0 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/281: dread - d1/d5/d14/f36 zero size 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:7/295: creat d3/d52/f60 x:0 0 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/199: mkdir d2/d3/d22/d23/d43 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/200: write d2/d3/f2f [4329911,30296] 0 2024-04-25T23:01:06.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/201: mknod d2/d3e/c44 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:2/202: unlink d2/d3/d13/d18/c31 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/296: dread d3/d1e/f50 [0,4194304] 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:2/203: chown d2/d3/f27 3 1 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/297: write d3/da/f23 [3814347,63188] 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:0/281: write d1b/f56 [681740,6025] 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:9/344: write d8/de/d12/d15/d2f/f2d [6198840,39102] 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/298: readlink d3/da/l30 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:9/345: symlink d8/de/d44/d47/l7d 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/299: write d3/da/f44 [1886967,60614] 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:0/282: truncate d1b/d23/d39/f44 396757 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/300: readlink d3/l28 0 2024-04-25T23:01:06.152 INFO:tasks.workunit.client.0.smithi043.stdout:3/342: dwrite d7/d26/f3d [0,4194304] 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/346: rename d8/de/d12/d16/d26 to d8/de/d44/d47/d7e 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:3/343: symlink d7/d26/d27/l7b 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:0/283: link d1b/f57 d1b/d55/f5a 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:3/344: stat d7/d26/d27/d34/c3a 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/347: symlink d8/de/d12/d16/l7f 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:7/301: dread d3/da/df/d11/f15 [0,4194304] 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:3/345: dread - d7/d26/d27/d34/d1a/d28/f4c zero size 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:7/302: readlink d3/d1e/d1f/l59 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:3/346: mkdir d7/d26/d59/d7c 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:3/347: write d7/d26/d27/d34/d1a/d28/f46 [5416255,94214] 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/348: fsync d8/fd 0 2024-04-25T23:01:06.153 INFO:tasks.workunit.client.0.smithi043.stdout:5/336: dread d0/d2c/d39/d37/d2d/d5f/d3a/f65 [0,4194304] 0 2024-04-25T23:01:06.154 INFO:tasks.workunit.client.0.smithi043.stdout:0/284: dwrite d1b/f3f [0,4194304] 0 2024-04-25T23:01:06.154 INFO:tasks.workunit.client.0.smithi043.stdout:2/204: truncate d2/d3/f34 2174138 0 2024-04-25T23:01:06.154 INFO:tasks.workunit.client.0.smithi043.stdout:7/303: dwrite d3/d1e/d1f/f5f [0,4194304] 0 2024-04-25T23:01:06.155 INFO:tasks.workunit.client.0.smithi043.stdout:2/205: chown d2/d3/d22/d23/l1f 7535 1 2024-04-25T23:01:06.155 INFO:tasks.workunit.client.0.smithi043.stdout:7/304: write d3/f19 [8569617,106631] 0 2024-04-25T23:01:06.156 INFO:tasks.workunit.client.0.smithi043.stdout:2/206: dread d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:06.163 INFO:tasks.workunit.client.0.smithi043.stdout:3/348: rename d7/l19 to d7/d26/d27/d34/d1a/l7d 0 2024-04-25T23:01:06.163 INFO:tasks.workunit.client.0.smithi043.stdout:2/207: symlink d2/d3/d13/d18/l45 0 2024-04-25T23:01:06.163 INFO:tasks.workunit.client.0.smithi043.stdout:9/349: dread - d8/de/d12/d16/f40 zero size 2024-04-25T23:01:06.163 INFO:tasks.workunit.client.0.smithi043.stdout:5/337: symlink d0/d2c/d39/d63/l75 0 2024-04-25T23:01:06.164 INFO:tasks.workunit.client.0.smithi043.stdout:0/285: rename f18 to d1b/d42/f5b 0 2024-04-25T23:01:06.164 INFO:tasks.workunit.client.0.smithi043.stdout:9/350: readlink d8/l46 0 2024-04-25T23:01:06.164 INFO:tasks.workunit.client.0.smithi043.stdout:0/286: dread - d1b/d31/f49 zero size 2024-04-25T23:01:06.164 INFO:tasks.workunit.client.0.smithi043.stdout:3/349: write d7/d26/d27/d34/d1a/f50 [2647762,107497] 0 2024-04-25T23:01:06.165 INFO:tasks.workunit.client.0.smithi043.stdout:9/351: write d8/de/f78 [116383,21115] 0 2024-04-25T23:01:06.165 INFO:tasks.workunit.client.0.smithi043.stdout:3/350: sync 2024-04-25T23:01:06.166 INFO:tasks.workunit.client.0.smithi043.stdout:0/287: mkdir d1b/d42/d5c 0 2024-04-25T23:01:06.168 INFO:tasks.workunit.client.0.smithi043.stdout:9/352: dread d8/de/d12/d16/d24/f2a [4194304,4194304] 0 2024-04-25T23:01:06.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/353: truncate d8/de/d44/d47/d7e/d31/f5b 651188 0 2024-04-25T23:01:06.171 INFO:tasks.workunit.client.0.smithi043.stdout:3/351: dwrite d7/d26/f5e [0,4194304] 0 2024-04-25T23:01:06.172 INFO:tasks.workunit.client.0.smithi043.stdout:3/352: dread - d7/d26/d27/d34/d1a/d40/f64 zero size 2024-04-25T23:01:06.173 INFO:tasks.workunit.client.0.smithi043.stdout:3/353: fsync d7/d26/d27/d34/d1a/d40/f47 0 2024-04-25T23:01:06.174 INFO:tasks.workunit.client.0.smithi043.stdout:3/354: creat d7/d26/f7e x:0 0 0 2024-04-25T23:01:06.175 INFO:tasks.workunit.client.0.smithi043.stdout:1/244: dread d0/f2e [0,4194304] 0 2024-04-25T23:01:06.176 INFO:tasks.workunit.client.0.smithi043.stdout:9/354: rename d8/de/d44/d47/d7e to d8/de/d12/d16/d80 0 2024-04-25T23:01:06.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/355: write d7/d26/d2d/f74 [706840,75394] 0 2024-04-25T23:01:06.178 INFO:tasks.workunit.client.0.smithi043.stdout:9/355: write d8/de/d12/d16/f40 [845384,79385] 0 2024-04-25T23:01:06.178 INFO:tasks.workunit.client.0.smithi043.stdout:3/356: write d7/f20 [662982,34693] 0 2024-04-25T23:01:06.180 INFO:tasks.workunit.client.0.smithi043.stdout:9/356: stat d8/de/d44/d65/f3c 0 2024-04-25T23:01:06.182 INFO:tasks.workunit.client.0.smithi043.stdout:6/282: write d1/d5/d3b/d4c/f25 [943413,56361] 0 2024-04-25T23:01:06.184 INFO:tasks.workunit.client.0.smithi043.stdout:3/357: fsync d7/d26/d59/f69 0 2024-04-25T23:01:06.184 INFO:tasks.workunit.client.0.smithi043.stdout:9/357: mknod d8/de/d44/c81 0 2024-04-25T23:01:06.187 INFO:tasks.workunit.client.0.smithi043.stdout:9/358: dread - d8/de/d12/d16/d24/f62 zero size 2024-04-25T23:01:06.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/339: dread d3/f41 [0,4194304] 0 2024-04-25T23:01:06.188 INFO:tasks.workunit.client.0.smithi043.stdout:3/358: write d7/d39/d52/f5d [3482796,118704] 0 2024-04-25T23:01:06.189 INFO:tasks.workunit.client.0.smithi043.stdout:7/305: dread d3/da/df/d11/f2f [0,4194304] 0 2024-04-25T23:01:06.191 INFO:tasks.workunit.client.0.smithi043.stdout:1/245: dwrite d0/d3d/f30 [0,4194304] 0 2024-04-25T23:01:06.194 INFO:tasks.workunit.client.0.smithi043.stdout:0/288: truncate f1a 3385314 0 2024-04-25T23:01:06.194 INFO:tasks.workunit.client.0.smithi043.stdout:2/208: write d2/fc [1294883,94563] 0 2024-04-25T23:01:06.195 INFO:tasks.workunit.client.0.smithi043.stdout:3/359: symlink d7/d26/d59/d7c/l7f 0 2024-04-25T23:01:06.195 INFO:tasks.workunit.client.0.smithi043.stdout:7/306: link d3/da/df/d11/c1d d3/d1e/d1f/c61 0 2024-04-25T23:01:06.196 INFO:tasks.workunit.client.0.smithi043.stdout:9/359: getdents d8/de/d44/d5d/d4f 0 2024-04-25T23:01:06.196 INFO:tasks.workunit.client.0.smithi043.stdout:0/289: creat d1b/d31/d3c/d50/f5d x:0 0 0 2024-04-25T23:01:06.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/209: unlink d2/d3/d22/c24 0 2024-04-25T23:01:06.196 INFO:tasks.workunit.client.0.smithi043.stdout:0/290: chown d1b/d23/f4e 40 1 2024-04-25T23:01:06.196 INFO:tasks.workunit.client.0.smithi043.stdout:8/199: dread d3/d4/f25 [4194304,4194304] 0 2024-04-25T23:01:06.197 INFO:tasks.workunit.client.0.smithi043.stdout:3/360: truncate d7/d26/d27/d34/f17 4391861 0 2024-04-25T23:01:06.197 INFO:tasks.workunit.client.0.smithi043.stdout:7/307: unlink d3/da/df/d11/c29 0 2024-04-25T23:01:06.197 INFO:tasks.workunit.client.0.smithi043.stdout:1/246: truncate d0/f26 928386 0 2024-04-25T23:01:06.197 INFO:tasks.workunit.client.0.smithi043.stdout:2/210: mknod d2/d3/d13/c46 0 2024-04-25T23:01:06.198 INFO:tasks.workunit.client.0.smithi043.stdout:0/291: truncate d1b/d23/f53 82432 0 2024-04-25T23:01:06.198 INFO:tasks.workunit.client.0.smithi043.stdout:8/200: rename d3/d32/d38 to d3/d4/db/d14/d3e 0 2024-04-25T23:01:06.199 INFO:tasks.workunit.client.0.smithi043.stdout:2/211: dread d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:06.200 INFO:tasks.workunit.client.0.smithi043.stdout:1/247: getdents d0/d2f 0 2024-04-25T23:01:06.200 INFO:tasks.workunit.client.0.smithi043.stdout:7/308: truncate d3/d1e/d1f/f24 1161160 0 2024-04-25T23:01:06.201 INFO:tasks.workunit.client.0.smithi043.stdout:8/201: symlink d3/d4/d36/l3f 0 2024-04-25T23:01:06.201 INFO:tasks.workunit.client.0.smithi043.stdout:9/360: link d8/de/d12/d15/d6c/l77 d8/de/l82 0 2024-04-25T23:01:06.202 INFO:tasks.workunit.client.0.smithi043.stdout:8/202: fdatasync d3/d4/db/d14/f2c 0 2024-04-25T23:01:06.202 INFO:tasks.workunit.client.0.smithi043.stdout:7/309: creat d3/da/f62 x:0 0 0 2024-04-25T23:01:06.203 INFO:tasks.workunit.client.0.smithi043.stdout:5/338: dread d0/d2c/d39/f34 [0,4194304] 0 2024-04-25T23:01:06.203 INFO:tasks.workunit.client.0.smithi043.stdout:9/361: stat d8/de/d12/d15/d2f/f2d 0 2024-04-25T23:01:06.203 INFO:tasks.workunit.client.0.smithi043.stdout:4/340: dwrite d3/d19/f48 [0,4194304] 0 2024-04-25T23:01:06.204 INFO:tasks.workunit.client.0.smithi043.stdout:2/212: creat d2/d3/f47 x:0 0 0 2024-04-25T23:01:06.204 INFO:tasks.workunit.client.0.smithi043.stdout:9/362: chown d8/de/f3e 466 1 2024-04-25T23:01:06.205 INFO:tasks.workunit.client.0.smithi043.stdout:3/361: dwrite d7/d26/d2d/f74 [0,4194304] 0 2024-04-25T23:01:06.205 INFO:tasks.workunit.client.0.smithi043.stdout:2/213: chown d2/d3/d13/d18/f19 2427147 1 2024-04-25T23:01:06.206 INFO:tasks.workunit.client.0.smithi043.stdout:7/310: mkdir d3/d1e/d41/d63 0 2024-04-25T23:01:06.207 INFO:tasks.workunit.client.0.smithi043.stdout:7/311: read d3/da/f36 [132069,83871] 0 2024-04-25T23:01:06.207 INFO:tasks.workunit.client.0.smithi043.stdout:8/203: symlink d3/d4/db/df/l40 0 2024-04-25T23:01:06.208 INFO:tasks.workunit.client.0.smithi043.stdout:9/363: rename d8/de/d12/d16/d80/d31/c72 to d8/de/d12/d16/c83 0 2024-04-25T23:01:06.209 INFO:tasks.workunit.client.0.smithi043.stdout:1/248: dwrite d0/d16/f4a [0,4194304] 0 2024-04-25T23:01:06.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/341: creat d3/f7d x:0 0 0 2024-04-25T23:01:06.209 INFO:tasks.workunit.client.0.smithi043.stdout:3/362: getdents d7/d26/d27/d56 0 2024-04-25T23:01:06.209 INFO:tasks.workunit.client.0.smithi043.stdout:1/249: chown d0/fa 9861940 1 2024-04-25T23:01:06.210 INFO:tasks.workunit.client.0.smithi043.stdout:1/250: chown d0/f2 244 1 2024-04-25T23:01:06.210 INFO:tasks.workunit.client.0.smithi043.stdout:8/204: dread d3/d4/db/d14/f2c [0,4194304] 0 2024-04-25T23:01:06.210 INFO:tasks.workunit.client.0.smithi043.stdout:3/363: creat d7/d26/d27/f80 x:0 0 0 2024-04-25T23:01:06.211 INFO:tasks.workunit.client.0.smithi043.stdout:1/251: chown d0/d3c/l42 1849513 1 2024-04-25T23:01:06.211 INFO:tasks.workunit.client.0.smithi043.stdout:6/283: truncate d1/d5/d3b/d4c/d21/d38/f45 3001239 0 2024-04-25T23:01:06.214 INFO:tasks.workunit.client.0.smithi043.stdout:6/284: write d1/f1f [1401463,9195] 0 2024-04-25T23:01:06.215 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:06.212+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:06.215 INFO:tasks.workunit.client.0.smithi043.stdout:1/252: symlink d0/d2f/l54 0 2024-04-25T23:01:06.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/205: link d3/d4/db/f2d d3/d4/db/d14/f41 0 2024-04-25T23:01:06.217 INFO:tasks.workunit.client.0.smithi043.stdout:1/253: truncate d0/f1a 669436 0 2024-04-25T23:01:06.217 INFO:tasks.workunit.client.0.smithi043.stdout:8/206: fsync d3/d32/f2b 0 2024-04-25T23:01:06.219 INFO:tasks.workunit.client.0.smithi043.stdout:4/342: dwrite d3/de/f14 [0,4194304] 0 2024-04-25T23:01:06.219 INFO:tasks.workunit.client.0.smithi043.stdout:7/312: dwrite d3/da/f36 [0,4194304] 0 2024-04-25T23:01:06.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/214: dread d2/fc [0,4194304] 0 2024-04-25T23:01:06.219 INFO:tasks.workunit.client.0.smithi043.stdout:8/207: readlink d3/d4/db/l21 0 2024-04-25T23:01:06.220 INFO:tasks.workunit.client.0.smithi043.stdout:9/364: dwrite d8/f5a [4194304,4194304] 0 2024-04-25T23:01:06.221 INFO:tasks.workunit.client.0.smithi043.stdout:9/365: write d8/de/d12/d16/d24/f62 [980232,39897] 0 2024-04-25T23:01:06.222 INFO:tasks.workunit.client.0.smithi043.stdout:7/313: mkdir d3/da/d64 0 2024-04-25T23:01:06.222 INFO:tasks.workunit.client.0.smithi043.stdout:4/343: mkdir d3/d37/d7a/d7e 0 2024-04-25T23:01:06.222 INFO:tasks.workunit.client.0.smithi043.stdout:2/215: mkdir d2/d3/d22/d48 0 2024-04-25T23:01:06.222 INFO:tasks.workunit.client.0.smithi043.stdout:9/366: fdatasync d8/de/d12/d16/f25 0 2024-04-25T23:01:06.222 INFO:tasks.workunit.client.0.smithi043.stdout:4/344: rmdir d3/d19/d34 39 2024-04-25T23:01:06.223 INFO:tasks.workunit.client.0.smithi043.stdout:7/314: mknod d3/da/d64/c65 0 2024-04-25T23:01:06.223 INFO:tasks.workunit.client.0.smithi043.stdout:9/367: rmdir d8/de/d12/d16 39 2024-04-25T23:01:06.223 INFO:tasks.workunit.client.0.smithi043.stdout:4/345: dread - d3/de/f49 zero size 2024-04-25T23:01:06.224 INFO:tasks.workunit.client.0.smithi043.stdout:4/346: write d3/d37/d5b/f5e [1471600,48114] 0 2024-04-25T23:01:06.224 INFO:tasks.workunit.client.0.smithi043.stdout:4/347: chown d3/d21/f64 2715883 1 2024-04-25T23:01:06.225 INFO:tasks.workunit.client.0.smithi043.stdout:0/292: write f1a [2313274,100955] 0 2024-04-25T23:01:06.226 INFO:tasks.workunit.client.0.smithi043.stdout:4/348: creat d3/d21/d6b/f7f x:0 0 0 2024-04-25T23:01:06.226 INFO:tasks.workunit.client.0.smithi043.stdout:0/293: rename d1b/d42/d5c to d1b/d55/d5e 0 2024-04-25T23:01:06.227 INFO:tasks.workunit.client.0.smithi043.stdout:4/349: chown d3/c44 231460446 1 2024-04-25T23:01:06.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/294: mknod d1b/d55/d5e/c5f 0 2024-04-25T23:01:06.227 INFO:tasks.workunit.client.0.smithi043.stdout:4/350: mknod d3/d37/d7a/c80 0 2024-04-25T23:01:06.228 INFO:tasks.workunit.client.0.smithi043.stdout:2/216: dwrite d2/d3/f42 [0,4194304] 0 2024-04-25T23:01:06.229 INFO:tasks.workunit.client.0.smithi043.stdout:4/351: creat d3/d21/d6b/f81 x:0 0 0 2024-04-25T23:01:06.231 INFO:tasks.workunit.client.0.smithi043.stdout:0/295: getdents d1b/d31/d3c 0 2024-04-25T23:01:06.231 INFO:tasks.workunit.client.0.smithi043.stdout:4/352: link d3/de/d46/d6a/f78 d3/d19/f82 0 2024-04-25T23:01:06.232 INFO:tasks.workunit.client.0.smithi043.stdout:4/353: chown d3/d37/c71 30 1 2024-04-25T23:01:06.233 INFO:tasks.workunit.client.0.smithi043.stdout:4/354: mknod d3/de/c83 0 2024-04-25T23:01:06.234 INFO:tasks.workunit.client.0.smithi043.stdout:4/355: mkdir d3/d21/d84 0 2024-04-25T23:01:06.234 INFO:tasks.workunit.client.0.smithi043.stdout:2/217: dwrite d2/d3/d13/f1e [0,4194304] 0 2024-04-25T23:01:06.235 INFO:tasks.workunit.client.0.smithi043.stdout:4/356: write d3/de/f49 [540745,17345] 0 2024-04-25T23:01:06.235 INFO:tasks.workunit.client.0.smithi043.stdout:4/357: write d3/d21/f64 [399919,96749] 0 2024-04-25T23:01:06.236 INFO:tasks.workunit.client.0.smithi043.stdout:0/296: fdatasync f1a 0 2024-04-25T23:01:06.236 INFO:tasks.workunit.client.0.smithi043.stdout:3/364: read d7/d26/d27/f48 [345579,77651] 0 2024-04-25T23:01:06.236 INFO:tasks.workunit.client.0.smithi043.stdout:2/218: creat d2/d3/d22/f49 x:0 0 0 2024-04-25T23:01:06.237 INFO:tasks.workunit.client.0.smithi043.stdout:2/219: truncate d2/d3/f42 4312783 0 2024-04-25T23:01:06.239 INFO:tasks.workunit.client.0.smithi043.stdout:2/220: unlink d2/d3/d22/d23/f11 0 2024-04-25T23:01:06.239 INFO:tasks.workunit.client.0.smithi043.stdout:3/365: link d7/d26/d27/d34/d1a/c30 d7/d26/d2d/c81 0 2024-04-25T23:01:06.240 INFO:tasks.workunit.client.0.smithi043.stdout:3/366: unlink d7/d32/c4e 0 2024-04-25T23:01:06.240 INFO:tasks.workunit.client.0.smithi043.stdout:0/297: dread d1b/f37 [0,4194304] 0 2024-04-25T23:01:06.241 INFO:tasks.workunit.client.0.smithi043.stdout:2/221: creat d2/d3/f4a x:0 0 0 2024-04-25T23:01:06.243 INFO:tasks.workunit.client.0.smithi043.stdout:4/358: dwrite d3/d19/f82 [0,4194304] 0 2024-04-25T23:01:06.244 INFO:tasks.workunit.client.0.smithi043.stdout:6/285: truncate d1/d5/d3b/d4c/d21/f24 682062 0 2024-04-25T23:01:06.244 INFO:tasks.workunit.client.0.smithi043.stdout:1/254: truncate d0/d16/f22 1117740 0 2024-04-25T23:01:06.244 INFO:tasks.workunit.client.0.smithi043.stdout:8/208: truncate d3/d4/db/df/d10/d33/f1a 2971526 0 2024-04-25T23:01:06.245 INFO:tasks.workunit.client.0.smithi043.stdout:3/367: unlink d7/d26/d27/d34/d1a/c30 0 2024-04-25T23:01:06.246 INFO:tasks.workunit.client.0.smithi043.stdout:7/315: write d3/d1e/d1f/f24 [346063,56534] 0 2024-04-25T23:01:06.246 INFO:tasks.workunit.client.0.smithi043.stdout:1/255: mknod d0/d2f/d4b/c55 0 2024-04-25T23:01:06.246 INFO:tasks.workunit.client.0.smithi043.stdout:3/368: rmdir d7/d39 39 2024-04-25T23:01:06.246 INFO:tasks.workunit.client.0.smithi043.stdout:4/359: rmdir d3/d37/d7a/d7e 0 2024-04-25T23:01:06.246 INFO:tasks.workunit.client.0.smithi043.stdout:8/209: mknod d3/d4/db/df/d10/c42 0 2024-04-25T23:01:06.248 INFO:tasks.workunit.client.0.smithi043.stdout:1/256: creat d0/d2f/d4b/f56 x:0 0 0 2024-04-25T23:01:06.248 INFO:tasks.workunit.client.0.smithi043.stdout:4/360: mknod d3/de/d27/d45/c85 0 2024-04-25T23:01:06.249 INFO:tasks.workunit.client.0.smithi043.stdout:3/369: write d7/d26/d27/d34/f17 [5004165,62033] 0 2024-04-25T23:01:06.249 INFO:tasks.workunit.client.0.smithi043.stdout:8/210: creat d3/d4/db/d14/d3e/f43 x:0 0 0 2024-04-25T23:01:06.249 INFO:tasks.workunit.client.0.smithi043.stdout:1/257: rmdir d0/d3d 39 2024-04-25T23:01:06.250 INFO:tasks.workunit.client.0.smithi043.stdout:0/298: dwrite d1b/d23/d39/f44 [0,4194304] 0 2024-04-25T23:01:06.250 INFO:tasks.workunit.client.0.smithi043.stdout:7/316: read d3/da/df/f3f [272505,73001] 0 2024-04-25T23:01:06.251 INFO:tasks.workunit.client.0.smithi043.stdout:6/286: dread d1/d5/d3b/d4c/f25 [0,4194304] 0 2024-04-25T23:01:06.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/299: stat d1b/f4a 0 2024-04-25T23:01:06.251 INFO:tasks.workunit.client.0.smithi043.stdout:1/258: symlink d0/d3d/d4f/l57 0 2024-04-25T23:01:06.251 INFO:tasks.workunit.client.0.smithi043.stdout:4/361: link d3/d19/l4a d3/d19/l86 0 2024-04-25T23:01:06.251 INFO:tasks.workunit.client.0.smithi043.stdout:6/287: fdatasync d1/d5/f3f 0 2024-04-25T23:01:06.252 INFO:tasks.workunit.client.0.smithi043.stdout:0/300: creat d1b/d55/d5e/f60 x:0 0 0 2024-04-25T23:01:06.254 INFO:tasks.workunit.client.0.smithi043.stdout:6/288: getdents d1/d5/d3b/d4c 0 2024-04-25T23:01:06.255 INFO:tasks.workunit.client.0.smithi043.stdout:6/289: chown d1/d5/d3b/d4c/l5c 874 1 2024-04-25T23:01:06.256 INFO:tasks.workunit.client.0.smithi043.stdout:1/259: dread d0/d2f/f48 [0,4194304] 0 2024-04-25T23:01:06.256 INFO:tasks.workunit.client.0.smithi043.stdout:6/290: rmdir d1/d5/d3b 39 2024-04-25T23:01:06.258 INFO:tasks.workunit.client.0.smithi043.stdout:1/260: fdatasync d0/d2f/f48 0 2024-04-25T23:01:06.259 INFO:tasks.workunit.client.0.smithi043.stdout:4/362: dwrite d3/d21/d6b/f7f [0,4194304] 0 2024-04-25T23:01:06.259 INFO:tasks.workunit.client.0.smithi043.stdout:6/291: truncate d1/d5/f1b 472864 0 2024-04-25T23:01:06.259 INFO:tasks.workunit.client.0.smithi043.stdout:0/301: dwrite d1b/d23/d39/f4b [0,4194304] 0 2024-04-25T23:01:06.259 INFO:tasks.workunit.client.0.smithi043.stdout:5/339: dread d0/d2c/d39/d1c/d25/f27 [4194304,4194304] 0 2024-04-25T23:01:06.259 INFO:tasks.workunit.client.0.smithi043.stdout:1/261: symlink d0/d2f/l58 0 2024-04-25T23:01:06.260 INFO:tasks.workunit.client.0.smithi043.stdout:4/363: mkdir d3/d21/d6b/d87 0 2024-04-25T23:01:06.260 INFO:tasks.workunit.client.0.smithi043.stdout:6/292: dread - d1/d5/d14/d30/f35 zero size 2024-04-25T23:01:06.261 INFO:tasks.workunit.client.0.smithi043.stdout:2/222: truncate d2/d3/f34 643128 0 2024-04-25T23:01:06.262 INFO:tasks.workunit.client.0.smithi043.stdout:5/340: truncate d0/d2c/d39/d1c/d25/f56 456572 0 2024-04-25T23:01:06.263 INFO:tasks.workunit.client.0.smithi043.stdout:0/302: chown d1b/d55/f5a 5838 1 2024-04-25T23:01:06.263 INFO:tasks.workunit.client.0.smithi043.stdout:1/262: link d0/c2b d0/d2f/c59 0 2024-04-25T23:01:06.263 INFO:tasks.workunit.client.0.smithi043.stdout:1/263: chown d0/d16/f2d 127717 1 2024-04-25T23:01:06.263 INFO:tasks.workunit.client.0.smithi043.stdout:5/341: write d0/d2c/d39/d1c/d25/f56 [804690,118589] 0 2024-04-25T23:01:06.264 INFO:tasks.workunit.client.0.smithi043.stdout:5/342: unlink d0/d2c/d39/d37/d41/l6e 0 2024-04-25T23:01:06.264 INFO:tasks.workunit.client.0.smithi043.stdout:6/293: getdents d1/d5/d3b/d4c 0 2024-04-25T23:01:06.264 INFO:tasks.workunit.client.0.smithi043.stdout:5/343: write d0/d22/f6d [9864,99082] 0 2024-04-25T23:01:06.266 INFO:tasks.workunit.client.0.smithi043.stdout:5/344: rmdir d0/d2c/d39/d37/d2d/d5f/d3a 39 2024-04-25T23:01:06.266 INFO:tasks.workunit.client.0.smithi043.stdout:4/364: dread d3/de/f35 [4194304,4194304] 0 2024-04-25T23:01:06.266 INFO:tasks.workunit.client.0.smithi043.stdout:5/345: read - d0/d2c/f6b zero size 2024-04-25T23:01:06.267 INFO:tasks.workunit.client.0.smithi043.stdout:5/346: creat d0/d22/f76 x:0 0 0 2024-04-25T23:01:06.269 INFO:tasks.workunit.client.0.smithi043.stdout:5/347: rename d0/d2c/d39/d37/d2d/d5f/d3a/f43 to d0/d2c/d39/d1c/d5e/f77 0 2024-04-25T23:01:06.270 INFO:tasks.workunit.client.0.smithi043.stdout:5/348: mkdir d0/d2c/d39/d37/d41/d4a/d78 0 2024-04-25T23:01:06.271 INFO:tasks.workunit.client.0.smithi043.stdout:7/317: read d3/d1e/d1f/f24 [103361,130768] 0 2024-04-25T23:01:06.271 INFO:tasks.workunit.client.0.smithi043.stdout:6/294: dwrite d1/d5/d3b/d4c/f15 [0,4194304] 0 2024-04-25T23:01:06.272 INFO:tasks.workunit.client.0.smithi043.stdout:5/349: symlink d0/d2c/d39/d1c/d25/d32/d62/l79 0 2024-04-25T23:01:06.272 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:06.272 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:06.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.272 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4556.0:11657 4.16 e53/17 4:69e5bd7d:::10000003230.00000000:head v 53'189, mlcod=53'187)", 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.251192+0000", 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.019942198000000001, 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019969137000000001, 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.251192+0000", 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.251192+0000", 2024-04-25T23:01:06.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.251193+0000", 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4900000000000001e-07 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258933+0000", 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077402169999999998 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258950+0000", 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7031999999999999e-05 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258960+0000", 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0033e-05 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.259030+0000", 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9542999999999995e-05 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.259055+0000", 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5174999999999999e-05 2024-04-25T23:01:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1001 3.13 3:cb3d3880:::200.0000000d:head [write 2120465~6039 [fadvise_dontneed] in=6039b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.261686+0000", 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0094485720000000006, 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009557655, 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.261686+0000", 2024-04-25T23:01:06.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.261686+0000", 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.261687+0000", 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000003e-07 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.261705+0000", 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8304999999999998e-05 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.261751+0000", 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5961999999999998e-05 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.261759+0000", 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6860000000000006e-06 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262129+0000", 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036973399999999998 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262230+0000", 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101505 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262331+0000", 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010134800000000001 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268218+0000", 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058862480000000002 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1003 3.13 3:cb3d3880:::200.0000000d:head [write 2126504~2644 [fadvise_dontneed] in=2644b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.262003+0000", 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0091313550000000007, 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093545669999999994, 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262003+0000", 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262003+0000", 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262004+0000", 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6800000000000009e-07 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262031+0000", 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7248999999999999e-05 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262044+0000", 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2289999999999999e-05 2024-04-25T23:01:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262051+0000", 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2250000000000003e-06 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263556+0000", 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015049410000000001 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263641+0000", 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5167999999999995e-05 2024-04-25T23:01:06.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263769+0000", 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128405 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268263+0000", 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004493553 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1004 4.3 4:c13e0e08:::100000031c7.00000000:head [trimtrunc 2@1117740] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.283 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.262064+0000", 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0090708160000000006, 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093841069999999992, 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262064+0000", 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262064+0000", 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262064+0000", 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.61e-07 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262067+0000", 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0280000000000001e-06 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262074+0000", 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7959999999999998e-06 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262080+0000", 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.57e-06 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263533+0000", 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014529580000000001 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263623+0000", 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0292999999999998e-05 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.286 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1005 3.13 3:cb3d3880:::200.0000000d:head [write 2129148~2488 [fadvise_dontneed] in=2488b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.262089+0000", 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0090459259999999993, 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094468020000000007, 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262089+0000", 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262089+0000", 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262089+0000", 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5300000000000004e-07 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262094+0000", 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6249999999999998e-06 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262103+0000", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4539999999999996e-06 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262109+0000", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5489999999999997e-06 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.264282+0000", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021734079999999999 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.264338+0000", 2024-04-25T23:01:06.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5398000000000001e-05 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.264418+0000", 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0174999999999997e-05 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268319+0000", 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039017069999999999 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.290 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1007 3.13 3:cb3d3880:::200.0000000d:head [write 2131636~2450 [fadvise_dontneed] in=2450b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.262154+0000", 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0089808860000000004, 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094769469999999995, 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262154+0000", 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262154+0000", 2024-04-25T23:01:06.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262154+0000", 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0200000000000001e-07 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262159+0000", 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7489999999999998e-06 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262168+0000", 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8249999999999994e-06 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262173+0000", 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3619999999999997e-06 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.265292+0000", 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031184979999999999 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.265392+0000", 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100503 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.265529+0000", 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137186 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268413+0000", 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002883591 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1008 3.13 3:cb3d3880:::200.0000000d:head [write 2134086~6778 [fadvise_dontneed] in=6778b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.262888+0000", 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0082466480000000005, 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088357460000000002, 2024-04-25T23:01:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262888+0000", 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262888+0000", 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262889+0000", 2024-04-25T23:01:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.085e-06 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262900+0000", 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0618999999999999e-05 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262915+0000", 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5132e-05 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.262923+0000", 2024-04-25T23:01:06.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5059999999999995e-06 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266387+0000", 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034641250000000002 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266507+0000", 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012002099999999999 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266612+0000", 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104224 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268469+0000", 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001857722 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1009 3.13 3:cb3d3880:::200.0000000d:head [write 2140864~2450 [fadvise_dontneed] in=2450b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.263149+0000", 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0079852580000000003, 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086651950000000005, 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:06.298 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263149+0000", 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263149+0000", 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263150+0000", 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5300000000000002e-07 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263156+0000", 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3850000000000001e-06 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263167+0000", 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1627999999999999e-05 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.263176+0000", 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0450000000000006e-06 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268517+0000", 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053411530000000004 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268623+0000", 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105596 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.268759+0000", 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013562599999999999 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1010 3.13 3:cb3d3880:::200.0000000d:head [write 2143314~11110 [fadvise_dontneed] in=11110b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.266055+0000", 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0050795279999999998, 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058321309999999999, 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266055+0000", 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266055+0000", 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266057+0000", 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9149999999999999e-06 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266069+0000", 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1656e-05 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266080+0000", 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1797000000000001e-05 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.266089+0000", 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3040000000000005e-06 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.271172+0000", 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050834870000000002 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.271286+0000", 2024-04-25T23:01:06.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113645 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.271400+0000", 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011398199999999999 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:11678 4.25 4:a7ae0919:::100000033a3.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.260513+0000", 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.010621339, 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01146019, 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 11678 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.260513+0000", 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.260513+0000", 2024-04-25T23:01:06.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.260514+0000", 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.176e-06 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267554+0000", 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070396979999999996 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267566+0000", 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2319e-05 2024-04-25T23:01:06.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267574+0000", 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5329999999999997e-06 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267640+0000", 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5621000000000001e-05 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267746+0000", 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106644 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:11680 4.32 4:4f3042f2:::1000000322e.00000000:head [read 405504~90112 [2@1161160]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.267636+0000", 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0034989629999999999, 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044184990000000002, 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 11680 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267636+0000", 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267636+0000", 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267636+0000", 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7300000000000001e-07 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267639+0000", 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8260000000000001e-06 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267645+0000", 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5939999999999999e-06 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.267651+0000", 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4229999999999996e-06 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.270919+0000", 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032680449999999998 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.271009+0000", 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:11675 4.e 4:72a45bd2:::100000032b4.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:06.312 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.251426+0000", 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.019708112999999999, 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020682244999999998, 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 11675 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.251426+0000", 2024-04-25T23:01:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.251426+0000", 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.251428+0000", 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3939999999999999e-06 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258375+0000", 2024-04-25T23:01:06.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0069476420000000004 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258390+0000", 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4953999999999999e-05 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258400+0000", 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5109999999999992e-06 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258459+0000", 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9508e-05 2024-04-25T23:01:06.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.258626+0000", 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016681399999999999 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:1009 3.13 e53/16)", 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:06.270295+0000", 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.00084000600000000002, 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00186024, 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:06.316 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.270295+0000", 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.270295+0000", 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.270296+0000", 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:06.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.270299+0000", 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8979999999999998e-06 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.270309+0000", 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2539999999999998e-06 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:06.270314+0000", 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.318 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:06.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:06.319 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:01:06.319 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 13 2024-04-25T23:01:06.319 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:06.319 INFO:tasks.workunit.client.0.smithi043.stdout:7/318: creat d3/d1e/d41/f66 x:0 0 0 2024-04-25T23:01:06.321 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:06.323 INFO:tasks.workunit.client.0.smithi043.stdout:7/319: write d3/da/df/d11/d26/f43 [716189,43817] 0 2024-04-25T23:01:06.323 INFO:tasks.workunit.client.0.smithi043.stdout:7/320: getdents d3/d1e/d1f/d54 0 2024-04-25T23:01:06.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/295: dwrite d1/d5/d3b/d4c/d1a/f27 [0,4194304] 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:7/321: dread d3/d1e/d41/f4a [0,4194304] 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/296: mkdir d1/d5/d3b/d62 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/297: fdatasync d1/f1f 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:8/211: dwrite d3/d4/db/df/d10/d33/f1a [0,4194304] 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/264: sync 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:7/322: dwrite d3/d1e/d1f/f24 [0,4194304] 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/365: dread d3/fa [0,4194304] 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/265: chown d0/d16/f23 359938 1 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/298: dwrite d1/d5/d3b/d4c/f15 [0,4194304] 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:7/323: symlink d3/d1e/l67 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:9/368: dread d8/de/d12/d16/d80/d31/f3f [0,4194304] 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/366: creat d3/de/d27/d45/f88 x:0 0 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/299: symlink d1/d5/d3b/d4c/d21/d46/l63 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/300: stat d1/d5/d3b/d4c/d1a/f54 0 2024-04-25T23:01:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/367: symlink d3/de/l89 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:0/303: dwrite d1b/d31/f33 [0,4194304] 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:8/212: dwrite d3/d4/db/df/d10/f3b [0,4194304] 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:5/350: rename d0/d2c/d39/d37 to d0/d2c/d39/d1c/d25/d7a 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:4/368: chown d3/d21/f79 209140110 1 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:9/369: rename d8/de/d12/d16/d80 to d8/de/d12/d15/d2f/d84 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:1/266: sync 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:0/304: readlink d1b/d31/l58 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:6/301: write d1/f20 [1278933,109343] 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:8/213: write d3/d4/db/df/d10/d33/f1a [1934126,70823] 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:1/267: truncate d0/f2 5116093 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:6/302: mknod d1/d5/d3b/d62/c64 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:1/268: mkdir d0/d16/d5a 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:8/214: mkdir d3/d32/d2e/d44 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:7/324: dwrite d3/da/f44 [0,4194304] 0 2024-04-25T23:01:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:2/223: dwrite d2/d3/d13/d18/f19 [0,4194304] 0 2024-04-25T23:01:06.326 INFO:tasks.workunit.client.0.smithi043.stdout:7/325: write d3/d1e/f4c [754241,24237] 0 2024-04-25T23:01:06.326 INFO:tasks.workunit.client.0.smithi043.stdout:2/224: chown d2/d3/d13 7 1 2024-04-25T23:01:06.326 INFO:tasks.workunit.client.0.smithi043.stdout:8/215: creat d3/d4/d36/f45 x:0 0 0 2024-04-25T23:01:06.326 INFO:tasks.workunit.client.0.smithi043.stdout:2/225: mkdir d2/d4b 0 2024-04-25T23:01:06.326 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:01:06.327 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:06.318+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:1/269: mkdir d0/d16/d5a/d5b 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/216: chown d3/d4/db/d14/d3e/f43 57235 1 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:6/303: creat d1/d5/f65 x:0 0 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:2/226: rename d2/d3e/c44 to d2/c4c 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:1/270: mknod d0/d16/c5c 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:6/304: stat d1/d5/c19 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/370: dwrite d8/de/f78 [0,4194304] 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:3/370: dread d7/f9 [0,4194304] 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:1/271: write d0/d16/f2d [563703,88833] 0 2024-04-25T23:01:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/371: mknod d8/de/d12/d15/d68/c85 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/272: write d0/d2f/d4b/f56 [608020,114804] 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:7/326: getdents d3/da/d64 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:3/371: symlink d7/d26/d59/l82 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:2/227: creat d2/d3/d22/d23/d3a/f4d x:0 0 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:7/327: write d3/d1e/f4c [1553150,7293] 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:9/372: link d8/de/d12/d15/d2f/l71 d8/de/d44/d47/l86 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:2/228: chown d2/d3/d13/c46 22408 1 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:7/328: rmdir d3/da 39 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:9/373: symlink d8/de/d44/l87 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:4/369: dwrite d3/d19/f5a [0,4194304] 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:9/374: write d8/de/d12/d15/d2f/f6d [429637,2348] 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:4/370: chown d3/de 792 1 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:3/372: dread d7/d26/d27/d34/d1a/d28/f29 [0,4194304] 0 2024-04-25T23:01:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:5/351: dread d0/d2c/d39/d1c/d25/d4e/f58 [0,4194304] 0 2024-04-25T23:01:06.331 INFO:tasks.workunit.client.0.smithi043.stdout:9/375: rmdir d8/de/d44/d47/d6a 39 2024-04-25T23:01:06.331 INFO:tasks.workunit.client.0.smithi043.stdout:3/373: chown d7/d26/d2d/f36 10105236 1 2024-04-25T23:01:06.331 INFO:tasks.workunit.client.0.smithi043.stdout:4/371: dread d3/de/d46/f4b [0,4194304] 0 2024-04-25T23:01:06.331 INFO:tasks.workunit.client.0.smithi043.stdout:3/374: dwrite d7/d26/d27/d34/d1a/f5f [0,4194304] 0 2024-04-25T23:01:06.331 INFO:tasks.workunit.client.0.smithi043.stdout:3/375: chown d7/d26/d27/d34/d1a/l42 113336 1 2024-04-25T23:01:06.331 INFO:tasks.workunit.client.0.smithi043.stdout:1/273: dread d0/d16/f22 [0,4194304] 0 2024-04-25T23:01:06.331 INFO:tasks.workunit.client.0.smithi043.stdout:1/274: write d0/d2f/d4b/f56 [1610067,62806] 0 2024-04-25T23:01:06.333 INFO:tasks.workunit.client.0.smithi043.stdout:1/275: read d0/d9/f46 [1132827,16043] 0 2024-04-25T23:01:06.334 INFO:tasks.workunit.client.0.smithi043.stdout:1/276: mknod d0/d9/c5d 0 2024-04-25T23:01:06.335 INFO:tasks.workunit.client.0.smithi043.stdout:1/277: readlink d0/d3d/l47 0 2024-04-25T23:01:06.335 INFO:tasks.workunit.client.0.smithi043.stdout:1/278: unlink d0/d2f/d4b/f56 0 2024-04-25T23:01:06.335 INFO:tasks.workunit.client.0.smithi043.stdout:1/279: creat d0/d16/f5e x:0 0 0 2024-04-25T23:01:06.336 INFO:tasks.workunit.client.0.smithi043.stdout:1/280: link d0/l36 d0/d9/l5f 0 2024-04-25T23:01:06.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/329: fsync d3/d1e/f4c 0 2024-04-25T23:01:06.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/330: read d3/d1e/d1f/f24 [4120281,5871] 0 2024-04-25T23:01:06.345 INFO:tasks.workunit.client.0.smithi043.stdout:7/331: dread d3/d1e/f50 [0,4194304] 0 2024-04-25T23:01:06.346 INFO:tasks.workunit.client.0.smithi043.stdout:7/332: creat d3/f68 x:0 0 0 2024-04-25T23:01:06.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/333: dread d3/da/df/d11/d26/f43 [0,4194304] 0 2024-04-25T23:01:06.351 INFO:tasks.workunit.client.0.smithi043.stdout:7/334: read d3/da/f23 [905708,7026] 0 2024-04-25T23:01:06.352 INFO:tasks.workunit.client.0.smithi043.stdout:7/335: creat d3/d1e/f69 x:0 0 0 2024-04-25T23:01:06.356 INFO:tasks.workunit.client.0.smithi043.stdout:1/281: fsync d0/f2 0 2024-04-25T23:01:06.356 INFO:tasks.workunit.client.0.smithi043.stdout:8/217: write d3/d1d/f37 [3450403,101504] 0 2024-04-25T23:01:06.357 INFO:tasks.workunit.client.0.smithi043.stdout:2/229: chown d2/c4c 296159810 1 2024-04-25T23:01:06.357 INFO:tasks.workunit.client.0.smithi043.stdout:6/305: write d1/d5/fd [1259482,92152] 0 2024-04-25T23:01:06.357 INFO:tasks.workunit.client.0.smithi043.stdout:1/282: write d0/d16/f1b [1241058,109609] 0 2024-04-25T23:01:06.358 INFO:tasks.workunit.client.0.smithi043.stdout:7/336: dwrite d3/d1e/f4d [4194304,4194304] 0 2024-04-25T23:01:06.358 INFO:tasks.workunit.client.0.smithi043.stdout:1/283: read - d0/d3d/f50 zero size 2024-04-25T23:01:06.358 INFO:tasks.workunit.client.0.smithi043.stdout:2/230: unlink d2/d3/d22/d23/l1d 0 2024-04-25T23:01:06.358 INFO:tasks.workunit.client.0.smithi043.stdout:8/218: creat d3/d32/d2e/f46 x:0 0 0 2024-04-25T23:01:06.359 INFO:tasks.workunit.client.0.smithi043.stdout:6/306: chown d1/d5/d3b/d4c/d21/f24 12926 1 2024-04-25T23:01:06.359 INFO:tasks.workunit.client.0.smithi043.stdout:8/219: chown d3/d32/f1e 1593 1 2024-04-25T23:01:06.359 INFO:tasks.workunit.client.0.smithi043.stdout:9/376: dread d8/de/d12/d16/d24/f62 [0,4194304] 0 2024-04-25T23:01:06.360 INFO:tasks.workunit.client.0.smithi043.stdout:2/231: write d2/d3/d13/f32 [1125101,32020] 0 2024-04-25T23:01:06.360 INFO:tasks.workunit.client.0.smithi043.stdout:9/377: fdatasync d8/de/f10 0 2024-04-25T23:01:06.360 INFO:tasks.workunit.client.0.smithi043.stdout:7/337: rename d3/d1e/f4c to d3/d1e/d1f/f6a 0 2024-04-25T23:01:06.360 INFO:tasks.workunit.client.0.smithi043.stdout:6/307: chown d1/d5/d3b/d4c/d21/d38/l47 1 1 2024-04-25T23:01:06.361 INFO:tasks.workunit.client.0.smithi043.stdout:8/220: dread - d3/d4/db/d14/f19 zero size 2024-04-25T23:01:06.361 INFO:tasks.workunit.client.0.smithi043.stdout:7/338: dread - d3/da/f62 zero size 2024-04-25T23:01:06.362 INFO:tasks.workunit.client.0.smithi043.stdout:6/308: mknod d1/d5/d3b/d4c/d1a/c66 0 2024-04-25T23:01:06.362 INFO:tasks.workunit.client.0.smithi043.stdout:2/232: truncate d2/d3/d22/f26 532270 0 2024-04-25T23:01:06.363 INFO:tasks.workunit.client.0.smithi043.stdout:7/339: mkdir d3/d1e/d1f/d6b 0 2024-04-25T23:01:06.363 INFO:tasks.workunit.client.0.smithi043.stdout:8/221: mknod d3/d4/db/c47 0 2024-04-25T23:01:06.363 INFO:tasks.workunit.client.0.smithi043.stdout:6/309: creat d1/d5/f67 x:0 0 0 2024-04-25T23:01:06.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:06.365 INFO:tasks.workunit.client.0.smithi043.stdout:7/340: write d3/da/f23 [4466933,41294] 0 2024-04-25T23:01:06.365 INFO:tasks.workunit.client.0.smithi043.stdout:7/341: fsync d3/da/f44 0 2024-04-25T23:01:06.365 INFO:tasks.workunit.client.0.smithi043.stdout:7/342: chown d3/d1e/l4f 303667 1 2024-04-25T23:01:06.365 INFO:tasks.workunit.client.0.smithi043.stdout:9/378: dread d8/de/f3e [0,4194304] 0 2024-04-25T23:01:06.365 INFO:tasks.workunit.client.0.smithi043.stdout:9/379: stat d8/fd 0 2024-04-25T23:01:06.366 INFO:tasks.workunit.client.0.smithi043.stdout:7/343: chown d3/da/l10 125 1 2024-04-25T23:01:06.366 INFO:tasks.workunit.client.0.smithi043.stdout:9/380: unlink d8/de/d44/d65/f3c 0 2024-04-25T23:01:06.368 INFO:tasks.workunit.client.0.smithi043.stdout:3/376: truncate d7/d26/d27/f48 293220 0 2024-04-25T23:01:06.368 INFO:tasks.workunit.client.0.smithi043.stdout:9/381: getdents d8/de/d44/d47 0 2024-04-25T23:01:06.369 INFO:tasks.workunit.client.0.smithi043.stdout:3/377: write d7/d26/f5e [1609858,28472] 0 2024-04-25T23:01:06.372 INFO:tasks.workunit.client.0.smithi043.stdout:3/378: mknod d7/d26/c83 0 2024-04-25T23:01:06.372 INFO:tasks.workunit.client.0.smithi043.stdout:5/352: sync 2024-04-25T23:01:06.372 INFO:tasks.workunit.client.0.smithi043.stdout:0/305: dread f3 [0,4194304] 0 2024-04-25T23:01:06.374 INFO:tasks.workunit.client.0.smithi043.stdout:5/353: creat d0/d22/f7b x:0 0 0 2024-04-25T23:01:06.374 INFO:tasks.workunit.client.0.smithi043.stdout:1/284: dwrite d0/d16/f22 [0,4194304] 0 2024-04-25T23:01:06.374 INFO:tasks.workunit.client.0.smithi043.stdout:7/344: dwrite d3/d1e/f69 [0,4194304] 0 2024-04-25T23:01:06.375 INFO:tasks.workunit.client.0.smithi043.stdout:6/310: dread d1/d5/d3b/d4c/d1a/f2e [0,4194304] 0 2024-04-25T23:01:06.376 INFO:tasks.workunit.client.0.smithi043.stdout:9/382: dread d8/de/d12/d15/d2f/d84/d31/f3f [0,4194304] 0 2024-04-25T23:01:06.378 INFO:tasks.workunit.client.0.smithi043.stdout:7/345: rename d3/d1e/d41/f5d to d3/d52/f6c 0 2024-04-25T23:01:06.378 INFO:tasks.workunit.client.0.smithi043.stdout:5/354: creat d0/f7c x:0 0 0 2024-04-25T23:01:06.379 INFO:tasks.workunit.client.0.smithi043.stdout:6/311: dread - d1/d5/d3b/d4c/d21/d38/f59 zero size 2024-04-25T23:01:06.380 INFO:tasks.workunit.client.0.smithi043.stdout:6/312: fsync d1/d5/d14/f42 0 2024-04-25T23:01:06.380 INFO:tasks.workunit.client.0.smithi043.stdout:0/306: dread d1b/d23/d39/f4b [0,4194304] 0 2024-04-25T23:01:06.382 INFO:tasks.workunit.client.0.smithi043.stdout:3/379: dwrite d7/f20 [0,4194304] 0 2024-04-25T23:01:06.383 INFO:tasks.workunit.client.0.smithi043.stdout:1/285: dread d0/d16/f4a [0,4194304] 0 2024-04-25T23:01:06.385 INFO:tasks.workunit.client.0.smithi043.stdout:6/313: write d1/d5/d14/d30/f35 [889819,1843] 0 2024-04-25T23:01:06.385 INFO:tasks.workunit.client.0.smithi043.stdout:8/222: dread d3/d4/db/f2d [0,4194304] 0 2024-04-25T23:01:06.385 INFO:tasks.workunit.client.0.smithi043.stdout:0/307: symlink d1b/d55/l61 0 2024-04-25T23:01:06.385 INFO:tasks.workunit.client.0.smithi043.stdout:1/286: unlink d0/d16/c31 0 2024-04-25T23:01:06.387 INFO:tasks.workunit.client.0.smithi043.stdout:1/287: creat d0/d2f/f60 x:0 0 0 2024-04-25T23:01:06.388 INFO:tasks.workunit.client.0.smithi043.stdout:7/346: dwrite d3/da/df/f48 [0,4194304] 0 2024-04-25T23:01:06.388 INFO:tasks.workunit.client.0.smithi043.stdout:8/223: chown d3/d4/db/d14/d3e 14 1 2024-04-25T23:01:06.388 INFO:tasks.workunit.client.0.smithi043.stdout:0/308: rename d1b/d42/f4d to d1b/d55/d5e/f62 0 2024-04-25T23:01:06.389 INFO:tasks.workunit.client.0.smithi043.stdout:1/288: truncate d0/d2f/f60 530604 0 2024-04-25T23:01:06.389 INFO:tasks.workunit.client.0.smithi043.stdout:6/314: rename d1/d5/d14 to d1/d5/d3b/d4c/d21/d55/d68 0 2024-04-25T23:01:06.389 INFO:tasks.workunit.client.0.smithi043.stdout:5/355: dwrite d0/d2c/d39/d1c/d25/d7a/f6f [0,4194304] 0 2024-04-25T23:01:06.390 INFO:tasks.workunit.client.0.smithi043.stdout:8/224: dread - d3/d4/d36/f45 zero size 2024-04-25T23:01:06.392 INFO:tasks.workunit.client.0.smithi043.stdout:8/225: unlink d3/d4/db/df/d10/d33/f34 0 2024-04-25T23:01:06.393 INFO:tasks.workunit.client.0.smithi043.stdout:5/356: write d0/d2c/d39/f5b [692941,99011] 0 2024-04-25T23:01:06.393 INFO:tasks.workunit.client.0.smithi043.stdout:3/380: dread d7/d39/d52/f5d [0,4194304] 0 2024-04-25T23:01:06.393 INFO:tasks.workunit.client.0.smithi043.stdout:8/226: chown d3/cc 4735759 1 2024-04-25T23:01:06.394 INFO:tasks.workunit.client.0.smithi043.stdout:5/357: chown d0/d2c/d39/d63 211042 1 2024-04-25T23:01:06.394 INFO:tasks.workunit.client.0.smithi043.stdout:3/381: mknod d7/d26/d27/d34/d1a/d40/c84 0 2024-04-25T23:01:06.396 INFO:tasks.workunit.client.0.smithi043.stdout:5/358: creat d0/d2c/d39/d63/f7d x:0 0 0 2024-04-25T23:01:06.396 INFO:tasks.workunit.client.0.smithi043.stdout:8/227: getdents d3 0 2024-04-25T23:01:06.397 INFO:tasks.workunit.client.0.smithi043.stdout:8/228: creat d3/f48 x:0 0 0 2024-04-25T23:01:06.398 INFO:tasks.workunit.client.0.smithi043.stdout:6/315: dwrite d1/d5/d3b/f44 [0,4194304] 0 2024-04-25T23:01:06.400 INFO:tasks.workunit.client.0.smithi043.stdout:5/359: write d0/d2c/d39/d1c/d25/d7a/d41/d4a/f73 [232448,129908] 0 2024-04-25T23:01:06.401 INFO:tasks.workunit.client.0.smithi043.stdout:8/229: truncate d3/d4/db/d14/f2c 160373 0 2024-04-25T23:01:06.402 INFO:tasks.workunit.client.0.smithi043.stdout:6/316: rename d1/d5/d3b/d4c/d21/d55/d68/d30/f52 to d1/d5/d3b/d62/f69 0 2024-04-25T23:01:06.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/230: stat d3/d4/db/df/d10/c42 0 2024-04-25T23:01:06.403 INFO:tasks.workunit.client.0.smithi043.stdout:5/360: stat d0/d2c/d39/d1c/d5e/l57 0 2024-04-25T23:01:06.404 INFO:tasks.workunit.client.0.smithi043.stdout:8/231: unlink d3/c3c 0 2024-04-25T23:01:06.405 INFO:tasks.workunit.client.0.smithi043.stdout:1/289: dread d0/fa [0,4194304] 0 2024-04-25T23:01:06.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/382: dwrite d7/f2a [0,4194304] 0 2024-04-25T23:01:06.406 INFO:tasks.workunit.client.0.smithi043.stdout:5/361: truncate d0/d22/f6d 850178 0 2024-04-25T23:01:06.406 INFO:tasks.workunit.client.0.smithi043.stdout:8/232: unlink d3/d32/f2b 0 2024-04-25T23:01:06.407 INFO:tasks.workunit.client.0.smithi043.stdout:1/290: unlink d0/d9/f46 0 2024-04-25T23:01:06.408 INFO:tasks.workunit.client.0.smithi043.stdout:5/362: chown d0/d2c/d39/d1c/d25/d7a/d2d/l4b 0 1 2024-04-25T23:01:06.408 INFO:tasks.workunit.client.0.smithi043.stdout:1/291: write d0/d2f/f48 [433889,74926] 0 2024-04-25T23:01:06.409 INFO:tasks.workunit.client.0.smithi043.stdout:8/233: creat d3/d4/db/df/d10/d33/f49 x:0 0 0 2024-04-25T23:01:06.410 INFO:tasks.workunit.client.0.smithi043.stdout:5/363: rmdir d0/d2c/d39/d1c/d25/d7a/d41/d4a 39 2024-04-25T23:01:06.410 INFO:tasks.workunit.client.0.smithi043.stdout:6/317: dwrite d1/f53 [4194304,4194304] 0 2024-04-25T23:01:06.412 INFO:tasks.workunit.client.0.smithi043.stdout:5/364: rename d0/d2c/d39/d1c/d5e/l57 to d0/d2c/d39/d1c/l7e 0 2024-04-25T23:01:06.412 INFO:tasks.workunit.client.0.smithi043.stdout:1/292: getdents d0/d3d/d4f 0 2024-04-25T23:01:06.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/383: dread d8/de/d12/d16/f40 [0,4194304] 0 2024-04-25T23:01:06.412 INFO:tasks.workunit.client.0.smithi043.stdout:8/234: creat d3/d4/db/f4a x:0 0 0 2024-04-25T23:01:06.413 INFO:tasks.workunit.client.0.smithi043.stdout:9/384: rmdir d8/de/d12/d15 39 2024-04-25T23:01:06.413 INFO:tasks.workunit.client.0.smithi043.stdout:1/293: creat d0/d2f/f61 x:0 0 0 2024-04-25T23:01:06.415 INFO:tasks.workunit.client.0.smithi043.stdout:1/294: creat d0/d3c/f62 x:0 0 0 2024-04-25T23:01:06.415 INFO:tasks.workunit.client.0.smithi043.stdout:9/385: fsync d8/de/d12/d15/f17 0 2024-04-25T23:01:06.415 INFO:tasks.workunit.client.0.smithi043.stdout:8/235: rename d3/d4/db/df/d10/d33/f49 to d3/d4/db/f4b 0 2024-04-25T23:01:06.416 INFO:tasks.workunit.client.0.smithi043.stdout:1/295: truncate d0/d2f/f60 889015 0 2024-04-25T23:01:06.416 INFO:tasks.workunit.client.0.smithi043.stdout:9/386: fsync d8/de/d12/d16/f25 0 2024-04-25T23:01:06.417 INFO:tasks.workunit.client.0.smithi043.stdout:9/387: readlink d8/de/d44/d47/l7d 0 2024-04-25T23:01:06.419 INFO:tasks.workunit.client.0.smithi043.stdout:6/318: dwrite d1/d5/f3f [0,4194304] 0 2024-04-25T23:01:06.419 INFO:tasks.workunit.client.0.smithi043.stdout:9/388: stat d8/de/d12/d16/l1d 0 2024-04-25T23:01:06.421 INFO:tasks.workunit.client.0.smithi043.stdout:9/389: creat d8/de/d12/d15/d68/f88 x:0 0 0 2024-04-25T23:01:06.421 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:06.418+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:06.422 INFO:tasks.workunit.client.0.smithi043.stdout:6/319: truncate d1/d5/f1b 951743 0 2024-04-25T23:01:06.422 INFO:tasks.workunit.client.0.smithi043.stdout:9/390: creat d8/f89 x:0 0 0 2024-04-25T23:01:06.423 INFO:tasks.workunit.client.0.smithi043.stdout:5/365: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d4a/f73 [0,4194304] 0 2024-04-25T23:01:06.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/236: dwrite d3/d4/db/f4b [0,4194304] 0 2024-04-25T23:01:06.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/366: creat d0/d2c/f7f x:0 0 0 2024-04-25T23:01:06.427 INFO:tasks.workunit.client.0.smithi043.stdout:8/237: rename d3/d32/d2e/d44 to d3/d4/db/d14/d4c 0 2024-04-25T23:01:06.427 INFO:tasks.workunit.client.0.smithi043.stdout:0/309: dread d1b/d55/f5a [0,4194304] 0 2024-04-25T23:01:06.428 INFO:tasks.workunit.client.0.smithi043.stdout:0/310: readlink d1b/d31/l58 0 2024-04-25T23:01:06.429 INFO:tasks.workunit.client.0.smithi043.stdout:5/367: symlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/d60/l80 0 2024-04-25T23:01:06.430 INFO:tasks.workunit.client.0.smithi043.stdout:0/311: getdents d1b/d55/d5e 0 2024-04-25T23:01:06.431 INFO:tasks.workunit.client.0.smithi043.stdout:0/312: chown c16 0 1 2024-04-25T23:01:06.431 INFO:tasks.workunit.client.0.smithi043.stdout:5/368: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d47/d81 0 2024-04-25T23:01:06.433 INFO:tasks.workunit.client.0.smithi043.stdout:9/391: dwrite d8/de/d12/d16/f1f [0,4194304] 0 2024-04-25T23:01:06.433 INFO:tasks.workunit.client.0.smithi043.stdout:0/313: link d1b/d23/f4e d1b/d42/f63 0 2024-04-25T23:01:06.434 INFO:tasks.workunit.client.0.smithi043.stdout:0/314: write d1b/d31/d3c/f52 [396714,20488] 0 2024-04-25T23:01:06.435 INFO:tasks.workunit.client.0.smithi043.stdout:4/372: sync 2024-04-25T23:01:06.435 INFO:tasks.workunit.client.0.smithi043.stdout:5/369: truncate d0/d2c/d39/d1c/d25/d7a/d41/d4a/f73 4544582 0 2024-04-25T23:01:06.435 INFO:tasks.workunit.client.0.smithi043.stdout:0/315: creat d1b/d42/f64 x:0 0 0 2024-04-25T23:01:06.437 INFO:tasks.workunit.client.0.smithi043.stdout:4/373: chown d3/de/d27/d45/c51 22 1 2024-04-25T23:01:06.437 INFO:tasks.workunit.client.0.smithi043.stdout:5/370: dread - d0/d2c/d39/d1c/d25/d7a/d2d/f5a zero size 2024-04-25T23:01:06.437 INFO:tasks.workunit.client.0.smithi043.stdout:0/316: mknod d1b/d31/d3c/d50/c65 0 2024-04-25T23:01:06.437 INFO:tasks.workunit.client.0.smithi043.stdout:4/374: mkdir d3/d21/d6b/d87/d8a 0 2024-04-25T23:01:06.438 INFO:tasks.workunit.client.0.smithi043.stdout:5/371: creat d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/f82 x:0 0 0 2024-04-25T23:01:06.438 INFO:tasks.workunit.client.0.smithi043.stdout:4/375: creat d3/d21/d6b/d87/f8b x:0 0 0 2024-04-25T23:01:06.440 INFO:tasks.workunit.client.0.smithi043.stdout:4/376: getdents d3/d37 0 2024-04-25T23:01:06.441 INFO:tasks.workunit.client.0.smithi043.stdout:4/377: creat d3/d37/d4d/f8c x:0 0 0 2024-04-25T23:01:06.442 INFO:tasks.workunit.client.0.smithi043.stdout:3/383: dread d7/d26/d27/d34/f68 [0,4194304] 0 2024-04-25T23:01:06.442 INFO:tasks.workunit.client.0.smithi043.stdout:4/378: write d3/d37/d5b/f5e [2138079,27449] 0 2024-04-25T23:01:06.443 INFO:tasks.workunit.client.0.smithi043.stdout:3/384: read - d7/d26/d27/f80 zero size 2024-04-25T23:01:06.443 INFO:tasks.workunit.client.0.smithi043.stdout:3/385: stat d7/d26/d27/d34/f17 0 2024-04-25T23:01:06.444 INFO:tasks.workunit.client.0.smithi043.stdout:3/386: read d7/d32/f38 [182048,122373] 0 2024-04-25T23:01:06.445 INFO:tasks.workunit.client.0.smithi043.stdout:3/387: fsync d7/d26/d2d/f53 0 2024-04-25T23:01:06.445 INFO:tasks.workunit.client.0.smithi043.stdout:4/379: rename d3/de/d27/d45/f50 to d3/d19/f8d 0 2024-04-25T23:01:06.445 INFO:tasks.workunit.client.0.smithi043.stdout:4/380: fdatasync d3/d21/f3d 0 2024-04-25T23:01:06.447 INFO:tasks.workunit.client.0.smithi043.stdout:4/381: mkdir d3/d37/d5b/d8e 0 2024-04-25T23:01:06.447 INFO:tasks.workunit.client.0.smithi043.stdout:3/388: link d7/c31 d7/c85 0 2024-04-25T23:01:06.447 INFO:tasks.workunit.client.0.smithi043.stdout:7/347: dread d3/da/df/d11/d26/f49 [0,4194304] 0 2024-04-25T23:01:06.447 INFO:tasks.workunit.client.0.smithi043.stdout:3/389: fsync d7/d26/d27/d34/d1a/f1d 0 2024-04-25T23:01:06.448 INFO:tasks.workunit.client.0.smithi043.stdout:7/348: unlink d3/d52/f6c 0 2024-04-25T23:01:06.449 INFO:tasks.workunit.client.0.smithi043.stdout:3/390: link d7/d26/d59/f69 d7/d32/f86 0 2024-04-25T23:01:06.449 INFO:tasks.workunit.client.0.smithi043.stdout:9/392: dread d8/de/d12/d15/d2f/f2d [0,4194304] 0 2024-04-25T23:01:06.449 INFO:tasks.workunit.client.0.smithi043.stdout:3/391: chown d7/d26/d27/d34/d1a/c44 1088 1 2024-04-25T23:01:06.450 INFO:tasks.workunit.client.0.smithi043.stdout:9/393: chown d8/f89 454 1 2024-04-25T23:01:06.451 INFO:tasks.workunit.client.0.smithi043.stdout:3/392: getdents d7/d26/d59 0 2024-04-25T23:01:06.451 INFO:tasks.workunit.client.0.smithi043.stdout:9/394: truncate d8/de/d12/d16/f25 734648 0 2024-04-25T23:01:06.451 INFO:tasks.workunit.client.0.smithi043.stdout:5/372: read d0/d2c/d39/d1c/d25/d7a/d41/d47/f54 [2427880,57123] 0 2024-04-25T23:01:06.452 INFO:tasks.workunit.client.0.smithi043.stdout:9/395: creat d8/de/d44/d47/f8a x:0 0 0 2024-04-25T23:01:06.452 INFO:tasks.workunit.client.0.smithi043.stdout:5/373: write d0/d2c/f6b [219047,116381] 0 2024-04-25T23:01:06.453 INFO:tasks.workunit.client.0.smithi043.stdout:9/396: write d8/fd [2127583,57537] 0 2024-04-25T23:01:06.457 INFO:tasks.workunit.client.0.smithi043.stdout:3/393: dwrite d7/d26/d27/d34/f24 [0,4194304] 0 2024-04-25T23:01:06.458 INFO:tasks.workunit.client.0.smithi043.stdout:3/394: read - d7/d26/d27/d34/d1a/d28/f4c zero size 2024-04-25T23:01:06.459 INFO:tasks.workunit.client.0.smithi043.stdout:3/395: unlink d7/d26/d27/d34/d1a/d40/c75 0 2024-04-25T23:01:06.460 INFO:tasks.workunit.client.0.smithi043.stdout:3/396: chown d7/d26/d59/f7a 40360790 1 2024-04-25T23:01:06.460 INFO:tasks.workunit.client.0.smithi043.stdout:3/397: readlink d7/d26/d2d/l70 0 2024-04-25T23:01:06.462 INFO:tasks.workunit.client.0.smithi043.stdout:0/317: write d1b/d55/f5a [501967,10141] 0 2024-04-25T23:01:06.462 INFO:tasks.workunit.client.0.smithi043.stdout:3/398: mkdir d7/d39/d87 0 2024-04-25T23:01:06.462 INFO:tasks.workunit.client.0.smithi043.stdout:4/382: rename d3/d37/d5b to d3/de/d46/d6a/d8f 0 2024-04-25T23:01:06.462 INFO:tasks.workunit.client.0.smithi043.stdout:0/318: rename c16 to d1b/d23/c66 0 2024-04-25T23:01:06.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/399: rmdir d7/d26/d59 39 2024-04-25T23:01:06.463 INFO:tasks.workunit.client.0.smithi043.stdout:4/383: truncate d3/d21/f63 1608526 0 2024-04-25T23:01:06.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/319: creat d1b/d23/d39/f67 x:0 0 0 2024-04-25T23:01:06.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/400: mkdir d7/d26/d88 0 2024-04-25T23:01:06.463 INFO:tasks.workunit.client.0.smithi043.stdout:4/384: write d3/d21/d6b/f81 [218467,37371] 0 2024-04-25T23:01:06.464 INFO:tasks.workunit.client.0.smithi043.stdout:3/401: stat d7/d26/d27/d34/d1a/f1d 0 2024-04-25T23:01:06.464 INFO:tasks.workunit.client.0.smithi043.stdout:4/385: mknod d3/de/d46/d6a/c90 0 2024-04-25T23:01:06.464 INFO:tasks.workunit.client.0.smithi043.stdout:0/320: getdents d1b/d31/d3c 0 2024-04-25T23:01:06.465 INFO:tasks.workunit.client.0.smithi043.stdout:3/402: creat d7/d39/d52/f89 x:0 0 0 2024-04-25T23:01:06.466 INFO:tasks.workunit.client.0.smithi043.stdout:0/321: mknod d1b/d55/d5e/c68 0 2024-04-25T23:01:06.466 INFO:tasks.workunit.client.0.smithi043.stdout:3/403: chown d7/d26/d27/d56 5175 1 2024-04-25T23:01:06.466 INFO:tasks.workunit.client.0.smithi043.stdout:4/386: read d3/d21/f63 [1478491,107803] 0 2024-04-25T23:01:06.467 INFO:tasks.workunit.client.0.smithi043.stdout:4/387: mknod d3/d19/c91 0 2024-04-25T23:01:06.467 INFO:tasks.workunit.client.0.smithi043.stdout:3/404: write d7/d26/d27/d34/f24 [1348728,70441] 0 2024-04-25T23:01:06.471 INFO:tasks.workunit.client.0.smithi043.stdout:0/322: dwrite f8 [0,4194304] 0 2024-04-25T23:01:06.473 INFO:tasks.workunit.client.0.smithi043.stdout:3/405: fsync d7/d32/f86 0 2024-04-25T23:01:06.473 INFO:tasks.workunit.client.0.smithi043.stdout:5/374: dread d0/d2c/d39/d1c/d25/d7a/f44 [0,4194304] 0 2024-04-25T23:01:06.475 INFO:tasks.workunit.client.0.smithi043.stdout:5/375: chown d0/d2c/d39/d1c/d25/d7a/d2d/l4b 551416 1 2024-04-25T23:01:06.476 INFO:tasks.workunit.client.0.smithi043.stdout:3/406: truncate d7/d26/d27/d34/d1a/f1d 2438387 0 2024-04-25T23:01:06.477 INFO:tasks.workunit.client.0.smithi043.stdout:6/320: dread d1/d5/d3b/d62/f69 [8388608,4194304] 0 2024-04-25T23:01:06.477 INFO:tasks.workunit.client.0.smithi043.stdout:5/376: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/f83 x:0 0 0 2024-04-25T23:01:06.478 INFO:tasks.workunit.client.0.smithi043.stdout:3/407: rename d7/d39/d52/f60 to d7/d26/d27/d34/d1a/d40/f8a 0 2024-04-25T23:01:06.478 INFO:tasks.workunit.client.0.smithi043.stdout:5/377: chown d0/d2c/d39/d1c/f2b 0 1 2024-04-25T23:01:06.478 INFO:tasks.workunit.client.0.smithi043.stdout:3/408: symlink d7/d39/d52/l8b 0 2024-04-25T23:01:06.479 INFO:tasks.workunit.client.0.smithi043.stdout:3/409: write d7/d39/f4a [3638767,9638] 0 2024-04-25T23:01:06.480 INFO:tasks.workunit.client.0.smithi043.stdout:5/378: rename d0/d2c/d39/d1c/d25/d7a/l1f to d0/l84 0 2024-04-25T23:01:06.480 INFO:tasks.workunit.client.0.smithi043.stdout:3/410: mkdir d7/d26/d2d/d8c 0 2024-04-25T23:01:06.480 INFO:tasks.workunit.client.0.smithi043.stdout:3/411: rmdir d7 39 2024-04-25T23:01:06.481 INFO:tasks.workunit.client.0.smithi043.stdout:5/379: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85 0 2024-04-25T23:01:06.484 INFO:tasks.workunit.client.0.smithi043.stdout:6/321: dwrite d1/d5/d3b/d4c/d21/d55/d68/f36 [0,4194304] 0 2024-04-25T23:01:06.488 INFO:tasks.workunit.client.0.smithi043.stdout:6/322: dread d1/d5/d3b/d4c/d1a/f54 [0,4194304] 0 2024-04-25T23:01:06.489 INFO:tasks.workunit.client.0.smithi043.stdout:6/323: write d1/d5/d3b/f44 [4228960,104742] 0 2024-04-25T23:01:06.489 INFO:tasks.workunit.client.0.smithi043.stdout:3/412: dwrite d7/d26/d27/d34/f68 [0,4194304] 0 2024-04-25T23:01:06.489 INFO:tasks.workunit.client.0.smithi043.stdout:5/380: dwrite d0/d2c/d39/d1c/d25/f27 [4194304,4194304] 0 2024-04-25T23:01:06.490 INFO:tasks.workunit.client.0.smithi043.stdout:3/413: stat d7/d26/d27/d34/d1a/c23 0 2024-04-25T23:01:06.491 INFO:tasks.workunit.client.0.smithi043.stdout:5/381: creat d0/d2c/d39/d1c/d25/d7a/d41/f86 x:0 0 0 2024-04-25T23:01:06.491 INFO:tasks.workunit.client.0.smithi043.stdout:3/414: link d7/d32/d51/l6f d7/d32/d51/d5a/l8d 0 2024-04-25T23:01:06.492 INFO:tasks.workunit.client.0.smithi043.stdout:3/415: write d7/d26/d59/f7a [734684,94461] 0 2024-04-25T23:01:06.493 INFO:tasks.workunit.client.0.smithi043.stdout:3/416: creat d7/d26/d59/f8e x:0 0 0 2024-04-25T23:01:06.494 INFO:tasks.workunit.client.0.smithi043.stdout:0/323: dread f11 [0,4194304] 0 2024-04-25T23:01:06.494 INFO:tasks.workunit.client.0.smithi043.stdout:3/417: readlink d7/d26/d2d/l76 0 2024-04-25T23:01:06.495 INFO:tasks.workunit.client.0.smithi043.stdout:0/324: getdents d1b/d23 0 2024-04-25T23:01:06.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/325: fsync f1a 0 2024-04-25T23:01:06.497 INFO:tasks.workunit.client.0.smithi043.stdout:0/326: write d1b/d55/f5a [3098455,115997] 0 2024-04-25T23:01:06.497 INFO:tasks.workunit.client.0.smithi043.stdout:6/324: dwrite d1/d5/d3b/d62/f69 [8388608,4194304] 0 2024-04-25T23:01:06.501 INFO:tasks.workunit.client.0.smithi043.stdout:3/418: rename d7/d32 to d7/d26/d27/d34/d1a/d40/d8f 0 2024-04-25T23:01:06.502 INFO:tasks.workunit.client.0.smithi043.stdout:0/327: write d1b/d42/f63 [325142,108271] 0 2024-04-25T23:01:06.502 INFO:tasks.workunit.client.0.smithi043.stdout:6/325: write d1/d5/d3b/d4c/f10 [1531633,68246] 0 2024-04-25T23:01:06.503 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:06.503 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:06.503 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:06.503 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:06.503 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:06.504 INFO:tasks.workunit.client.0.smithi043.stdout:6/326: write d1/d5/d3b/d4c/d21/f48 [4366955,55523] 0 2024-04-25T23:01:06.505 INFO:tasks.workunit.client.0.smithi043.stdout:6/327: rmdir d1/d5/d3b/d4c/d21/d55/d68/d30 39 2024-04-25T23:01:06.506 INFO:tasks.workunit.client.0.smithi043.stdout:6/328: creat d1/f6a x:0 0 0 2024-04-25T23:01:06.509 INFO:tasks.workunit.client.0.smithi043.stdout:0/328: dwrite f11 [0,4194304] 0 2024-04-25T23:01:06.509 INFO:tasks.workunit.client.0.smithi043.stdout:3/419: dwrite d7/d26/d27/d34/d1a/d40/f8a [0,4194304] 0 2024-04-25T23:01:06.509 INFO:tasks.workunit.client.0.smithi043.stdout:0/329: readlink d1b/d23/l34 0 2024-04-25T23:01:06.510 INFO:tasks.workunit.client.0.smithi043.stdout:3/420: chown d7/d26/c2c 5061 1 2024-04-25T23:01:06.510 INFO:tasks.workunit.client.0.smithi043.stdout:0/330: dread - d1b/d31/f49 zero size 2024-04-25T23:01:06.513 INFO:tasks.workunit.client.0.smithi043.stdout:0/331: dread d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:06.514 INFO:tasks.workunit.client.0.smithi043.stdout:0/332: symlink d1b/d42/l69 0 2024-04-25T23:01:06.516 INFO:tasks.workunit.client.0.smithi043.stdout:3/421: write d7/d26/d27/d34/d1a/d40/d8f/f86 [442440,10607] 0 2024-04-25T23:01:06.518 INFO:tasks.workunit.client.0.smithi043.stdout:3/422: truncate d7/d26/d27/d34/d1a/d28/f63 643862 0 2024-04-25T23:01:06.519 INFO:tasks.workunit.client.0.smithi043.stdout:6/329: dwrite d1/d5/d3b/d4c/d1a/f54 [0,4194304] 0 2024-04-25T23:01:06.519 INFO:tasks.workunit.client.0.smithi043.stdout:3/423: rename d7/d26/d2d/c57 to d7/d26/d27/d34/d1a/d28/c90 0 2024-04-25T23:01:06.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/424: rename d7/d26/d27/f66 to d7/d26/d27/d56/f91 0 2024-04-25T23:01:06.522 INFO:tasks.workunit.client.0.smithi043.stdout:6/330: rename d1/d5/d3b/d4c/d21/f48 to d1/d5/d3b/d4c/f6b 0 2024-04-25T23:01:06.522 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:06.516+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:06.524 INFO:tasks.workunit.client.0.smithi043.stdout:3/425: mkdir d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/d92 0 2024-04-25T23:01:06.524 INFO:tasks.workunit.client.0.smithi043.stdout:3/426: write d7/d26/d59/f71 [388112,31969] 0 2024-04-25T23:01:06.524 INFO:tasks.workunit.client.0.smithi043.stdout:6/331: symlink d1/d5/d3b/d4c/d21/d55/d68/d30/l6c 0 2024-04-25T23:01:06.525 INFO:tasks.workunit.client.0.smithi043.stdout:3/427: fdatasync d7/f20 0 2024-04-25T23:01:06.526 INFO:tasks.workunit.client.0.smithi043.stdout:3/428: stat d7/d26/d27/d34/d1a/d40/d8f/f38 0 2024-04-25T23:01:06.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:06.527 INFO:tasks.workunit.client.0.smithi043.stdout:0/333: dread d1b/d23/d39/f46 [0,4194304] 0 2024-04-25T23:01:06.537 INFO:tasks.workunit.client.0.smithi043.stdout:0/334: dread d1b/f56 [0,4194304] 0 2024-04-25T23:01:06.538 INFO:tasks.workunit.client.0.smithi043.stdout:0/335: creat d1b/d31/d3c/f6a x:0 0 0 2024-04-25T23:01:06.538 INFO:tasks.workunit.client.0.smithi043.stdout:0/336: unlink d1b/c59 0 2024-04-25T23:01:06.539 INFO:tasks.workunit.client.0.smithi043.stdout:0/337: getdents d1b/d55 0 2024-04-25T23:01:06.540 INFO:tasks.workunit.client.0.smithi043.stdout:0/338: readlink d1b/d55/l61 0 2024-04-25T23:01:06.545 INFO:tasks.workunit.client.0.smithi043.stdout:3/429: dread d7/d26/d27/d34/d1a/f1e [0,4194304] 0 2024-04-25T23:01:06.546 INFO:tasks.workunit.client.0.smithi043.stdout:7/349: sync 2024-04-25T23:01:06.546 INFO:tasks.workunit.client.0.smithi043.stdout:8/238: sync 2024-04-25T23:01:06.546 INFO:tasks.workunit.client.0.smithi043.stdout:2/233: sync 2024-04-25T23:01:06.546 INFO:tasks.workunit.client.0.smithi043.stdout:1/296: sync 2024-04-25T23:01:06.547 INFO:tasks.workunit.client.0.smithi043.stdout:1/297: write d0/d9/f25 [1154091,653] 0 2024-04-25T23:01:06.547 INFO:tasks.workunit.client.0.smithi043.stdout:7/350: creat d3/d1e/d1f/d54/f6d x:0 0 0 2024-04-25T23:01:06.548 INFO:tasks.workunit.client.0.smithi043.stdout:1/298: mkdir d0/d9/d63 0 2024-04-25T23:01:06.548 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:06.548 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:06.549 INFO:tasks.workunit.client.0.smithi043.stdout:2/234: getdents d2/d3/d22 0 2024-04-25T23:01:06.549 INFO:tasks.workunit.client.0.smithi043.stdout:2/235: chown d2/d4b 439140 1 2024-04-25T23:01:06.549 INFO:tasks.workunit.client.0.smithi043.stdout:6/332: dread d1/d5/d3b/d4c/f28 [0,4194304] 0 2024-04-25T23:01:06.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/299: creat d0/d3d/d4f/f64 x:0 0 0 2024-04-25T23:01:06.550 INFO:tasks.workunit.client.0.smithi043.stdout:3/430: dread d7/d26/d27/f48 [0,4194304] 0 2024-04-25T23:01:06.550 INFO:tasks.workunit.client.0.smithi043.stdout:7/351: truncate d3/da/df/d11/d26/f43 1338247 0 2024-04-25T23:01:06.550 INFO:tasks.workunit.client.0.smithi043.stdout:1/300: chown d0/d2f/f48 14703 1 2024-04-25T23:01:06.551 INFO:tasks.workunit.client.0.smithi043.stdout:6/333: mkdir d1/d5/d3b/d4c/d21/d55/d6d 0 2024-04-25T23:01:06.551 INFO:tasks.workunit.client.0.smithi043.stdout:2/236: mknod d2/d3/d13/d40/c4e 0 2024-04-25T23:01:06.551 INFO:tasks.workunit.client.0.smithi043.stdout:1/301: fdatasync d0/d9/f25 0 2024-04-25T23:01:06.551 INFO:tasks.workunit.client.0.smithi043.stdout:6/334: unlink d1/f20 0 2024-04-25T23:01:06.552 INFO:tasks.workunit.client.0.smithi043.stdout:1/302: creat d0/d16/f65 x:0 0 0 2024-04-25T23:01:06.552 INFO:tasks.workunit.client.0.smithi043.stdout:3/431: symlink d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/l93 0 2024-04-25T23:01:06.552 INFO:tasks.workunit.client.0.smithi043.stdout:7/352: link d3/c3b d3/d1e/d1f/d54/c6e 0 2024-04-25T23:01:06.552 INFO:tasks.workunit.client.0.smithi043.stdout:1/303: fsync d0/f38 0 2024-04-25T23:01:06.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/432: chown d7/d26/d27/d34/d1a/d28/f4c 3 1 2024-04-25T23:01:06.553 INFO:tasks.workunit.client.0.smithi043.stdout:1/304: rename d0/f38 to d0/d16/f66 0 2024-04-25T23:01:06.554 INFO:tasks.workunit.client.0.smithi043.stdout:1/305: dread - d0/d2f/f61 zero size 2024-04-25T23:01:06.554 INFO:tasks.workunit.client.0.smithi043.stdout:2/237: read d2/d3/d22/fe [908557,90273] 0 2024-04-25T23:01:06.554 INFO:tasks.workunit.client.0.smithi043.stdout:3/433: mknod d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/c94 0 2024-04-25T23:01:06.556 INFO:tasks.workunit.client.0.smithi043.stdout:1/306: creat d0/f67 x:0 0 0 2024-04-25T23:01:06.556 INFO:tasks.workunit.client.0.smithi043.stdout:2/238: getdents d2/d3/d22/d23/d43 0 2024-04-25T23:01:06.557 INFO:tasks.workunit.client.0.smithi043.stdout:1/307: write d0/d3d/f30 [4804806,6394] 0 2024-04-25T23:01:06.557 INFO:tasks.workunit.client.0.smithi043.stdout:3/434: link d7/d26/d59/f69 d7/d26/f95 0 2024-04-25T23:01:06.557 INFO:tasks.workunit.client.0.smithi043.stdout:2/239: mkdir d2/d3/d13/d4f 0 2024-04-25T23:01:06.557 INFO:tasks.workunit.client.0.smithi043.stdout:3/435: fsync d7/d26/f3d 0 2024-04-25T23:01:06.558 INFO:tasks.workunit.client.0.smithi043.stdout:1/308: mknod d0/d3d/c68 0 2024-04-25T23:01:06.558 INFO:tasks.workunit.client.0.smithi043.stdout:6/335: dwrite d1/d5/f67 [0,4194304] 0 2024-04-25T23:01:06.559 INFO:tasks.workunit.client.0.smithi043.stdout:3/436: mknod d7/d39/d87/c96 0 2024-04-25T23:01:06.559 INFO:tasks.workunit.client.0.smithi043.stdout:1/309: dread - d0/d16/f66 zero size 2024-04-25T23:01:06.559 INFO:tasks.workunit.client.0.smithi043.stdout:2/240: write d2/d3/f42 [4271116,55034] 0 2024-04-25T23:01:06.560 INFO:tasks.workunit.client.0.smithi043.stdout:6/336: write d1/d5/f1d [1024782,108397] 0 2024-04-25T23:01:06.561 INFO:tasks.workunit.client.0.smithi043.stdout:6/337: chown d1/d2a/f5e 3189027 1 2024-04-25T23:01:06.564 INFO:tasks.workunit.client.0.smithi043.stdout:0/339: dread d1b/d42/f5b [0,4194304] 0 2024-04-25T23:01:06.564 INFO:tasks.workunit.client.0.smithi043.stdout:6/338: creat d1/d5/d3b/d4c/d21/d55/d68/d30/f6e x:0 0 0 2024-04-25T23:01:06.564 INFO:tasks.workunit.client.0.smithi043.stdout:7/353: truncate d3/d1e/d41/f4a 3659787 0 2024-04-25T23:01:06.564 INFO:tasks.workunit.client.0.smithi043.stdout:0/340: readlink d1b/d31/l58 0 2024-04-25T23:01:06.565 INFO:tasks.workunit.client.0.smithi043.stdout:7/354: dread - d3/d1e/d41/f66 zero size 2024-04-25T23:01:06.565 INFO:tasks.workunit.client.0.smithi043.stdout:0/341: readlink d1b/d55/l61 0 2024-04-25T23:01:06.567 INFO:tasks.workunit.client.0.smithi043.stdout:0/342: mknod d1b/c6b 0 2024-04-25T23:01:06.567 INFO:tasks.workunit.client.0.smithi043.stdout:3/437: dwrite d7/f65 [0,4194304] 0 2024-04-25T23:01:06.569 INFO:tasks.workunit.client.0.smithi043.stdout:2/241: dwrite d2/d3/d22/f26 [0,4194304] 0 2024-04-25T23:01:06.570 INFO:tasks.workunit.client.0.smithi043.stdout:8/239: dread d3/d4/f8 [4194304,4194304] 0 2024-04-25T23:01:06.570 INFO:tasks.workunit.client.0.smithi043.stdout:2/242: readlink d2/l20 0 2024-04-25T23:01:06.571 INFO:tasks.workunit.client.0.smithi043.stdout:2/243: dread - d2/d3/d22/f35 zero size 2024-04-25T23:01:06.571 INFO:tasks.workunit.client.0.smithi043.stdout:1/310: dread d0/f1a [0,4194304] 0 2024-04-25T23:01:06.574 INFO:tasks.workunit.client.0.smithi043.stdout:0/343: getdents d1b/d55 0 2024-04-25T23:01:06.575 INFO:tasks.workunit.client.0.smithi043.stdout:3/438: dwrite d7/f65 [0,4194304] 0 2024-04-25T23:01:06.576 INFO:tasks.workunit.client.0.smithi043.stdout:3/439: fsync d7/d26/d59/f72 0 2024-04-25T23:01:06.577 INFO:tasks.workunit.client.0.smithi043.stdout:1/311: read d0/d3d/f30 [3137334,117064] 0 2024-04-25T23:01:06.578 INFO:tasks.workunit.client.0.smithi043.stdout:3/440: dread - d7/d26/d27/d56/f91 zero size 2024-04-25T23:01:06.578 INFO:tasks.workunit.client.0.smithi043.stdout:1/312: fdatasync d0/d16/f4a 0 2024-04-25T23:01:06.579 INFO:tasks.workunit.client.0.smithi043.stdout:2/244: dwrite d2/d3e/f3f [0,4194304] 0 2024-04-25T23:01:06.579 INFO:tasks.workunit.client.0.smithi043.stdout:3/441: write d7/d26/d2d/f67 [322298,79618] 0 2024-04-25T23:01:06.579 INFO:tasks.workunit.client.0.smithi043.stdout:1/313: mkdir d0/d3d/d4f/d69 0 2024-04-25T23:01:06.580 INFO:tasks.workunit.client.0.smithi043.stdout:2/245: write d2/d3/d22/d23/f37 [714560,108297] 0 2024-04-25T23:01:06.581 INFO:tasks.workunit.client.0.smithi043.stdout:1/314: unlink d0/d9/l14 0 2024-04-25T23:01:06.582 INFO:tasks.workunit.client.0.smithi043.stdout:1/315: mknod d0/d3d/c6a 0 2024-04-25T23:01:06.582 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:06.583 INFO:tasks.workunit.client.0.smithi043.stdout:0/344: dwrite d1b/d42/f54 [0,4194304] 0 2024-04-25T23:01:06.583 INFO:tasks.workunit.client.0.smithi043.stdout:0/345: readlink l7 0 2024-04-25T23:01:06.585 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:06.586 INFO:tasks.workunit.client.0.smithi043.stdout:0/346: chown d1b/d23/d39/f4b 1 1 2024-04-25T23:01:06.589 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:06.590 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:06.590 INFO:tasks.workunit.client.0.smithi043.stdout:9/397: sync 2024-04-25T23:01:06.590 INFO:tasks.workunit.client.0.smithi043.stdout:5/382: sync 2024-04-25T23:01:06.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/388: sync 2024-04-25T23:01:06.590 INFO:tasks.workunit.client.0.smithi043.stdout:7/355: write d3/d1e/d41/f4a [3830038,13214] 0 2024-04-25T23:01:06.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/442: dwrite d7/d26/d27/d34/d1a/d28/f4c [0,4194304] 0 2024-04-25T23:01:06.592 INFO:tasks.workunit.client.0.smithi043.stdout:2/246: dwrite d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:06.593 INFO:tasks.workunit.client.0.smithi043.stdout:7/356: fsync d3/d1e/d1f/d54/f6d 0 2024-04-25T23:01:06.594 INFO:tasks.workunit.client.0.smithi043.stdout:4/389: readlink d3/l3e 0 2024-04-25T23:01:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:5/383: write d0/f35 [677001,79597] 0 2024-04-25T23:01:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:9/398: mknod d8/de/d12/d16/c8b 0 2024-04-25T23:01:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:8/240: dwrite d3/d4/db/f2d [0,4194304] 0 2024-04-25T23:01:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:7/357: dread - d3/f68 zero size 2024-04-25T23:01:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:2/247: symlink d2/d3/d13/d40/l50 0 2024-04-25T23:01:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:3/443: truncate d7/d39/d52/f89 540681 0 2024-04-25T23:01:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:1/316: dwrite d0/d16/f5e [0,4194304] 0 2024-04-25T23:01:06.596 INFO:tasks.workunit.client.0.smithi043.stdout:4/390: creat d3/d37/d4d/f92 x:0 0 0 2024-04-25T23:01:06.596 INFO:tasks.workunit.client.0.smithi043.stdout:7/358: dread - d3/d1e/d1f/d54/f6d zero size 2024-04-25T23:01:06.597 INFO:tasks.workunit.client.0.smithi043.stdout:1/317: write d0/f67 [138494,62264] 0 2024-04-25T23:01:06.598 INFO:tasks.workunit.client.0.smithi043.stdout:2/248: unlink d2/d3/d22/d23/c3c 0 2024-04-25T23:01:06.598 INFO:tasks.workunit.client.0.smithi043.stdout:0/347: write d1b/d23/f2a [1816751,5226] 0 2024-04-25T23:01:06.599 INFO:tasks.workunit.client.0.smithi043.stdout:8/241: mknod d3/d4/db/df/d10/c4d 0 2024-04-25T23:01:06.607 INFO:tasks.workunit.client.0.smithi043.stdout:5/384: dwrite d0/f5 [8388608,4194304] 0 2024-04-25T23:01:06.611 INFO:tasks.workunit.client.0.smithi043.stdout:2/249: dwrite d2/d3/f2c [0,4194304] 0 2024-04-25T23:01:06.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/399: dwrite d8/de/d44/d5d/d4f/f73 [0,4194304] 0 2024-04-25T23:01:06.612 INFO:tasks.workunit.client.0.smithi043.stdout:4/391: dwrite d3/f3c [0,4194304] 0 2024-04-25T23:01:06.613 INFO:tasks.workunit.client.0.smithi043.stdout:2/250: chown d2/d3/d13/l21 5 1 2024-04-25T23:01:06.613 INFO:tasks.workunit.client.0.smithi043.stdout:7/359: dwrite d3/d1e/d1f/f6a [0,4194304] 0 2024-04-25T23:01:06.613 INFO:tasks.workunit.client.0.smithi043.stdout:5/385: dread d0/d2c/d39/d1c/d25/d4e/f58 [0,4194304] 0 2024-04-25T23:01:06.613 INFO:tasks.workunit.client.0.smithi043.stdout:9/400: mkdir d8/de/d8c 0 2024-04-25T23:01:06.613 INFO:tasks.workunit.client.0.smithi043.stdout:0/348: dwrite d1b/f57 [0,4194304] 0 2024-04-25T23:01:06.614 INFO:tasks.workunit.client.0.smithi043.stdout:9/401: fdatasync d8/de/f79 0 2024-04-25T23:01:06.614 INFO:tasks.workunit.client.0.smithi043.stdout:7/360: mknod d3/d1e/d1f/c6f 0 2024-04-25T23:01:06.614 INFO:tasks.workunit.client.0.smithi043.stdout:5/386: creat d0/d2c/d39/d1c/d5e/f87 x:0 0 0 2024-04-25T23:01:06.615 INFO:tasks.workunit.client.0.smithi043.stdout:9/402: rename c3 to d8/de/d44/c8d 0 2024-04-25T23:01:06.615 INFO:tasks.workunit.client.0.smithi043.stdout:0/349: link d1b/f57 d1b/d31/f6c 0 2024-04-25T23:01:06.616 INFO:tasks.workunit.client.0.smithi043.stdout:9/403: rmdir d8/de/d12 39 2024-04-25T23:01:06.616 INFO:tasks.workunit.client.0.smithi043.stdout:5/387: chown d0/d2c/d39/d1c/l7e 3952 1 2024-04-25T23:01:06.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/388: creat d0/d2c/d39/f88 x:0 0 0 2024-04-25T23:01:06.618 INFO:tasks.workunit.client.0.smithi043.stdout:7/361: getdents d3/da/df/d11 0 2024-04-25T23:01:06.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/389: chown d0/d2c/d39/d63 6 1 2024-04-25T23:01:06.618 INFO:tasks.workunit.client.0.smithi043.stdout:7/362: chown d3/da/df/d11/c4b 346159056 1 2024-04-25T23:01:06.619 INFO:tasks.workunit.client.0.smithi043.stdout:5/390: unlink d0/d2c/d39/d1c/c21 0 2024-04-25T23:01:06.619 INFO:tasks.workunit.client.0.smithi043.stdout:7/363: write d3/f68 [334795,101598] 0 2024-04-25T23:01:06.620 INFO:tasks.workunit.client.0.smithi043.stdout:7/364: readlink d3/le 0 2024-04-25T23:01:06.621 INFO:tasks.workunit.client.0.smithi043.stdout:1/318: truncate d0/d16/f1b 2178183 0 2024-04-25T23:01:06.622 INFO:tasks.workunit.client.0.smithi043.stdout:7/365: truncate d3/d52/f60 699212 0 2024-04-25T23:01:06.623 INFO:tasks.workunit.client.0.smithi043.stdout:0/350: dwrite d1b/d31/d3c/d50/f5d [0,4194304] 0 2024-04-25T23:01:06.623 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:06.622+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:06.624 INFO:tasks.workunit.client.0.smithi043.stdout:1/319: rename d0/c2c to d0/d2f/d4b/c6b 0 2024-04-25T23:01:06.624 INFO:tasks.workunit.client.0.smithi043.stdout:2/251: read d2/d3/d13/d18/f19 [1981882,57806] 0 2024-04-25T23:01:06.624 INFO:tasks.workunit.client.0.smithi043.stdout:0/351: creat d1b/d55/f6d x:0 0 0 2024-04-25T23:01:06.624 INFO:tasks.workunit.client.0.smithi043.stdout:7/366: symlink d3/d1e/d41/d63/l70 0 2024-04-25T23:01:06.625 INFO:tasks.workunit.client.0.smithi043.stdout:1/320: creat d0/d3c/f6c x:0 0 0 2024-04-25T23:01:06.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/352: mknod d1b/d55/c6e 0 2024-04-25T23:01:06.627 INFO:tasks.workunit.client.0.smithi043.stdout:2/252: creat d2/d3/d13/d40/f51 x:0 0 0 2024-04-25T23:01:06.628 INFO:tasks.workunit.client.0.smithi043.stdout:7/367: write d3/d1e/f69 [199106,30032] 0 2024-04-25T23:01:06.628 INFO:tasks.workunit.client.0.smithi043.stdout:6/339: dread d1/d5/f7 [0,4194304] 0 2024-04-25T23:01:06.628 INFO:tasks.workunit.client.0.smithi043.stdout:2/253: creat d2/d3/d22/f52 x:0 0 0 2024-04-25T23:01:06.628 INFO:tasks.workunit.client.0.smithi043.stdout:6/340: mknod d1/d2a/c6f 0 2024-04-25T23:01:06.629 INFO:tasks.workunit.client.0.smithi043.stdout:7/368: write d3/da/f36 [5064237,116721] 0 2024-04-25T23:01:06.629 INFO:tasks.workunit.client.0.smithi043.stdout:5/391: dwrite d0/d22/f76 [0,4194304] 0 2024-04-25T23:01:06.629 INFO:tasks.workunit.client.0.smithi043.stdout:2/254: symlink d2/l53 0 2024-04-25T23:01:06.630 INFO:tasks.workunit.client.0.smithi043.stdout:5/392: chown d0/d2c/d39/d1c/d25/d7a/d2d/l4b 0 1 2024-04-25T23:01:06.633 INFO:tasks.workunit.client.0.smithi043.stdout:0/353: dread d1b/f57 [0,4194304] 0 2024-04-25T23:01:06.633 INFO:tasks.workunit.client.0.smithi043.stdout:0/354: getdents d1b/d42 0 2024-04-25T23:01:06.634 INFO:tasks.workunit.client.0.smithi043.stdout:6/341: dread d1/d5/d3b/d4c/d21/d55/d68/f36 [0,4194304] 0 2024-04-25T23:01:06.636 INFO:tasks.workunit.client.0.smithi043.stdout:4/392: read d3/d21/f25 [2393917,106486] 0 2024-04-25T23:01:06.636 INFO:tasks.workunit.client.0.smithi043.stdout:6/342: fsync d1/d5/d3b/d4c/d21/d38/f59 0 2024-04-25T23:01:06.637 INFO:tasks.workunit.client.0.smithi043.stdout:0/355: mknod d1b/d31/d3c/d50/c6f 0 2024-04-25T23:01:06.637 INFO:tasks.workunit.client.0.smithi043.stdout:0/356: creat d1b/d23/f70 x:0 0 0 2024-04-25T23:01:06.637 INFO:tasks.workunit.client.0.smithi043.stdout:6/343: creat d1/d5/d3b/d4c/d21/d55/d6d/f70 x:0 0 0 2024-04-25T23:01:06.637 INFO:tasks.workunit.client.0.smithi043.stdout:0/357: symlink d1b/d23/l71 0 2024-04-25T23:01:06.638 INFO:tasks.workunit.client.0.smithi043.stdout:6/344: read - d1/d5/d3b/d4c/d21/d55/d6d/f70 zero size 2024-04-25T23:01:06.639 INFO:tasks.workunit.client.0.smithi043.stdout:6/345: creat d1/d5/d3b/d4c/d21/d55/d57/f71 x:0 0 0 2024-04-25T23:01:06.640 INFO:tasks.workunit.client.0.smithi043.stdout:6/346: mknod d1/d5/d3b/d4c/d21/d55/d68/d30/c72 0 2024-04-25T23:01:06.641 INFO:tasks.workunit.client.0.smithi043.stdout:1/321: write d0/d9/f21 [4522078,53305] 0 2024-04-25T23:01:06.641 INFO:tasks.workunit.client.0.smithi043.stdout:5/393: dwrite d0/d22/f6d [0,4194304] 0 2024-04-25T23:01:06.642 INFO:tasks.workunit.client.0.smithi043.stdout:1/322: fsync d0/d3c/f62 0 2024-04-25T23:01:06.643 INFO:tasks.workunit.client.0.smithi043.stdout:2/255: creat d2/d3/d22/d23/d3a/f54 x:0 0 0 2024-04-25T23:01:06.643 INFO:tasks.workunit.client.0.smithi043.stdout:6/347: rename d1/d5/d3b/d4c/d21/d46/f4a to d1/d5/d3b/d62/f73 0 2024-04-25T23:01:06.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/323: chown d0/d3d/c29 47122739 1 2024-04-25T23:01:06.644 INFO:tasks.workunit.client.0.smithi043.stdout:5/394: mknod d0/d2c/d39/d1c/d25/d32/d62/c89 0 2024-04-25T23:01:06.645 INFO:tasks.workunit.client.0.smithi043.stdout:7/369: dwrite d3/da/df/d11/f2f [0,4194304] 0 2024-04-25T23:01:06.646 INFO:tasks.workunit.client.0.smithi043.stdout:7/370: fdatasync d3/d52/f60 0 2024-04-25T23:01:06.646 INFO:tasks.workunit.client.0.smithi043.stdout:7/371: chown d3/c53 3149017 1 2024-04-25T23:01:06.648 INFO:tasks.workunit.client.0.smithi043.stdout:5/395: creat d0/d2c/d39/d1c/d25/d7a/d2d/f8a x:0 0 0 2024-04-25T23:01:06.648 INFO:tasks.workunit.client.0.smithi043.stdout:7/372: rename d3/da/l30 to d3/da/df/d11/d26/l71 0 2024-04-25T23:01:06.648 INFO:tasks.workunit.client.0.smithi043.stdout:4/393: truncate d3/d19/f48 957283 0 2024-04-25T23:01:06.649 INFO:tasks.workunit.client.0.smithi043.stdout:4/394: dread - d3/d37/d4d/f52 zero size 2024-04-25T23:01:06.650 INFO:tasks.workunit.client.0.smithi043.stdout:6/348: dwrite d1/d5/d3b/d4c/f25 [0,4194304] 0 2024-04-25T23:01:06.651 INFO:tasks.workunit.client.0.smithi043.stdout:7/373: mkdir d3/d1e/d1f/d6b/d72 0 2024-04-25T23:01:06.651 INFO:tasks.workunit.client.0.smithi043.stdout:4/395: rename d3/d19/l4a to d3/de/d27/d5c/d67/l93 0 2024-04-25T23:01:06.652 INFO:tasks.workunit.client.0.smithi043.stdout:7/374: chown d3/d1e/d1f/d54/c6e 1815501183 1 2024-04-25T23:01:06.653 INFO:tasks.workunit.client.0.smithi043.stdout:4/396: rename d3/f28 to d3/d21/d6b/d87/d8a/f94 0 2024-04-25T23:01:06.653 INFO:tasks.workunit.client.0.smithi043.stdout:7/375: chown d3/da/d64/c65 8233741 1 2024-04-25T23:01:06.653 INFO:tasks.workunit.client.0.smithi043.stdout:4/397: mkdir d3/de/d46/d95 0 2024-04-25T23:01:06.654 INFO:tasks.workunit.client.0.smithi043.stdout:7/376: creat d3/d1e/d41/d63/f73 x:0 0 0 2024-04-25T23:01:06.655 INFO:tasks.workunit.client.0.smithi043.stdout:5/396: dwrite d0/d2c/d39/d1c/d25/d7a/f1e [0,4194304] 0 2024-04-25T23:01:06.655 INFO:tasks.workunit.client.0.smithi043.stdout:4/398: creat d3/f96 x:0 0 0 2024-04-25T23:01:06.657 INFO:tasks.workunit.client.0.smithi043.stdout:5/397: write d0/d22/f7b [567547,84607] 0 2024-04-25T23:01:06.657 INFO:tasks.workunit.client.0.smithi043.stdout:1/324: read d0/d16/f22 [2209501,42009] 0 2024-04-25T23:01:06.657 INFO:tasks.workunit.client.0.smithi043.stdout:0/358: truncate d1b/d31/d3c/f48 571166 0 2024-04-25T23:01:06.658 INFO:tasks.workunit.client.0.smithi043.stdout:2/256: write d2/d3/f34 [1275152,81806] 0 2024-04-25T23:01:06.658 INFO:tasks.workunit.client.0.smithi043.stdout:1/325: rename d0/f2e to d0/d16/f6d 0 2024-04-25T23:01:06.658 INFO:tasks.workunit.client.0.smithi043.stdout:0/359: mkdir d1b/d31/d3c/d72 0 2024-04-25T23:01:06.659 INFO:tasks.workunit.client.0.smithi043.stdout:2/257: fdatasync d2/fc 0 2024-04-25T23:01:06.659 INFO:tasks.workunit.client.0.smithi043.stdout:0/360: chown d1b/d31/f49 4609499 1 2024-04-25T23:01:06.660 INFO:tasks.workunit.client.0.smithi043.stdout:1/326: creat d0/d16/d5a/f6e x:0 0 0 2024-04-25T23:01:06.660 INFO:tasks.workunit.client.0.smithi043.stdout:6/349: dwrite d1/d5/d3b/d4c/f10 [0,4194304] 0 2024-04-25T23:01:06.661 INFO:tasks.workunit.client.0.smithi043.stdout:2/258: chown d2/d3/d13/d18/l1b 5759239 1 2024-04-25T23:01:06.662 INFO:tasks.workunit.client.0.smithi043.stdout:6/350: truncate d1/d5/d3b/d4c/d1a/f5a 908270 0 2024-04-25T23:01:06.662 INFO:tasks.workunit.client.0.smithi043.stdout:7/377: dread d3/da/df/d11/f2f [0,4194304] 0 2024-04-25T23:01:06.662 INFO:tasks.workunit.client.0.smithi043.stdout:0/361: creat d1b/d55/f73 x:0 0 0 2024-04-25T23:01:06.662 INFO:tasks.workunit.client.0.smithi043.stdout:5/398: getdents d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78 0 2024-04-25T23:01:06.662 INFO:tasks.workunit.client.0.smithi043.stdout:7/378: chown d3/d1e/d41 7957 1 2024-04-25T23:01:06.663 INFO:tasks.workunit.client.0.smithi043.stdout:2/259: rename d2/d3/c2e to d2/d3/d13/d40/c55 0 2024-04-25T23:01:06.663 INFO:tasks.workunit.client.0.smithi043.stdout:7/379: fsync d3/d1e/d41/f4a 0 2024-04-25T23:01:06.664 INFO:tasks.workunit.client.0.smithi043.stdout:7/380: write d3/d1e/d41/f4a [186574,117031] 0 2024-04-25T23:01:06.664 INFO:tasks.workunit.client.0.smithi043.stdout:7/381: rmdir d3/da/d64 39 2024-04-25T23:01:06.666 INFO:tasks.workunit.client.0.smithi043.stdout:7/382: rename d3/f21 to d3/da/df/d11/d26/f74 0 2024-04-25T23:01:06.666 INFO:tasks.workunit.client.0.smithi043.stdout:6/351: dread d1/d5/d3b/d4c/f28 [0,4194304] 0 2024-04-25T23:01:06.668 INFO:tasks.workunit.client.0.smithi043.stdout:6/352: chown d1/d5/d3b/d4c/f28 73 1 2024-04-25T23:01:06.668 INFO:tasks.workunit.client.0.smithi043.stdout:6/353: creat d1/d5/d3b/d4c/d21/d55/f74 x:0 0 0 2024-04-25T23:01:06.669 INFO:tasks.workunit.client.0.smithi043.stdout:6/354: write d1/d2a/f5e [375285,120796] 0 2024-04-25T23:01:06.670 INFO:tasks.workunit.client.0.smithi043.stdout:6/355: truncate d1/d5/f56 650187 0 2024-04-25T23:01:06.670 INFO:tasks.workunit.client.0.smithi043.stdout:7/383: getdents d3/d1e/d41/d63 0 2024-04-25T23:01:06.671 INFO:tasks.workunit.client.0.smithi043.stdout:7/384: mknod d3/d1e/d41/d63/c75 0 2024-04-25T23:01:06.671 INFO:tasks.workunit.client.0.smithi043.stdout:4/399: truncate d3/d21/d6b/d87/d8a/f94 4469958 0 2024-04-25T23:01:06.672 INFO:tasks.workunit.client.0.smithi043.stdout:7/385: unlink d3/da/c38 0 2024-04-25T23:01:06.672 INFO:tasks.workunit.client.0.smithi043.stdout:7/386: unlink d3/d1e/d1f/d54/f6d 0 2024-04-25T23:01:06.675 INFO:tasks.workunit.client.0.smithi043.stdout:2/260: chown d2/d3/d22/f52 42502 1 2024-04-25T23:01:06.675 INFO:tasks.workunit.client.0.smithi043.stdout:5/399: truncate d0/d2c/d39/d1c/d25/d4e/f58 324046 0 2024-04-25T23:01:06.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/387: link d3/d1e/d1f/d54/c6e d3/da/df/c76 0 2024-04-25T23:01:06.677 INFO:tasks.workunit.client.0.smithi043.stdout:7/388: fsync d3/da/df/f48 0 2024-04-25T23:01:06.678 INFO:tasks.workunit.client.0.smithi043.stdout:8/242: dread d3/d4/db/df/d10/f15 [0,4194304] 0 2024-04-25T23:01:06.678 INFO:tasks.workunit.client.0.smithi043.stdout:6/356: dwrite d1/d2a/f4e [0,4194304] 0 2024-04-25T23:01:06.678 INFO:tasks.workunit.client.0.smithi043.stdout:2/261: mknod d2/d3/d22/d48/c56 0 2024-04-25T23:01:06.679 INFO:tasks.workunit.client.0.smithi043.stdout:5/400: unlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/f69 0 2024-04-25T23:01:06.679 INFO:tasks.workunit.client.0.smithi043.stdout:4/400: dwrite d3/d37/f54 [4194304,4194304] 0 2024-04-25T23:01:06.680 INFO:tasks.workunit.client.0.smithi043.stdout:5/401: readlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/d60/l80 0 2024-04-25T23:01:06.683 INFO:tasks.workunit.client.0.smithi043.stdout:6/357: readlink d1/lb 0 2024-04-25T23:01:06.683 INFO:tasks.workunit.client.0.smithi043.stdout:2/262: creat d2/d3/d22/d23/f57 x:0 0 0 2024-04-25T23:01:06.684 INFO:tasks.workunit.client.0.smithi043.stdout:4/401: symlink d3/de/d46/d95/l97 0 2024-04-25T23:01:06.684 INFO:tasks.workunit.client.0.smithi043.stdout:2/263: chown d2 251977 1 2024-04-25T23:01:06.684 INFO:tasks.workunit.client.0.smithi043.stdout:5/402: rename d0/d2c/d39/d1c/d25/d32 to d0/d2c/d39/d1c/d25/d7a/d2d/d8b 0 2024-04-25T23:01:06.684 INFO:tasks.workunit.client.0.smithi043.stdout:2/264: fdatasync d2/d3/d22/f39 0 2024-04-25T23:01:06.686 INFO:tasks.workunit.client.0.smithi043.stdout:6/358: rename d1/d5/d3b/d4c/f10 to d1/d5/d3b/d4c/d21/d46/f75 0 2024-04-25T23:01:06.686 INFO:tasks.workunit.client.0.smithi043.stdout:5/403: truncate d0/f23 856963 0 2024-04-25T23:01:06.688 INFO:tasks.workunit.client.0.smithi043.stdout:8/243: dwrite d3/d4/d36/f45 [0,4194304] 0 2024-04-25T23:01:06.688 INFO:tasks.workunit.client.0.smithi043.stdout:6/359: stat d1/d5/d3b/d4c/f58 0 2024-04-25T23:01:06.689 INFO:tasks.workunit.client.0.smithi043.stdout:5/404: fsync d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fe 0 2024-04-25T23:01:06.690 INFO:tasks.workunit.client.0.smithi043.stdout:7/389: dwrite d3/da/df/d11/f15 [4194304,4194304] 0 2024-04-25T23:01:06.691 INFO:tasks.workunit.client.0.smithi043.stdout:4/402: dwrite d3/de/f13 [0,4194304] 0 2024-04-25T23:01:06.693 INFO:tasks.workunit.client.0.smithi043.stdout:8/244: rmdir d3/d32/d2e 39 2024-04-25T23:01:06.697 INFO:tasks.workunit.client.0.smithi043.stdout:6/360: dwrite d1/d5/f1d [0,4194304] 0 2024-04-25T23:01:06.697 INFO:tasks.workunit.client.0.smithi043.stdout:4/403: rename d3/d21/l3f to d3/d19/d34/d76/l98 0 2024-04-25T23:01:06.698 INFO:tasks.workunit.client.0.smithi043.stdout:8/245: mkdir d3/d4/db/d4e 0 2024-04-25T23:01:06.698 INFO:tasks.workunit.client.0.smithi043.stdout:3/444: sync 2024-04-25T23:01:06.698 INFO:tasks.workunit.client.0.smithi043.stdout:0/362: sync 2024-04-25T23:01:06.699 INFO:tasks.workunit.client.0.smithi043.stdout:5/405: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d4a/f73 [4194304,4194304] 0 2024-04-25T23:01:06.699 INFO:tasks.workunit.client.0.smithi043.stdout:7/390: dwrite d3/da/df/f48 [4194304,4194304] 0 2024-04-25T23:01:06.699 INFO:tasks.workunit.client.0.smithi043.stdout:8/246: mknod d3/d4/db/df/d10/c4f 0 2024-04-25T23:01:06.703 INFO:tasks.workunit.client.0.smithi043.stdout:3/445: mkdir d7/d26/d97 0 2024-04-25T23:01:06.703 INFO:tasks.workunit.client.0.smithi043.stdout:8/247: mknod d3/c50 0 2024-04-25T23:01:06.703 INFO:tasks.workunit.client.0.smithi043.stdout:4/404: getdents d3/de/d27/d5c 0 2024-04-25T23:01:06.704 INFO:tasks.workunit.client.0.smithi043.stdout:8/248: readlink d3/d4/db/l21 0 2024-04-25T23:01:06.704 INFO:tasks.workunit.client.0.smithi043.stdout:4/405: stat d3/f96 0 2024-04-25T23:01:06.705 INFO:tasks.workunit.client.0.smithi043.stdout:3/446: creat d7/d39/f98 x:0 0 0 2024-04-25T23:01:06.705 INFO:tasks.workunit.client.0.smithi043.stdout:1/327: dread d0/d16/f1b [0,4194304] 0 2024-04-25T23:01:06.707 INFO:tasks.workunit.client.0.smithi043.stdout:2/265: truncate d2/d3e/f3f 1123836 0 2024-04-25T23:01:06.707 INFO:tasks.workunit.client.0.smithi043.stdout:3/447: write d7/f9 [199204,128976] 0 2024-04-25T23:01:06.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/328: getdents d0/d3d/d4f/d69 0 2024-04-25T23:01:06.709 INFO:tasks.workunit.client.0.smithi043.stdout:5/406: dwrite d0/d2c/d39/d1c/d25/f27 [0,4194304] 0 2024-04-25T23:01:06.709 INFO:tasks.workunit.client.0.smithi043.stdout:6/361: dwrite d1/d5/d3b/d4c/d1a/f5a [0,4194304] 0 2024-04-25T23:01:06.709 INFO:tasks.workunit.client.0.smithi043.stdout:2/266: write d2/d3/d22/d23/f37 [1254223,108064] 0 2024-04-25T23:01:06.710 INFO:tasks.workunit.client.0.smithi043.stdout:8/249: dread d3/d4/db/d14/f41 [0,4194304] 0 2024-04-25T23:01:06.711 INFO:tasks.workunit.client.0.smithi043.stdout:5/407: readlink d0/d22/l66 0 2024-04-25T23:01:06.711 INFO:tasks.workunit.client.0.smithi043.stdout:1/329: mknod d0/d9/d63/c6f 0 2024-04-25T23:01:06.711 INFO:tasks.workunit.client.0.smithi043.stdout:3/448: chown d7/d26/d27/d34/c1f 123 1 2024-04-25T23:01:06.712 INFO:tasks.workunit.client.0.smithi043.stdout:8/250: mknod d3/c51 0 2024-04-25T23:01:06.712 INFO:tasks.workunit.client.0.smithi043.stdout:6/362: getdents d1/d5/d3b/d4c/d21/d55 0 2024-04-25T23:01:06.712 INFO:tasks.workunit.client.0.smithi043.stdout:2/267: truncate d2/d3/f2f 2075535 0 2024-04-25T23:01:06.712 INFO:tasks.workunit.client.0.smithi043.stdout:8/251: rmdir d3/d4 39 2024-04-25T23:01:06.712 INFO:tasks.workunit.client.0.smithi043.stdout:3/449: write d7/d26/d2d/f67 [781359,55981] 0 2024-04-25T23:01:06.714 INFO:tasks.workunit.client.0.smithi043.stdout:0/363: write d1b/d31/d3c/f48 [974054,85411] 0 2024-04-25T23:01:06.714 INFO:tasks.workunit.client.0.smithi043.stdout:6/363: link d1/f6a d1/d2a/f76 0 2024-04-25T23:01:06.715 INFO:tasks.workunit.client.0.smithi043.stdout:6/364: chown d1/d5/f67 55159344 1 2024-04-25T23:01:06.715 INFO:tasks.workunit.client.0.smithi043.stdout:5/408: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/d8c 0 2024-04-25T23:01:06.715 INFO:tasks.workunit.client.0.smithi043.stdout:6/365: stat d1/d5/d3b 0 2024-04-25T23:01:06.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/366: creat d1/d5/d3b/d4c/f77 x:0 0 0 2024-04-25T23:01:06.718 INFO:tasks.workunit.client.0.smithi043.stdout:1/330: dwrite d0/d9/f44 [0,4194304] 0 2024-04-25T23:01:06.718 INFO:tasks.workunit.client.0.smithi043.stdout:3/450: dread d7/d26/d27/d34/d1a/d40/d8f/f38 [0,4194304] 0 2024-04-25T23:01:06.718 INFO:tasks.workunit.client.0.smithi043.stdout:5/409: truncate d0/d2c/d39/d1c/d25/d7a/d41/d47/f54 4758222 0 2024-04-25T23:01:06.719 INFO:tasks.workunit.client.0.smithi043.stdout:6/367: creat d1/f78 x:0 0 0 2024-04-25T23:01:06.719 INFO:tasks.workunit.client.0.smithi043.stdout:3/451: creat d7/d26/d2d/f99 x:0 0 0 2024-04-25T23:01:06.719 INFO:tasks.workunit.client.0.smithi043.stdout:7/391: truncate d3/da/f23 486907 0 2024-04-25T23:01:06.720 INFO:tasks.workunit.client.0.smithi043.stdout:6/368: fdatasync d1/d5/d3b/d4c/d21/f4f 0 2024-04-25T23:01:06.720 INFO:tasks.workunit.client.0.smithi043.stdout:5/410: unlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/f73 0 2024-04-25T23:01:06.720 INFO:tasks.workunit.client.0.smithi043.stdout:6/369: stat d1/d5/d3b/d62/f73 0 2024-04-25T23:01:06.721 INFO:tasks.workunit.client.0.smithi043.stdout:5/411: symlink d0/d2c/d39/d1c/d25/d7a/d41/l8d 0 2024-04-25T23:01:06.722 INFO:tasks.workunit.client.0.smithi043.stdout:5/412: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/f8e x:0 0 0 2024-04-25T23:01:06.724 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:06.722+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:06.725 INFO:tasks.workunit.client.0.smithi043.stdout:7/392: dwrite d3/da/f36 [0,4194304] 0 2024-04-25T23:01:06.727 INFO:tasks.workunit.client.0.smithi043.stdout:7/393: creat d3/d1e/d1f/d6b/d72/f77 x:0 0 0 2024-04-25T23:01:06.728 INFO:tasks.workunit.client.0.smithi043.stdout:6/370: dread d1/d5/f56 [0,4194304] 0 2024-04-25T23:01:06.728 INFO:tasks.workunit.client.0.smithi043.stdout:6/371: rmdir d1/d5/d3b/d4c 39 2024-04-25T23:01:06.729 INFO:tasks.workunit.client.0.smithi043.stdout:3/452: read d7/f18 [4007930,118074] 0 2024-04-25T23:01:06.730 INFO:tasks.workunit.client.0.smithi043.stdout:3/453: unlink d7/d26/d27/d34/d1a/f1e 0 2024-04-25T23:01:06.730 INFO:tasks.workunit.client.0.smithi043.stdout:6/372: mkdir d1/d5/d3b/d62/d79 0 2024-04-25T23:01:06.732 INFO:tasks.workunit.client.0.smithi043.stdout:6/373: dread - d1/d5/d3b/d4c/d21/d55/f74 zero size 2024-04-25T23:01:06.732 INFO:tasks.workunit.client.0.smithi043.stdout:3/454: link d7/d26/d59/f7a d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f9a 0 2024-04-25T23:01:06.734 INFO:tasks.workunit.client.0.smithi043.stdout:6/374: link d1/d2a/f5e d1/d5/d3b/f7a 0 2024-04-25T23:01:06.734 INFO:tasks.workunit.client.0.smithi043.stdout:7/394: dwrite d3/d1e/d1f/f51 [0,4194304] 0 2024-04-25T23:01:06.734 INFO:tasks.workunit.client.0.smithi043.stdout:9/404: sync 2024-04-25T23:01:06.735 INFO:tasks.workunit.client.0.smithi043.stdout:2/268: sync 2024-04-25T23:01:06.735 INFO:tasks.workunit.client.0.smithi043.stdout:0/364: sync 2024-04-25T23:01:06.735 INFO:tasks.workunit.client.0.smithi043.stdout:2/269: stat d2/d3 0 2024-04-25T23:01:06.735 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:06.735 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:06.737 INFO:tasks.workunit.client.0.smithi043.stdout:0/365: fsync d1b/d31/d3c/f43 0 2024-04-25T23:01:06.738 INFO:tasks.workunit.client.0.smithi043.stdout:2/270: rmdir d2/d3/d22/d23/d3a 39 2024-04-25T23:01:06.739 INFO:tasks.workunit.client.0.smithi043.stdout:0/366: fdatasync d1b/d55/f5a 0 2024-04-25T23:01:06.739 INFO:tasks.workunit.client.0.smithi043.stdout:6/375: rename d1/d5/d3b/d4c/d21/l2f to d1/d5/l7b 0 2024-04-25T23:01:06.740 INFO:tasks.workunit.client.0.smithi043.stdout:2/271: write d2/d3/f42 [3857069,99043] 0 2024-04-25T23:01:06.740 INFO:tasks.workunit.client.0.smithi043.stdout:6/376: rename d1 to d1/d5/d7c 22 2024-04-25T23:01:06.740 INFO:tasks.workunit.client.0.smithi043.stdout:3/455: dread d7/d26/d59/f7a [0,4194304] 0 2024-04-25T23:01:06.740 INFO:tasks.workunit.client.0.smithi043.stdout:0/367: write d1b/d42/f63 [572652,29981] 0 2024-04-25T23:01:06.740 INFO:tasks.workunit.client.0.smithi043.stdout:7/395: dread d3/da/df/d11/f2f [0,4194304] 0 2024-04-25T23:01:06.741 INFO:tasks.workunit.client.0.smithi043.stdout:3/456: fdatasync d7/d26/d27/f80 0 2024-04-25T23:01:06.741 INFO:tasks.workunit.client.0.smithi043.stdout:6/377: write d1/d2a/f5e [361002,50596] 0 2024-04-25T23:01:06.742 INFO:tasks.workunit.client.0.smithi043.stdout:6/378: chown d1/d5/f7 5574 1 2024-04-25T23:01:06.742 INFO:tasks.workunit.client.0.smithi043.stdout:3/457: symlink d7/d39/d52/l9b 0 2024-04-25T23:01:06.742 INFO:tasks.workunit.client.0.smithi043.stdout:2/272: truncate d2/d3/d22/d23/d3a/f4d 230840 0 2024-04-25T23:01:06.743 INFO:tasks.workunit.client.0.smithi043.stdout:0/368: getdents d1b/d23/d39 0 2024-04-25T23:01:06.743 INFO:tasks.workunit.client.0.smithi043.stdout:7/396: dread d3/da/df/f3f [0,4194304] 0 2024-04-25T23:01:06.744 INFO:tasks.workunit.client.0.smithi043.stdout:3/458: symlink d7/d26/d27/d34/l9c 0 2024-04-25T23:01:06.745 INFO:tasks.workunit.client.0.smithi043.stdout:0/369: symlink d1b/d23/l74 0 2024-04-25T23:01:06.745 INFO:tasks.workunit.client.0.smithi043.stdout:7/397: dread d3/da/df/f3f [0,4194304] 0 2024-04-25T23:01:06.745 INFO:tasks.workunit.client.0.smithi043.stdout:8/252: dread d3/d4/db/df/d10/f3b [0,4194304] 0 2024-04-25T23:01:06.746 INFO:tasks.workunit.client.0.smithi043.stdout:2/273: getdents d2/d3/d22/d23 0 2024-04-25T23:01:06.747 INFO:tasks.workunit.client.0.smithi043.stdout:7/398: chown d3/d1e/f4d 1 1 2024-04-25T23:01:06.747 INFO:tasks.workunit.client.0.smithi043.stdout:4/406: dread d3/f5 [0,4194304] 0 2024-04-25T23:01:06.748 INFO:tasks.workunit.client.0.smithi043.stdout:2/274: write d2/d3/f2c [4542568,3333] 0 2024-04-25T23:01:06.748 INFO:tasks.workunit.client.0.smithi043.stdout:7/399: mkdir d3/da/d78 0 2024-04-25T23:01:06.749 INFO:tasks.workunit.client.0.smithi043.stdout:4/407: creat d3/de/d46/d95/f99 x:0 0 0 2024-04-25T23:01:06.749 INFO:tasks.workunit.client.0.smithi043.stdout:1/331: dread d0/f26 [0,4194304] 0 2024-04-25T23:01:06.751 INFO:tasks.workunit.client.0.smithi043.stdout:2/275: write d2/d3/d22/f52 [144457,75070] 0 2024-04-25T23:01:06.752 INFO:tasks.workunit.client.0.smithi043.stdout:4/408: chown d3/de/d27/d45/c66 123498 1 2024-04-25T23:01:06.753 INFO:tasks.workunit.client.0.smithi043.stdout:3/459: write d7/d26/d27/d34/d1a/f1d [471037,15976] 0 2024-04-25T23:01:06.753 INFO:tasks.workunit.client.0.smithi043.stdout:7/400: mkdir d3/da/df/d79 0 2024-04-25T23:01:06.754 INFO:tasks.workunit.client.0.smithi043.stdout:4/409: unlink d3/de/l2c 0 2024-04-25T23:01:06.754 INFO:tasks.workunit.client.0.smithi043.stdout:1/332: write d0/f1a [748196,29599] 0 2024-04-25T23:01:06.754 INFO:tasks.workunit.client.0.smithi043.stdout:6/379: dwrite d1/d5/d3b/d62/f69 [0,4194304] 0 2024-04-25T23:01:06.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/370: dread d1b/f37 [0,4194304] 0 2024-04-25T23:01:06.755 INFO:tasks.workunit.client.0.smithi043.stdout:5/413: dread d0/f17 [0,4194304] 0 2024-04-25T23:01:06.755 INFO:tasks.workunit.client.0.smithi043.stdout:7/401: read d3/d1e/f69 [1164238,16691] 0 2024-04-25T23:01:06.756 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:06.756 INFO:tasks.workunit.client.0.smithi043.stdout:8/253: dwrite d3/d4/db/f4a [0,4194304] 0 2024-04-25T23:01:06.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/276: fsync d2/d3e/f3f 0 2024-04-25T23:01:06.757 INFO:tasks.workunit.client.0.smithi043.stdout:1/333: dread d0/d2f/f60 [0,4194304] 0 2024-04-25T23:01:06.757 INFO:tasks.workunit.client.0.smithi043.stdout:9/405: dread d8/de/d12/d15/d2f/f2d [0,4194304] 0 2024-04-25T23:01:06.759 INFO:tasks.workunit.client.0.smithi043.stdout:0/371: symlink d1b/d42/l75 0 2024-04-25T23:01:06.759 INFO:tasks.workunit.client.0.smithi043.stdout:4/410: mkdir d3/d21/d6b/d87/d9a 0 2024-04-25T23:01:06.759 INFO:tasks.workunit.client.0.smithi043.stdout:3/460: rename d7/d26/f41 to d7/d39/d87/f9d 0 2024-04-25T23:01:06.760 INFO:tasks.workunit.client.0.smithi043.stdout:9/406: write d8/de/d12/d15/f17 [6852551,100116] 0 2024-04-25T23:01:06.760 INFO:tasks.workunit.client.0.smithi043.stdout:6/380: write d1/d5/f3f [4765138,106784] 0 2024-04-25T23:01:06.760 INFO:tasks.workunit.client.0.smithi043.stdout:7/402: creat d3/d1e/d41/f7a x:0 0 0 2024-04-25T23:01:06.760 INFO:tasks.workunit.client.0.smithi043.stdout:1/334: rmdir d0/d3d 39 2024-04-25T23:01:06.760 INFO:tasks.workunit.client.0.smithi043.stdout:2/277: write d2/d3/f27 [5205096,96920] 0 2024-04-25T23:01:06.761 INFO:tasks.workunit.client.0.smithi043.stdout:5/414: rename d0/d2c/d39/l3f to d0/d6a/l8f 0 2024-04-25T23:01:06.761 INFO:tasks.workunit.client.0.smithi043.stdout:4/411: mkdir d3/d21/d9b 0 2024-04-25T23:01:06.761 INFO:tasks.workunit.client.0.smithi043.stdout:9/407: unlink d8/f55 0 2024-04-25T23:01:06.762 INFO:tasks.workunit.client.0.smithi043.stdout:3/461: write d7/d26/d27/d34/d1a/d40/d8f/f3e [94998,72859] 0 2024-04-25T23:01:06.763 INFO:tasks.workunit.client.0.smithi043.stdout:5/415: write d0/d2c/d39/d1c/d25/d7a/d2d/f8a [59140,62099] 0 2024-04-25T23:01:06.763 INFO:tasks.workunit.client.0.smithi043.stdout:1/335: write d0/d3c/f6c [91061,54336] 0 2024-04-25T23:01:06.764 INFO:tasks.workunit.client.0.smithi043.stdout:7/403: creat d3/f7b x:0 0 0 2024-04-25T23:01:06.764 INFO:tasks.workunit.client.0.smithi043.stdout:9/408: mknod d8/de/d44/c8e 0 2024-04-25T23:01:06.765 INFO:tasks.workunit.client.0.smithi043.stdout:3/462: write d7/d26/d2d/f67 [156362,122444] 0 2024-04-25T23:01:06.765 INFO:tasks.workunit.client.0.smithi043.stdout:2/278: fdatasync d2/d3/d22/f49 0 2024-04-25T23:01:06.765 INFO:tasks.workunit.client.0.smithi043.stdout:5/416: creat d0/d6a/f90 x:0 0 0 2024-04-25T23:01:06.766 INFO:tasks.workunit.client.0.smithi043.stdout:8/254: dwrite d3/d4/d36/f45 [0,4194304] 0 2024-04-25T23:01:06.767 INFO:tasks.workunit.client.0.smithi043.stdout:1/336: creat d0/d16/d5a/d5b/f70 x:0 0 0 2024-04-25T23:01:06.768 INFO:tasks.workunit.client.0.smithi043.stdout:2/279: fsync d2/d3/d22/d23/f37 0 2024-04-25T23:01:06.768 INFO:tasks.workunit.client.0.smithi043.stdout:9/409: read - d8/de/d12/d15/d68/f88 zero size 2024-04-25T23:01:06.769 INFO:tasks.workunit.client.0.smithi043.stdout:5/417: write d0/f5 [8924954,78611] 0 2024-04-25T23:01:06.770 INFO:tasks.workunit.client.0.smithi043.stdout:2/280: stat d2/d3/d13 0 2024-04-25T23:01:06.770 INFO:tasks.workunit.client.0.smithi043.stdout:8/255: symlink d3/d4/db/d4e/l52 0 2024-04-25T23:01:06.772 INFO:tasks.workunit.client.0.smithi043.stdout:0/372: dwrite d1b/d23/d39/f4b [0,4194304] 0 2024-04-25T23:01:06.773 INFO:tasks.workunit.client.0.smithi043.stdout:1/337: link d0/d16/f23 d0/d2f/f71 0 2024-04-25T23:01:06.774 INFO:tasks.workunit.client.0.smithi043.stdout:3/463: getdents d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/d92 0 2024-04-25T23:01:06.774 INFO:tasks.workunit.client.0.smithi043.stdout:4/412: dwrite d3/d21/f59 [0,4194304] 0 2024-04-25T23:01:06.774 INFO:tasks.workunit.client.0.smithi043.stdout:1/338: rmdir d0 39 2024-04-25T23:01:06.775 INFO:tasks.workunit.client.0.smithi043.stdout:0/373: symlink d1b/d31/d3c/d50/l76 0 2024-04-25T23:01:06.775 INFO:tasks.workunit.client.0.smithi043.stdout:2/281: mknod d2/d3/d22/d23/d43/c58 0 2024-04-25T23:01:06.775 INFO:tasks.workunit.client.0.smithi043.stdout:4/413: creat d3/d37/d7a/f9c x:0 0 0 2024-04-25T23:01:06.776 INFO:tasks.workunit.client.0.smithi043.stdout:2/282: symlink d2/d3e/l59 0 2024-04-25T23:01:06.777 INFO:tasks.workunit.client.0.smithi043.stdout:0/374: chown d1b/c2f 3736812 1 2024-04-25T23:01:06.777 INFO:tasks.workunit.client.0.smithi043.stdout:6/381: dwrite d1/fe [0,4194304] 0 2024-04-25T23:01:06.778 INFO:tasks.workunit.client.0.smithi043.stdout:1/339: truncate d0/d16/f5e 5078977 0 2024-04-25T23:01:06.781 INFO:tasks.workunit.client.0.smithi043.stdout:8/256: dwrite d3/d4/d36/f45 [0,4194304] 0 2024-04-25T23:01:06.781 INFO:tasks.workunit.client.0.smithi043.stdout:9/410: dwrite d8/de/d12/d15/d2f/f6d [0,4194304] 0 2024-04-25T23:01:06.783 INFO:tasks.workunit.client.0.smithi043.stdout:8/257: write d3/d1d/f37 [2005651,26492] 0 2024-04-25T23:01:06.784 INFO:tasks.workunit.client.0.smithi043.stdout:3/464: dwrite d7/d26/d27/d34/d1a/d28/f3c [0,4194304] 0 2024-04-25T23:01:06.784 INFO:tasks.workunit.client.0.smithi043.stdout:5/418: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/f54 [0,4194304] 0 2024-04-25T23:01:06.784 INFO:tasks.workunit.client.0.smithi043.stdout:4/414: read d3/d21/d6b/d87/d8a/f94 [717913,9657] 0 2024-04-25T23:01:06.786 INFO:tasks.workunit.client.0.smithi043.stdout:6/382: write d1/d5/d3b/d4c/d1a/f2e [1035070,75793] 0 2024-04-25T23:01:06.786 INFO:tasks.workunit.client.0.smithi043.stdout:2/283: dwrite d2/d3/d22/f39 [0,4194304] 0 2024-04-25T23:01:06.786 INFO:tasks.workunit.client.0.smithi043.stdout:9/411: stat d8/de/d44/d47/l86 0 2024-04-25T23:01:06.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/465: write d7/d26/d27/d34/d1a/d28/f4c [1069519,36766] 0 2024-04-25T23:01:06.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/375: dwrite d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:06.788 INFO:tasks.workunit.client.0.smithi043.stdout:2/284: dread - d2/d3/d22/d23/f57 zero size 2024-04-25T23:01:06.788 INFO:tasks.workunit.client.0.smithi043.stdout:7/404: truncate d3/d1e/f50 1611165 0 2024-04-25T23:01:06.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/376: chown d1b/d55/d5e 47 1 2024-04-25T23:01:06.790 INFO:tasks.workunit.client.0.smithi043.stdout:6/383: creat d1/d5/d3b/d4c/d21/f7d x:0 0 0 2024-04-25T23:01:06.790 INFO:tasks.workunit.client.0.smithi043.stdout:2/285: creat d2/d3/d22/d48/f5a x:0 0 0 2024-04-25T23:01:06.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/405: write d3/d1e/d1f/f5f [132671,76358] 0 2024-04-25T23:01:06.791 INFO:tasks.workunit.client.0.smithi043.stdout:4/415: chown d3/de/d27/d5c/d67/l93 444372 1 2024-04-25T23:01:06.791 INFO:tasks.workunit.client.0.smithi043.stdout:2/286: symlink d2/d3/d13/l5b 0 2024-04-25T23:01:06.792 INFO:tasks.workunit.client.0.smithi043.stdout:4/416: write d3/de/d27/d45/f88 [809682,86774] 0 2024-04-25T23:01:06.792 INFO:tasks.workunit.client.0.smithi043.stdout:2/287: fdatasync d2/d3/f4a 0 2024-04-25T23:01:06.792 INFO:tasks.workunit.client.0.smithi043.stdout:4/417: write d3/d37/d4d/f52 [959909,88249] 0 2024-04-25T23:01:06.792 INFO:tasks.workunit.client.0.smithi043.stdout:7/406: rename d3/da/f23 to d3/d1e/d1f/f7c 0 2024-04-25T23:01:06.792 INFO:tasks.workunit.client.0.smithi043.stdout:3/466: rmdir d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/d92 0 2024-04-25T23:01:06.792 INFO:tasks.workunit.client.0.smithi043.stdout:4/418: readlink d3/de/l42 0 2024-04-25T23:01:06.793 INFO:tasks.workunit.client.0.smithi043.stdout:7/407: readlink d3/da/df/d11/l3a 0 2024-04-25T23:01:06.793 INFO:tasks.workunit.client.0.smithi043.stdout:2/288: stat d2/d3/d22/d23/d43/c58 0 2024-04-25T23:01:06.794 INFO:tasks.workunit.client.0.smithi043.stdout:4/419: unlink d3/d21/f79 0 2024-04-25T23:01:06.794 INFO:tasks.workunit.client.0.smithi043.stdout:3/467: write d7/d26/d27/d34/d1a/d28/f4c [3690036,55270] 0 2024-04-25T23:01:06.795 INFO:tasks.workunit.client.0.smithi043.stdout:2/289: symlink d2/d3/d13/l5c 0 2024-04-25T23:01:06.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/377: dwrite d1b/d31/f33 [4194304,4194304] 0 2024-04-25T23:01:06.796 INFO:tasks.workunit.client.0.smithi043.stdout:2/290: rmdir d2/d3/d13/d40 39 2024-04-25T23:01:06.797 INFO:tasks.workunit.client.0.smithi043.stdout:1/340: write d0/f2 [478656,1568] 0 2024-04-25T23:01:06.797 INFO:tasks.workunit.client.0.smithi043.stdout:1/341: chown d0/d2f/f48 62290366 1 2024-04-25T23:01:06.798 INFO:tasks.workunit.client.0.smithi043.stdout:2/291: stat d2/d3/d22/d23/d3a/f4d 0 2024-04-25T23:01:06.798 INFO:tasks.workunit.client.0.smithi043.stdout:4/420: rename d3/c16 to d3/d21/d6b/d87/c9d 0 2024-04-25T23:01:06.799 INFO:tasks.workunit.client.0.smithi043.stdout:0/378: creat d1b/d31/f77 x:0 0 0 2024-04-25T23:01:06.799 INFO:tasks.workunit.client.0.smithi043.stdout:4/421: readlink d3/d19/l4c 0 2024-04-25T23:01:06.799 INFO:tasks.workunit.client.0.smithi043.stdout:2/292: write d2/d3/f27 [51751,74701] 0 2024-04-25T23:01:06.799 INFO:tasks.workunit.client.0.smithi043.stdout:0/379: write d1b/f40 [1426662,52552] 0 2024-04-25T23:01:06.801 INFO:tasks.workunit.client.0.smithi043.stdout:4/422: creat d3/d21/d6b/d87/d8a/f9e x:0 0 0 2024-04-25T23:01:06.802 INFO:tasks.workunit.client.0.smithi043.stdout:2/293: sync 2024-04-25T23:01:06.802 INFO:tasks.workunit.client.0.smithi043.stdout:4/423: fsync d3/d21/f25 0 2024-04-25T23:01:06.802 INFO:tasks.workunit.client.0.smithi043.stdout:2/294: chown d2/d3/d22/d23/d3a 1 1 2024-04-25T23:01:06.803 INFO:tasks.workunit.client.0.smithi043.stdout:6/384: dwrite d1/d5/f7 [0,4194304] 0 2024-04-25T23:01:06.803 INFO:tasks.workunit.client.0.smithi043.stdout:2/295: sync 2024-04-25T23:01:06.803 INFO:tasks.workunit.client.0.smithi043.stdout:4/424: symlink d3/d21/d6b/d87/d8a/l9f 0 2024-04-25T23:01:06.803 INFO:tasks.workunit.client.0.smithi043.stdout:2/296: unlink d2/d3/d13/c46 0 2024-04-25T23:01:06.803 INFO:tasks.workunit.client.0.smithi043.stdout:6/385: fsync d1/d5/d3b/d4c/d21/d55/d57/f71 0 2024-04-25T23:01:06.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/380: rename d1b/d55/d5e/f62 to d1b/d31/d3c/d72/f78 0 2024-04-25T23:01:06.804 INFO:tasks.workunit.client.0.smithi043.stdout:2/297: truncate d2/d3/d22/d23/f37 375591 0 2024-04-25T23:01:06.805 INFO:tasks.workunit.client.0.smithi043.stdout:0/381: getdents d1b/d23/d39 0 2024-04-25T23:01:06.805 INFO:tasks.workunit.client.0.smithi043.stdout:6/386: dread - d1/d5/d3b/d4c/d21/f7d zero size 2024-04-25T23:01:06.806 INFO:tasks.workunit.client.0.smithi043.stdout:0/382: truncate d1b/d42/f64 719576 0 2024-04-25T23:01:06.806 INFO:tasks.workunit.client.0.smithi043.stdout:0/383: readlink d1b/l21 0 2024-04-25T23:01:06.807 INFO:tasks.workunit.client.0.smithi043.stdout:2/298: rename d2/d3/d22/d23/d3a to d2/d3/d22/d23/d43/d5d 0 2024-04-25T23:01:06.807 INFO:tasks.workunit.client.0.smithi043.stdout:0/384: symlink d1b/l79 0 2024-04-25T23:01:06.808 INFO:tasks.workunit.client.0.smithi043.stdout:0/385: mkdir d1b/d23/d7a 0 2024-04-25T23:01:06.808 INFO:tasks.workunit.client.0.smithi043.stdout:2/299: creat d2/d3/d13/d40/f5e x:0 0 0 2024-04-25T23:01:06.808 INFO:tasks.workunit.client.0.smithi043.stdout:4/425: dwrite d3/de/d46/d6a/d8f/f5e [0,4194304] 0 2024-04-25T23:01:06.809 INFO:tasks.workunit.client.0.smithi043.stdout:0/386: chown d1b/d31/d3c/f6a 1147 1 2024-04-25T23:01:06.810 INFO:tasks.workunit.client.0.smithi043.stdout:8/258: read d3/d32/f1e [3082784,114168] 0 2024-04-25T23:01:06.810 INFO:tasks.workunit.client.0.smithi043.stdout:0/387: mkdir d1b/d23/d7b 0 2024-04-25T23:01:06.810 INFO:tasks.workunit.client.0.smithi043.stdout:4/426: write d3/de/d46/f4b [617792,51070] 0 2024-04-25T23:01:06.811 INFO:tasks.workunit.client.0.smithi043.stdout:0/388: read - d1b/d55/f73 zero size 2024-04-25T23:01:06.811 INFO:tasks.workunit.client.0.smithi043.stdout:4/427: rmdir d3/de/d27/d5c 39 2024-04-25T23:01:06.812 INFO:tasks.workunit.client.0.smithi043.stdout:0/389: write d1b/d31/d3c/f43 [1069403,29106] 0 2024-04-25T23:01:06.812 INFO:tasks.workunit.client.0.smithi043.stdout:4/428: chown d3/f96 98592740 1 2024-04-25T23:01:06.813 INFO:tasks.workunit.client.0.smithi043.stdout:0/390: link d1b/d23/f70 d1b/d31/d3c/f7c 0 2024-04-25T23:01:06.814 INFO:tasks.workunit.client.0.smithi043.stdout:0/391: chown d1b/d23/d39/f4b 6 1 2024-04-25T23:01:06.815 INFO:tasks.workunit.client.0.smithi043.stdout:2/300: dwrite d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:06.815 INFO:tasks.workunit.client.0.smithi043.stdout:2/301: readlink d2/l2a 0 2024-04-25T23:01:06.815 INFO:tasks.workunit.client.0.smithi043.stdout:0/392: fdatasync d1b/d31/d3c/f52 0 2024-04-25T23:01:06.816 INFO:tasks.workunit.client.0.smithi043.stdout:0/393: write d1b/d23/f3e [803034,74942] 0 2024-04-25T23:01:06.817 INFO:tasks.workunit.client.0.smithi043.stdout:0/394: chown d1b/d31/d3c/f43 190 1 2024-04-25T23:01:06.824 INFO:tasks.workunit.client.0.smithi043.stdout:4/429: dread d3/d21/f25 [0,4194304] 0 2024-04-25T23:01:06.824 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:06.822+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:06.827 INFO:tasks.workunit.client.0.smithi043.stdout:5/419: dread d0/d2c/d39/d1c/f2b [0,4194304] 0 2024-04-25T23:01:06.829 INFO:tasks.workunit.client.0.smithi043.stdout:4/430: dwrite d3/d19/f5a [0,4194304] 0 2024-04-25T23:01:06.829 INFO:tasks.workunit.client.0.smithi043.stdout:5/420: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/d8c 0 2024-04-25T23:01:06.831 INFO:tasks.workunit.client.0.smithi043.stdout:9/412: truncate d8/de/d12/d15/d2f/f2d 1678407 0 2024-04-25T23:01:06.832 INFO:tasks.workunit.client.0.smithi043.stdout:1/342: write d0/d2f/f71 [166543,111950] 0 2024-04-25T23:01:06.832 INFO:tasks.workunit.client.0.smithi043.stdout:0/395: dread d1b/d23/f2a [0,4194304] 0 2024-04-25T23:01:06.832 INFO:tasks.workunit.client.0.smithi043.stdout:5/421: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91 0 2024-04-25T23:01:06.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/396: chown d1b/d31/d3c/d50/l51 473736 1 2024-04-25T23:01:06.833 INFO:tasks.workunit.client.0.smithi043.stdout:1/343: creat d0/f72 x:0 0 0 2024-04-25T23:01:06.834 INFO:tasks.workunit.client.0.smithi043.stdout:0/397: mkdir d1b/d55/d5e/d7d 0 2024-04-25T23:01:06.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/422: write d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/f83 [724362,120023] 0 2024-04-25T23:01:06.835 INFO:tasks.workunit.client.0.smithi043.stdout:0/398: write d1b/d31/d3c/f52 [1355221,42409] 0 2024-04-25T23:01:06.835 INFO:tasks.workunit.client.0.smithi043.stdout:0/399: stat d1b/d23/f70 0 2024-04-25T23:01:06.835 INFO:tasks.workunit.client.0.smithi043.stdout:1/344: mknod d0/d9/c73 0 2024-04-25T23:01:06.836 INFO:tasks.workunit.client.0.smithi043.stdout:4/431: dread d3/f24 [0,4194304] 0 2024-04-25T23:01:06.837 INFO:tasks.workunit.client.0.smithi043.stdout:1/345: creat d0/d2f/d4b/f74 x:0 0 0 2024-04-25T23:01:06.837 INFO:tasks.workunit.client.0.smithi043.stdout:5/423: truncate d0/d2c/d39/d1c/d25/d7a/d2d/f5a 912959 0 2024-04-25T23:01:06.837 INFO:tasks.workunit.client.0.smithi043.stdout:5/424: read d0/f17 [1618417,95735] 0 2024-04-25T23:01:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:1/346: creat d0/d2f/d4b/f75 x:0 0 0 2024-04-25T23:01:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/400: getdents d1b/d31/d3c/d72 0 2024-04-25T23:01:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:4/432: creat d3/de/d27/d45/fa0 x:0 0 0 2024-04-25T23:01:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/259: dread d3/d1d/f37 [0,4194304] 0 2024-04-25T23:01:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:1/347: write d0/d2f/d4b/f75 [239232,10384] 0 2024-04-25T23:01:06.839 INFO:tasks.workunit.client.0.smithi043.stdout:5/425: mkdir d0/d2c/d39/d1c/d25/d7a/d92 0 2024-04-25T23:01:06.839 INFO:tasks.workunit.client.0.smithi043.stdout:8/260: mkdir d3/d4/db/d53 0 2024-04-25T23:01:06.839 INFO:tasks.workunit.client.0.smithi043.stdout:4/433: rename d3/d19/f48 to d3/d37/d7a/fa1 0 2024-04-25T23:01:06.840 INFO:tasks.workunit.client.0.smithi043.stdout:1/348: write d0/f72 [1005581,103364] 0 2024-04-25T23:01:06.840 INFO:tasks.workunit.client.0.smithi043.stdout:8/261: stat d3/d4/db/df/l40 0 2024-04-25T23:01:06.841 INFO:tasks.workunit.client.0.smithi043.stdout:5/426: rename d0/d2c/d39/d1c/d25/d7a/d2d/f5a to d0/d2c/d39/d63/f93 0 2024-04-25T23:01:06.841 INFO:tasks.workunit.client.0.smithi043.stdout:8/262: creat d3/d4/db/d14/f54 x:0 0 0 2024-04-25T23:01:06.842 INFO:tasks.workunit.client.0.smithi043.stdout:8/263: stat d3/d4/db/d14/d4c 0 2024-04-25T23:01:06.842 INFO:tasks.workunit.client.0.smithi043.stdout:5/427: write d0/d2c/d39/f88 [635419,80007] 0 2024-04-25T23:01:06.842 INFO:tasks.workunit.client.0.smithi043.stdout:0/401: dread d1b/d31/f6c [0,4194304] 0 2024-04-25T23:01:06.842 INFO:tasks.workunit.client.0.smithi043.stdout:8/264: mknod d3/c55 0 2024-04-25T23:01:06.844 INFO:tasks.workunit.client.0.smithi043.stdout:5/428: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f53 [754896,128018] 0 2024-04-25T23:01:06.845 INFO:tasks.workunit.client.0.smithi043.stdout:5/429: truncate d0/f23 1125237 0 2024-04-25T23:01:06.847 INFO:tasks.workunit.client.0.smithi043.stdout:4/434: dwrite d3/f57 [0,4194304] 0 2024-04-25T23:01:06.849 INFO:tasks.workunit.client.0.smithi043.stdout:0/402: dwrite d1b/d31/f6c [0,4194304] 0 2024-04-25T23:01:06.850 INFO:tasks.workunit.client.0.smithi043.stdout:8/265: dwrite d3/d1d/f27 [0,4194304] 0 2024-04-25T23:01:06.850 INFO:tasks.workunit.client.0.smithi043.stdout:2/302: creat d2/d3/d22/d23/f5f x:0 0 0 2024-04-25T23:01:06.850 INFO:tasks.workunit.client.0.smithi043.stdout:5/430: mknod d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/c94 0 2024-04-25T23:01:06.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/266: write d3/d4/db/df/d10/f15 [4782820,72910] 0 2024-04-25T23:01:06.852 INFO:tasks.workunit.client.0.smithi043.stdout:4/435: getdents d3 0 2024-04-25T23:01:06.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/267: chown d3/d4/db/l23 220 1 2024-04-25T23:01:06.853 INFO:tasks.workunit.client.0.smithi043.stdout:0/403: write d1b/d31/f77 [136683,26584] 0 2024-04-25T23:01:06.854 INFO:tasks.workunit.client.0.smithi043.stdout:5/431: truncate d0/d2c/d39/d1c/d25/d7a/d2d/f8a 283727 0 2024-04-25T23:01:06.854 INFO:tasks.workunit.client.0.smithi043.stdout:4/436: rename d3/de/d46/f4b to d3/de/d27/d5c/d67/fa2 0 2024-04-25T23:01:06.854 INFO:tasks.workunit.client.0.smithi043.stdout:0/404: symlink d1b/l7e 0 2024-04-25T23:01:06.854 INFO:tasks.workunit.client.0.smithi043.stdout:8/268: mkdir d3/d4/db/d14/d56 0 2024-04-25T23:01:06.855 INFO:tasks.workunit.client.0.smithi043.stdout:0/405: stat d1b/d23/f2a 0 2024-04-25T23:01:06.855 INFO:tasks.workunit.client.0.smithi043.stdout:4/437: chown d3/de/d27/d45/l58 1137309 1 2024-04-25T23:01:06.855 INFO:tasks.workunit.client.0.smithi043.stdout:9/413: sync 2024-04-25T23:01:06.857 INFO:tasks.workunit.client.0.smithi043.stdout:8/269: mknod d3/d4/db/d14/c57 0 2024-04-25T23:01:06.857 INFO:tasks.workunit.client.0.smithi043.stdout:8/270: fsync d3/d4/db/df/d10/d33/f1a 0 2024-04-25T23:01:06.857 INFO:tasks.workunit.client.0.smithi043.stdout:8/271: readlink d3/d4/db/d4e/l52 0 2024-04-25T23:01:06.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/438: getdents d3/d21 0 2024-04-25T23:01:06.858 INFO:tasks.workunit.client.0.smithi043.stdout:8/272: write d3/d32/f1e [4493219,90297] 0 2024-04-25T23:01:06.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/432: dread d0/d22/f76 [0,4194304] 0 2024-04-25T23:01:06.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/433: mkdir d0/d22/d95 0 2024-04-25T23:01:06.860 INFO:tasks.workunit.client.0.smithi043.stdout:8/273: creat d3/d4/db/df/f58 x:0 0 0 2024-04-25T23:01:06.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/439: mknod d3/d21/d6b/d87/d8a/ca3 0 2024-04-25T23:01:06.862 INFO:tasks.workunit.client.0.smithi043.stdout:4/440: getdents d3/d21/d6b 0 2024-04-25T23:01:06.862 INFO:tasks.workunit.client.0.smithi043.stdout:5/434: rename d0/d6a/f90 to d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f96 0 2024-04-25T23:01:06.863 INFO:tasks.workunit.client.0.smithi043.stdout:4/441: write d3/de/f35 [1336191,52596] 0 2024-04-25T23:01:06.863 INFO:tasks.workunit.client.0.smithi043.stdout:7/408: dread d3/d1e/d41/f4a [0,4194304] 0 2024-04-25T23:01:06.863 INFO:tasks.workunit.client.0.smithi043.stdout:5/435: fdatasync d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e 0 2024-04-25T23:01:06.863 INFO:tasks.workunit.client.0.smithi043.stdout:7/409: write d3/d52/f60 [858875,19187] 0 2024-04-25T23:01:06.864 INFO:tasks.workunit.client.0.smithi043.stdout:4/442: write d3/d19/f8d [3018550,71594] 0 2024-04-25T23:01:06.864 INFO:tasks.workunit.client.0.smithi043.stdout:7/410: rmdir d3/d1e/d1f 39 2024-04-25T23:01:06.865 INFO:tasks.workunit.client.0.smithi043.stdout:5/436: symlink d0/d2c/d39/d1c/d25/d7a/d2d/d8b/l97 0 2024-04-25T23:01:06.865 INFO:tasks.workunit.client.0.smithi043.stdout:1/349: dread d0/d2f/f71 [0,4194304] 0 2024-04-25T23:01:06.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/350: chown d0/d2f/d4b/c55 1682 1 2024-04-25T23:01:06.867 INFO:tasks.workunit.client.0.smithi043.stdout:1/351: chown d0/d2f/f71 148697317 1 2024-04-25T23:01:06.867 INFO:tasks.workunit.client.0.smithi043.stdout:1/352: chown d0/c39 344834356 1 2024-04-25T23:01:06.868 INFO:tasks.workunit.client.0.smithi043.stdout:8/274: dwrite d3/d4/f25 [0,4194304] 0 2024-04-25T23:01:06.868 INFO:tasks.workunit.client.0.smithi043.stdout:1/353: creat d0/d16/f76 x:0 0 0 2024-04-25T23:01:06.869 INFO:tasks.workunit.client.0.smithi043.stdout:8/275: fsync d3/d4/db/f2d 0 2024-04-25T23:01:06.870 INFO:tasks.workunit.client.0.smithi043.stdout:1/354: rename d0/c39 to d0/d9/c77 0 2024-04-25T23:01:06.870 INFO:tasks.workunit.client.0.smithi043.stdout:8/276: chown d3/cc 114 1 2024-04-25T23:01:06.871 INFO:tasks.workunit.client.0.smithi043.stdout:0/406: read d1b/f40 [3815719,90423] 0 2024-04-25T23:01:06.871 INFO:tasks.workunit.client.0.smithi043.stdout:3/468: dread d7/d39/d52/f5d [0,4194304] 0 2024-04-25T23:01:06.871 INFO:tasks.workunit.client.0.smithi043.stdout:1/355: mknod d0/d2f/c78 0 2024-04-25T23:01:06.871 INFO:tasks.workunit.client.0.smithi043.stdout:0/407: chown d1b/d23/f2a 86 1 2024-04-25T23:01:06.872 INFO:tasks.workunit.client.0.smithi043.stdout:1/356: rename d0/f67 to d0/d3c/f79 0 2024-04-25T23:01:06.872 INFO:tasks.workunit.client.0.smithi043.stdout:0/408: unlink d1b/f57 0 2024-04-25T23:01:06.872 INFO:tasks.workunit.client.0.smithi043.stdout:3/469: unlink d7/d26/d27/d34/d1a/d40/f8a 0 2024-04-25T23:01:06.873 INFO:tasks.workunit.client.0.smithi043.stdout:0/409: mkdir d1b/d7f 0 2024-04-25T23:01:06.873 INFO:tasks.workunit.client.0.smithi043.stdout:3/470: mkdir d7/d26/d27/d34/d1a/d28/d9e 0 2024-04-25T23:01:06.874 INFO:tasks.workunit.client.0.smithi043.stdout:0/410: dread - d1b/d23/f70 zero size 2024-04-25T23:01:06.876 INFO:tasks.workunit.client.0.smithi043.stdout:6/387: dread d1/d5/f22 [0,4194304] 0 2024-04-25T23:01:06.876 INFO:tasks.workunit.client.0.smithi043.stdout:3/471: link d7/d26/d27/d34/l77 d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/l9f 0 2024-04-25T23:01:06.877 INFO:tasks.workunit.client.0.smithi043.stdout:8/277: dwrite d3/d32/d2e/f46 [0,4194304] 0 2024-04-25T23:01:06.878 INFO:tasks.workunit.client.0.smithi043.stdout:3/472: write d7/d26/d27/d56/f6c [877023,68490] 0 2024-04-25T23:01:06.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/388: fdatasync d1/d5/d3b/d4c/d21/d55/d68/f36 0 2024-04-25T23:01:06.879 INFO:tasks.workunit.client.0.smithi043.stdout:6/389: fsync d1/d5/d3b/d4c/d21/d55/d68/d30/f3d 0 2024-04-25T23:01:06.880 INFO:tasks.workunit.client.0.smithi043.stdout:1/357: dwrite d0/d3d/f30 [4194304,4194304] 0 2024-04-25T23:01:06.887 INFO:tasks.workunit.client.0.smithi043.stdout:3/473: sync 2024-04-25T23:01:06.888 INFO:tasks.workunit.client.0.smithi043.stdout:3/474: creat d7/d26/d59/d7c/fa0 x:0 0 0 2024-04-25T23:01:06.888 INFO:tasks.workunit.client.0.smithi043.stdout:3/475: chown d7/d26/c2c 1 1 2024-04-25T23:01:06.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/476: read d7/d26/d27/d34/f17 [2416530,31235] 0 2024-04-25T23:01:06.899 INFO:tasks.workunit.client.0.smithi043.stdout:3/477: creat d7/d26/d59/d7c/fa1 x:0 0 0 2024-04-25T23:01:06.899 INFO:tasks.workunit.client.0.smithi043.stdout:3/478: chown d7/d26/d27/d34/d1a/d40/c84 3 1 2024-04-25T23:01:06.900 INFO:tasks.workunit.client.0.smithi043.stdout:3/479: fdatasync d7/d26/d27/d34/d1a/d28/f46 0 2024-04-25T23:01:06.901 INFO:tasks.workunit.client.0.smithi043.stdout:3/480: creat d7/d26/d59/fa2 x:0 0 0 2024-04-25T23:01:06.912 INFO:tasks.workunit.client.0.smithi043.stdout:7/411: dread d3/d1e/d1f/f6a [0,4194304] 0 2024-04-25T23:01:06.913 INFO:tasks.workunit.client.0.smithi043.stdout:7/412: write d3/d1e/d41/f66 [25197,108583] 0 2024-04-25T23:01:06.914 INFO:tasks.workunit.client.0.smithi043.stdout:7/413: fsync d3/da/df/d11/f20 0 2024-04-25T23:01:06.914 INFO:tasks.workunit.client.0.smithi043.stdout:7/414: readlink d3/d1e/d1f/l2a 0 2024-04-25T23:01:06.915 INFO:tasks.workunit.client.0.smithi043.stdout:7/415: mkdir d3/d1e/d1f/d54/d7d 0 2024-04-25T23:01:06.915 INFO:tasks.workunit.client.0.smithi043.stdout:7/416: mknod d3/da/df/d11/c7e 0 2024-04-25T23:01:06.916 INFO:tasks.workunit.client.0.smithi043.stdout:7/417: creat d3/d1e/d1f/f7f x:0 0 0 2024-04-25T23:01:06.917 INFO:tasks.workunit.client.0.smithi043.stdout:7/418: write d3/da/df/f48 [2820085,113627] 0 2024-04-25T23:01:06.918 INFO:tasks.workunit.client.0.smithi043.stdout:7/419: creat d3/d1e/d41/f80 x:0 0 0 2024-04-25T23:01:06.919 INFO:tasks.workunit.client.0.smithi043.stdout:3/481: dread d7/f18 [0,4194304] 0 2024-04-25T23:01:06.920 INFO:tasks.workunit.client.0.smithi043.stdout:3/482: creat d7/d26/d2d/fa3 x:0 0 0 2024-04-25T23:01:06.920 INFO:tasks.workunit.client.0.smithi043.stdout:3/483: chown d7/d26/d59/d7c 11749195 1 2024-04-25T23:01:06.920 INFO:tasks.workunit.client.0.smithi043.stdout:3/484: rmdir d7/d26/d59 39 2024-04-25T23:01:06.921 INFO:tasks.workunit.client.0.smithi043.stdout:3/485: fdatasync d7/d26/d27/d34/d1a/d40/f64 0 2024-04-25T23:01:06.922 INFO:tasks.workunit.client.0.smithi043.stdout:3/486: chown d7/d26/d27/d34/d1a/d28/d9e 1507 1 2024-04-25T23:01:06.923 INFO:tasks.workunit.client.0.smithi043.stdout:3/487: mknod d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/ca4 0 2024-04-25T23:01:06.923 INFO:tasks.workunit.client.0.smithi043.stdout:3/488: rmdir d7/d39/d87 39 2024-04-25T23:01:06.924 INFO:tasks.workunit.client.0.smithi043.stdout:3/489: chown d7/d26/d27/d34/d1a/d40/d8f/l73 3910049 1 2024-04-25T23:01:06.924 INFO:tasks.workunit.client.0.smithi043.stdout:2/303: read d2/d3/f2f [1168885,26559] 0 2024-04-25T23:01:06.925 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:06.920+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:06.928 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:06.928 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:06.928 INFO:tasks.workunit.client.0.smithi043.stdout:4/443: dwrite d3/d21/d6b/d87/d8a/f94 [0,4194304] 0 2024-04-25T23:01:06.929 INFO:tasks.workunit.client.0.smithi043.stdout:4/444: chown d3/de/d46 1355073 1 2024-04-25T23:01:06.931 INFO:tasks.workunit.client.0.smithi043.stdout:5/437: dwrite d0/d2c/d39/d1c/d25/d4e/f58 [0,4194304] 0 2024-04-25T23:01:06.933 INFO:tasks.workunit.client.0.smithi043.stdout:2/304: dwrite d2/d3/d13/d18/f19 [0,4194304] 0 2024-04-25T23:01:06.933 INFO:tasks.workunit.client.0.smithi043.stdout:3/490: dwrite d7/d26/d27/d34/d1a/d40/f64 [0,4194304] 0 2024-04-25T23:01:06.933 INFO:tasks.workunit.client.0.smithi043.stdout:2/305: readlink d2/d3/d13/l5b 0 2024-04-25T23:01:06.934 INFO:tasks.workunit.client.0.smithi043.stdout:5/438: read - d0/d2c/d39/d1c/d25/d7a/d41/f86 zero size 2024-04-25T23:01:06.934 INFO:tasks.workunit.client.0.smithi043.stdout:2/306: chown d2/d3/d13/d40/f51 7 1 2024-04-25T23:01:06.935 INFO:tasks.workunit.client.0.smithi043.stdout:3/491: chown d7/c31 530 1 2024-04-25T23:01:06.935 INFO:tasks.workunit.client.0.smithi043.stdout:0/411: truncate d1b/d31/d3c/d50/f5d 4111082 0 2024-04-25T23:01:06.935 INFO:tasks.workunit.client.0.smithi043.stdout:2/307: creat d2/d3/d22/f60 x:0 0 0 2024-04-25T23:01:06.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/439: rmdir d0/d2c/d39/d1c/d25/d7a/d41/d4a/d60 39 2024-04-25T23:01:06.936 INFO:tasks.workunit.client.0.smithi043.stdout:0/412: symlink d1b/d23/l80 0 2024-04-25T23:01:06.937 INFO:tasks.workunit.client.0.smithi043.stdout:3/492: creat d7/d39/d87/fa5 x:0 0 0 2024-04-25T23:01:06.937 INFO:tasks.workunit.client.0.smithi043.stdout:2/308: readlink d2/d3/d22/l3d 0 2024-04-25T23:01:06.937 INFO:tasks.workunit.client.0.smithi043.stdout:5/440: fdatasync d0/d2c/d39/f34 0 2024-04-25T23:01:06.937 INFO:tasks.workunit.client.0.smithi043.stdout:8/278: truncate d3/d1d/f37 298949 0 2024-04-25T23:01:06.938 INFO:tasks.workunit.client.0.smithi043.stdout:2/309: read - d2/d3/d13/d40/f51 zero size 2024-04-25T23:01:06.939 INFO:tasks.workunit.client.0.smithi043.stdout:2/310: chown d2/d3/f2c 252770782 1 2024-04-25T23:01:06.939 INFO:tasks.workunit.client.0.smithi043.stdout:8/279: mkdir d3/d32/d59 0 2024-04-25T23:01:06.940 INFO:tasks.workunit.client.0.smithi043.stdout:8/280: write d3/d4/f25 [2591019,68936] 0 2024-04-25T23:01:06.942 INFO:tasks.workunit.client.0.smithi043.stdout:6/390: truncate d1/d5/d3b/d4c/f11 1330634 0 2024-04-25T23:01:06.942 INFO:tasks.workunit.client.0.smithi043.stdout:8/281: rmdir d3/d32 39 2024-04-25T23:01:06.943 INFO:tasks.workunit.client.0.smithi043.stdout:0/413: dread d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:06.944 INFO:tasks.workunit.client.0.smithi043.stdout:6/391: symlink d1/d5/d3b/d4c/d21/d38/d60/l7e 0 2024-04-25T23:01:06.944 INFO:tasks.workunit.client.0.smithi043.stdout:0/414: rename d1b/d31/f77 to d1b/d31/f81 0 2024-04-25T23:01:06.944 INFO:tasks.workunit.client.0.smithi043.stdout:1/358: dwrite d0/d16/f1b [0,4194304] 0 2024-04-25T23:01:06.945 INFO:tasks.workunit.client.0.smithi043.stdout:6/392: stat d1/d5/d3b/d4c/d21/d55/d68 0 2024-04-25T23:01:06.945 INFO:tasks.workunit.client.0.smithi043.stdout:5/441: dwrite d0/d2c/d39/d1c/d25/d7a/f1e [0,4194304] 0 2024-04-25T23:01:06.947 INFO:tasks.workunit.client.0.smithi043.stdout:1/359: symlink d0/d2f/l7a 0 2024-04-25T23:01:06.947 INFO:tasks.workunit.client.0.smithi043.stdout:6/393: mkdir d1/d5/d3b/d4c/d21/d55/d68/d7f 0 2024-04-25T23:01:06.947 INFO:tasks.workunit.client.0.smithi043.stdout:8/282: link d3/d4/db/df/d10/c3a d3/d4/db/d4e/c5a 0 2024-04-25T23:01:06.947 INFO:tasks.workunit.client.0.smithi043.stdout:0/415: link d1b/d23/l34 d1b/d23/d7a/l82 0 2024-04-25T23:01:06.948 INFO:tasks.workunit.client.0.smithi043.stdout:1/360: mkdir d0/d9/d7b 0 2024-04-25T23:01:06.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:06.949 INFO:tasks.workunit.client.0.smithi043.stdout:1/361: creat d0/d2f/d4b/f7c x:0 0 0 2024-04-25T23:01:06.950 INFO:tasks.workunit.client.0.smithi043.stdout:8/283: mkdir d3/d32/d59/d5b 0 2024-04-25T23:01:06.952 INFO:tasks.workunit.client.0.smithi043.stdout:5/442: dwrite d0/d2c/d39/f34 [0,4194304] 0 2024-04-25T23:01:06.962 INFO:tasks.workunit.client.0.smithi043.stdout:6/394: read d1/d5/d3b/d4c/d21/d55/d68/f36 [2379914,63406] 0 2024-04-25T23:01:06.962 INFO:tasks.workunit.client.0.smithi043.stdout:3/493: sync 2024-04-25T23:01:06.963 INFO:tasks.workunit.client.0.smithi043.stdout:1/362: dread d0/d2f/d4b/f75 [0,4194304] 0 2024-04-25T23:01:06.963 INFO:tasks.workunit.client.0.smithi043.stdout:4/445: dread d3/d37/d7a/fa1 [0,4194304] 0 2024-04-25T23:01:06.963 INFO:tasks.workunit.client.0.smithi043.stdout:6/395: mknod d1/d5/d3b/d4c/d21/d55/d57/c80 0 2024-04-25T23:01:06.964 INFO:tasks.workunit.client.0.smithi043.stdout:1/363: symlink d0/d2f/l7d 0 2024-04-25T23:01:06.964 INFO:tasks.workunit.client.0.smithi043.stdout:6/396: stat d1/f13 0 2024-04-25T23:01:06.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/494: creat d7/d26/d27/d34/d1a/d28/fa6 x:0 0 0 2024-04-25T23:01:06.964 INFO:tasks.workunit.client.0.smithi043.stdout:6/397: rmdir d1/d5/d3b/d4c/d1a 39 2024-04-25T23:01:06.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/495: creat d7/d26/d97/fa7 x:0 0 0 2024-04-25T23:01:06.965 INFO:tasks.workunit.client.0.smithi043.stdout:3/496: symlink d7/d39/d52/la8 0 2024-04-25T23:01:06.965 INFO:tasks.workunit.client.0.smithi043.stdout:6/398: mknod d1/d5/d3b/d4c/d21/d55/d68/c81 0 2024-04-25T23:01:06.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/399: dread - d1/f78 zero size 2024-04-25T23:01:06.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/497: link d7/d26/d27/d34/f45 d7/d26/d27/d56/fa9 0 2024-04-25T23:01:06.967 INFO:tasks.workunit.client.0.smithi043.stdout:6/400: readlink d1/d5/d3b/d4c/d21/d46/l63 0 2024-04-25T23:01:06.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/498: stat d7/d26/d2d/d8c 0 2024-04-25T23:01:06.967 INFO:tasks.workunit.client.0.smithi043.stdout:6/401: write d1/d5/d3b/f44 [3094789,10889] 0 2024-04-25T23:01:06.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/499: fsync d7/d26/f95 0 2024-04-25T23:01:06.969 INFO:tasks.workunit.client.0.smithi043.stdout:4/446: dwrite d3/d37/f54 [0,4194304] 0 2024-04-25T23:01:06.970 INFO:tasks.workunit.client.0.smithi043.stdout:3/500: write d7/d39/d52/f5d [2533561,29932] 0 2024-04-25T23:01:06.970 INFO:tasks.workunit.client.0.smithi043.stdout:4/447: chown d3/d37/d4d/f92 1386703212 1 2024-04-25T23:01:06.971 INFO:tasks.workunit.client.0.smithi043.stdout:4/448: symlink d3/la4 0 2024-04-25T23:01:06.971 INFO:tasks.workunit.client.0.smithi043.stdout:3/501: rmdir d7/d26/d2d/d8c 0 2024-04-25T23:01:06.971 INFO:tasks.workunit.client.0.smithi043.stdout:3/502: chown d7/f20 7 1 2024-04-25T23:01:06.971 INFO:tasks.workunit.client.0.smithi043.stdout:4/449: stat d3/d21/d6b/d87/c9d 0 2024-04-25T23:01:06.972 INFO:tasks.workunit.client.0.smithi043.stdout:4/450: fsync d3/f96 0 2024-04-25T23:01:06.972 INFO:tasks.workunit.client.0.smithi043.stdout:4/451: sync 2024-04-25T23:01:06.972 INFO:tasks.workunit.client.0.smithi043.stdout:6/402: read d1/d2a/f5e [316862,75895] 0 2024-04-25T23:01:06.973 INFO:tasks.workunit.client.0.smithi043.stdout:4/452: dread - d3/de/d46/d95/f99 zero size 2024-04-25T23:01:06.974 INFO:tasks.workunit.client.0.smithi043.stdout:6/403: link d1/d5/d3b/d4c/d21/d55/d68/d30/c72 d1/d5/d3b/d4c/d21/d55/c82 0 2024-04-25T23:01:06.978 INFO:tasks.workunit.client.0.smithi043.stdout:4/453: dwrite d3/f57 [4194304,4194304] 0 2024-04-25T23:01:06.978 INFO:tasks.workunit.client.0.smithi043.stdout:7/420: getdents d3/d1e/d1f/d54 0 2024-04-25T23:01:06.979 INFO:tasks.workunit.client.0.smithi043.stdout:7/421: chown d3/da/l57 469136 1 2024-04-25T23:01:06.980 INFO:tasks.workunit.client.0.smithi043.stdout:9/414: dread d8/de/d12/d16/d24/f2a [0,4194304] 0 2024-04-25T23:01:06.981 INFO:tasks.workunit.client.0.smithi043.stdout:2/311: write d2/d3/f2f [2671975,66701] 0 2024-04-25T23:01:06.981 INFO:tasks.workunit.client.0.smithi043.stdout:8/284: rename d3/d32 to d3/d4/db/d4e/d5c 0 2024-04-25T23:01:06.982 INFO:tasks.workunit.client.0.smithi043.stdout:1/364: truncate d0/d16/f22 740898 0 2024-04-25T23:01:06.983 INFO:tasks.workunit.client.0.smithi043.stdout:3/503: getdents d7/d39/d52 0 2024-04-25T23:01:06.983 INFO:tasks.workunit.client.0.smithi043.stdout:1/365: stat d0/d3d/d4f/d69 0 2024-04-25T23:01:06.983 INFO:tasks.workunit.client.0.smithi043.stdout:2/312: fsync d2/d3/f34 0 2024-04-25T23:01:06.984 INFO:tasks.workunit.client.0.smithi043.stdout:8/285: mkdir d3/d4/db/d14/d56/d5d 0 2024-04-25T23:01:06.984 INFO:tasks.workunit.client.0.smithi043.stdout:5/443: rename d0/l1d to d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/l98 0 2024-04-25T23:01:06.985 INFO:tasks.workunit.client.0.smithi043.stdout:2/313: mknod d2/d3e/c61 0 2024-04-25T23:01:06.985 INFO:tasks.workunit.client.0.smithi043.stdout:4/454: dwrite d3/de/f49 [0,4194304] 0 2024-04-25T23:01:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:9/415: rename d8/de/d44/d47/d6a/f76 to d8/de/d12/d15/d68/f8f 0 2024-04-25T23:01:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:1/366: truncate d0/d2f/d4b/f75 1124131 0 2024-04-25T23:01:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:5/444: mknod d0/d2c/d39/c99 0 2024-04-25T23:01:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:8/286: truncate d3/d4/db/d14/f19 48450 0 2024-04-25T23:01:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:2/314: chown d2/d3/d13/d18/f19 0 1 2024-04-25T23:01:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:4/455: mkdir d3/d21/da5 0 2024-04-25T23:01:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:3/504: creat d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/faa x:0 0 0 2024-04-25T23:01:06.988 INFO:tasks.workunit.client.0.smithi043.stdout:8/287: read d3/d4/d36/f45 [3186349,82362] 0 2024-04-25T23:01:06.988 INFO:tasks.workunit.client.0.smithi043.stdout:4/456: read - d3/d21/d6b/d87/d8a/f9e zero size 2024-04-25T23:01:06.988 INFO:tasks.workunit.client.0.smithi043.stdout:9/416: symlink d8/de/d44/d47/d6a/l90 0 2024-04-25T23:01:06.989 INFO:tasks.workunit.client.0.smithi043.stdout:4/457: stat d3/d21/d6b/d87/f8b 0 2024-04-25T23:01:06.989 INFO:tasks.workunit.client.0.smithi043.stdout:8/288: readlink d3/d4/db/d14/l16 0 2024-04-25T23:01:06.989 INFO:tasks.workunit.client.0.smithi043.stdout:5/445: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/f50 [772564,65336] 0 2024-04-25T23:01:06.989 INFO:tasks.workunit.client.0.smithi043.stdout:3/505: write d7/f2a [1582616,103290] 0 2024-04-25T23:01:06.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/446: write d0/d2c/d39/d63/f7d [795545,81218] 0 2024-04-25T23:01:06.990 INFO:tasks.workunit.client.0.smithi043.stdout:3/506: readlink d7/d26/d2d/l70 0 2024-04-25T23:01:06.990 INFO:tasks.workunit.client.0.smithi043.stdout:4/458: truncate d3/d21/d6b/d87/f8b 272541 0 2024-04-25T23:01:06.991 INFO:tasks.workunit.client.0.smithi043.stdout:5/447: fdatasync d0/d2c/f4c 0 2024-04-25T23:01:06.991 INFO:tasks.workunit.client.0.smithi043.stdout:9/417: creat d8/de/d44/d5d/d4f/f91 x:0 0 0 2024-04-25T23:01:06.992 INFO:tasks.workunit.client.0.smithi043.stdout:8/289: mkdir d3/d4/db/d4e/d5c/d2e/d5e 0 2024-04-25T23:01:06.992 INFO:tasks.workunit.client.0.smithi043.stdout:3/507: mkdir d7/d26/d2d/dab 0 2024-04-25T23:01:06.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/459: mknod d3/de/d46/d6a/ca6 0 2024-04-25T23:01:06.993 INFO:tasks.workunit.client.0.smithi043.stdout:2/315: mknod d2/d3/d22/d23/d43/d5d/c62 0 2024-04-25T23:01:06.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/460: write d3/f7d [357908,25281] 0 2024-04-25T23:01:06.993 INFO:tasks.workunit.client.0.smithi043.stdout:8/290: write d3/d4/db/d14/d3e/f43 [67959,102828] 0 2024-04-25T23:01:06.993 INFO:tasks.workunit.client.0.smithi043.stdout:0/416: dread f8 [0,4194304] 0 2024-04-25T23:01:06.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/418: chown d8/de/d12/d15/d68/f8f 1 1 2024-04-25T23:01:06.994 INFO:tasks.workunit.client.0.smithi043.stdout:2/316: mkdir d2/d3/d22/d63 0 2024-04-25T23:01:06.994 INFO:tasks.workunit.client.0.smithi043.stdout:0/417: readlink l0 0 2024-04-25T23:01:06.994 INFO:tasks.workunit.client.0.smithi043.stdout:8/291: mknod d3/d4/d36/c5f 0 2024-04-25T23:01:06.994 INFO:tasks.workunit.client.0.smithi043.stdout:2/317: fdatasync d2/d3/d13/f32 0 2024-04-25T23:01:06.995 INFO:tasks.workunit.client.0.smithi043.stdout:9/419: unlink d8/f63 0 2024-04-25T23:01:06.995 INFO:tasks.workunit.client.0.smithi043.stdout:9/420: dread - d8/de/f79 zero size 2024-04-25T23:01:06.995 INFO:tasks.workunit.client.0.smithi043.stdout:2/318: creat d2/d3/d22/d48/f64 x:0 0 0 2024-04-25T23:01:06.995 INFO:tasks.workunit.client.0.smithi043.stdout:7/422: fsync d3/da/df/d11/d26/f43 0 2024-04-25T23:01:06.996 INFO:tasks.workunit.client.0.smithi043.stdout:4/461: mknod d3/d21/ca7 0 2024-04-25T23:01:06.996 INFO:tasks.workunit.client.0.smithi043.stdout:4/462: sync 2024-04-25T23:01:06.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/423: symlink d3/da/d78/l81 0 2024-04-25T23:01:06.997 INFO:tasks.workunit.client.0.smithi043.stdout:2/319: mknod d2/d3/d22/c65 0 2024-04-25T23:01:06.997 INFO:tasks.workunit.client.0.smithi043.stdout:4/463: rename d3/c29 to d3/ca8 0 2024-04-25T23:01:06.997 INFO:tasks.workunit.client.0.smithi043.stdout:9/421: symlink d8/de/d12/d15/d2f/d84/d69/l92 0 2024-04-25T23:01:06.998 INFO:tasks.workunit.client.0.smithi043.stdout:2/320: mkdir d2/d66 0 2024-04-25T23:01:06.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/424: truncate d3/f7b 386611 0 2024-04-25T23:01:06.999 INFO:tasks.workunit.client.0.smithi043.stdout:9/422: fsync d8/de/d12/d15/f17 0 2024-04-25T23:01:06.999 INFO:tasks.workunit.client.0.smithi043.stdout:3/508: write d7/d26/d2d/f74 [4157961,92909] 0 2024-04-25T23:01:07.000 INFO:tasks.workunit.client.0.smithi043.stdout:5/448: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f65 [0,4194304] 0 2024-04-25T23:01:07.001 INFO:tasks.workunit.client.0.smithi043.stdout:5/449: readlink d0/d2c/d39/d1c/l7e 0 2024-04-25T23:01:07.002 INFO:tasks.workunit.client.0.smithi043.stdout:2/321: mkdir d2/d3/d22/d23/d43/d67 0 2024-04-25T23:01:07.002 INFO:tasks.workunit.client.0.smithi043.stdout:4/464: dread d3/d21/d6b/d87/f8b [0,4194304] 0 2024-04-25T23:01:07.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/423: symlink d8/de/l93 0 2024-04-25T23:01:07.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/367: dwrite d0/f26 [0,4194304] 0 2024-04-25T23:01:07.004 INFO:tasks.workunit.client.0.smithi043.stdout:2/322: chown d2/d3/d13/d18/l45 3189937 1 2024-04-25T23:01:07.004 INFO:tasks.workunit.client.0.smithi043.stdout:1/368: write d0/d9/f20 [1036009,80403] 0 2024-04-25T23:01:07.005 INFO:tasks.workunit.client.0.smithi043.stdout:2/323: stat d2/d3/d22/d23/f5f 0 2024-04-25T23:01:07.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/418: write fb [1669927,66276] 0 2024-04-25T23:01:07.005 INFO:tasks.workunit.client.0.smithi043.stdout:5/450: creat d0/d2c/f9a x:0 0 0 2024-04-25T23:01:07.007 INFO:tasks.workunit.client.0.smithi043.stdout:8/292: truncate d3/d4/db/df/d10/f3b 2424009 0 2024-04-25T23:01:07.008 INFO:tasks.workunit.client.0.smithi043.stdout:9/424: mknod d8/de/d12/d15/d2f/c94 0 2024-04-25T23:01:07.008 INFO:tasks.workunit.client.0.smithi043.stdout:1/369: rename d0/d2f/f60 to d0/d9/d7b/f7e 0 2024-04-25T23:01:07.009 INFO:tasks.workunit.client.0.smithi043.stdout:1/370: readlink d0/d9/l2a 0 2024-04-25T23:01:07.009 INFO:tasks.workunit.client.0.smithi043.stdout:0/419: symlink d1b/d23/l83 0 2024-04-25T23:01:07.011 INFO:tasks.workunit.client.0.smithi043.stdout:7/425: dwrite d3/d1e/d41/f7a [0,4194304] 0 2024-04-25T23:01:07.011 INFO:tasks.workunit.client.0.smithi043.stdout:8/293: mknod d3/d4/c60 0 2024-04-25T23:01:07.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/451: write d0/d2c/d39/d63/f93 [977605,65334] 0 2024-04-25T23:01:07.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/420: unlink d1b/d23/l74 0 2024-04-25T23:01:07.012 INFO:tasks.workunit.client.0.smithi043.stdout:9/425: creat d8/de/d44/d5d/d4f/f95 x:0 0 0 2024-04-25T23:01:07.012 INFO:tasks.workunit.client.0.smithi043.stdout:1/371: symlink d0/d3c/l7f 0 2024-04-25T23:01:07.013 INFO:tasks.workunit.client.0.smithi043.stdout:6/404: dread d1/d5/d3b/d4c/f25 [0,4194304] 0 2024-04-25T23:01:07.013 INFO:tasks.workunit.client.0.smithi043.stdout:4/465: dwrite d3/d19/f1e [4194304,4194304] 0 2024-04-25T23:01:07.014 INFO:tasks.workunit.client.0.smithi043.stdout:7/426: fdatasync d3/d1e/d1f/f6a 0 2024-04-25T23:01:07.014 INFO:tasks.workunit.client.0.smithi043.stdout:2/324: rename d2/d3/d22/d23/d43/d5d/c62 to d2/d3/d22/c68 0 2024-04-25T23:01:07.014 INFO:tasks.workunit.client.0.smithi043.stdout:6/405: stat d1/d5/d3b/c43 0 2024-04-25T23:01:07.014 INFO:tasks.workunit.client.0.smithi043.stdout:5/452: symlink d0/d2c/d39/d63/l9b 0 2024-04-25T23:01:07.015 INFO:tasks.workunit.client.0.smithi043.stdout:2/325: chown d2/c4c 3 1 2024-04-25T23:01:07.016 INFO:tasks.workunit.client.0.smithi043.stdout:8/294: mkdir d3/d4/db/d4e/d5c/d59/d61 0 2024-04-25T23:01:07.016 INFO:tasks.workunit.client.0.smithi043.stdout:6/406: mknod d1/d5/d3b/d4c/d21/c83 0 2024-04-25T23:01:07.018 INFO:tasks.workunit.client.0.smithi043.stdout:4/466: rename d3/c44 to d3/d21/d84/ca9 0 2024-04-25T23:01:07.018 INFO:tasks.workunit.client.0.smithi043.stdout:8/295: fdatasync d3/f48 0 2024-04-25T23:01:07.018 INFO:tasks.workunit.client.0.smithi043.stdout:2/326: symlink d2/d3/d13/d40/l69 0 2024-04-25T23:01:07.019 INFO:tasks.workunit.client.0.smithi043.stdout:7/427: creat d3/da/df/d79/f82 x:0 0 0 2024-04-25T23:01:07.019 INFO:tasks.workunit.client.0.smithi043.stdout:2/327: rmdir d2/d3/d13 39 2024-04-25T23:01:07.020 INFO:tasks.workunit.client.0.smithi043.stdout:7/428: creat d3/da/df/d11/d26/f83 x:0 0 0 2024-04-25T23:01:07.021 INFO:tasks.workunit.client.0.smithi043.stdout:8/296: rename d3/d4/db/d4e/d5c/d59/d5b to d3/d4/db/df/d62 0 2024-04-25T23:01:07.021 INFO:tasks.workunit.client.0.smithi043.stdout:5/453: dwrite d0/d2c/d39/f5b [0,4194304] 0 2024-04-25T23:01:07.024 INFO:tasks.workunit.client.0.smithi043.stdout:4/467: dread d3/f3c [0,4194304] 0 2024-04-25T23:01:07.024 INFO:tasks.workunit.client.0.smithi043.stdout:2/328: unlink d2/d3/d13/d40/f5e 0 2024-04-25T23:01:07.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/329: chown d2/d3/d13/d40/f51 0 1 2024-04-25T23:01:07.026 INFO:tasks.workunit.client.0.smithi043.stdout:3/509: dread d7/d26/d27/d34/d1a/d28/f4c [0,4194304] 0 2024-04-25T23:01:07.028 INFO:tasks.workunit.client.0.smithi043.stdout:9/426: write d8/fd [1313233,34411] 0 2024-04-25T23:01:07.028 INFO:tasks.workunit.client.0.smithi043.stdout:2/330: creat d2/d3e/f6a x:0 0 0 2024-04-25T23:01:07.028 INFO:tasks.workunit.client.0.smithi043.stdout:2/331: sync 2024-04-25T23:01:07.029 INFO:tasks.workunit.client.0.smithi043.stdout:3/510: mkdir d7/dac 0 2024-04-25T23:01:07.032 INFO:tasks.workunit.client.0.smithi043.stdout:5/454: dwrite d0/d2c/d39/d1c/d25/f56 [0,4194304] 0 2024-04-25T23:01:07.032 INFO:tasks.workunit.client.0.smithi043.stdout:9/427: chown d8/de/d12/d15/d2f/d84/d31/f3f 831174 1 2024-04-25T23:01:07.033 INFO:tasks.workunit.client.0.smithi043.stdout:8/297: dwrite d3/d1d/f27 [4194304,4194304] 0 2024-04-25T23:01:07.033 INFO:tasks.workunit.client.0.smithi043.stdout:5/455: fsync d0/f5 0 2024-04-25T23:01:07.034 INFO:tasks.workunit.client.0.smithi043.stdout:7/429: dwrite d3/f5 [0,4194304] 0 2024-04-25T23:01:07.034 INFO:tasks.workunit.client.0.smithi043.stdout:3/511: mknod d7/d26/d88/cad 0 2024-04-25T23:01:07.035 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:07.034+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:07.035 INFO:tasks.workunit.client.0.smithi043.stdout:9/428: creat d8/f96 x:0 0 0 2024-04-25T23:01:07.036 INFO:tasks.workunit.client.0.smithi043.stdout:4/468: dwrite d3/de/d46/d6a/f78 [0,4194304] 0 2024-04-25T23:01:07.036 INFO:tasks.workunit.client.0.smithi043.stdout:3/512: fsync d7/d26/d27/f80 0 2024-04-25T23:01:07.036 INFO:tasks.workunit.client.0.smithi043.stdout:8/298: creat d3/d4/db/d14/d56/d5d/f63 x:0 0 0 2024-04-25T23:01:07.037 INFO:tasks.workunit.client.0.smithi043.stdout:7/430: mknod d3/da/df/d11/c84 0 2024-04-25T23:01:07.037 INFO:tasks.workunit.client.0.smithi043.stdout:0/421: dwrite d1b/d31/f6c [0,4194304] 0 2024-04-25T23:01:07.038 INFO:tasks.workunit.client.0.smithi043.stdout:4/469: write d3/de/f35 [3945664,43566] 0 2024-04-25T23:01:07.040 INFO:tasks.workunit.client.0.smithi043.stdout:2/332: dread d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:07.040 INFO:tasks.workunit.client.0.smithi043.stdout:0/422: mknod d1b/d23/d7a/c84 0 2024-04-25T23:01:07.040 INFO:tasks.workunit.client.0.smithi043.stdout:9/429: getdents d8/de/d12/d16 0 2024-04-25T23:01:07.040 INFO:tasks.workunit.client.0.smithi043.stdout:3/513: fdatasync d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f9a 0 2024-04-25T23:01:07.040 INFO:tasks.workunit.client.0.smithi043.stdout:4/470: write d3/d21/f2e [2184845,76951] 0 2024-04-25T23:01:07.041 INFO:tasks.workunit.client.0.smithi043.stdout:8/299: write d3/d4/db/d14/f19 [193390,94748] 0 2024-04-25T23:01:07.041 INFO:tasks.workunit.client.0.smithi043.stdout:0/423: dread - d1b/d31/d3c/f6a zero size 2024-04-25T23:01:07.042 INFO:tasks.workunit.client.0.smithi043.stdout:1/372: dread d0/d16/f4a [0,4194304] 0 2024-04-25T23:01:07.042 INFO:tasks.workunit.client.0.smithi043.stdout:3/514: chown d7/d26/d27/d34/d1a/d28/f29 1 1 2024-04-25T23:01:07.042 INFO:tasks.workunit.client.0.smithi043.stdout:5/456: dread d0/f17 [0,4194304] 0 2024-04-25T23:01:07.043 INFO:tasks.workunit.client.0.smithi043.stdout:8/300: creat d3/d4/d36/f64 x:0 0 0 2024-04-25T23:01:07.043 INFO:tasks.workunit.client.0.smithi043.stdout:7/431: link d3/d1e/d1f/d54/l58 d3/d52/l85 0 2024-04-25T23:01:07.044 INFO:tasks.workunit.client.0.smithi043.stdout:3/515: creat d7/d39/d52/fae x:0 0 0 2024-04-25T23:01:07.044 INFO:tasks.workunit.client.0.smithi043.stdout:1/373: chown d0/l13 137863938 1 2024-04-25T23:01:07.044 INFO:tasks.workunit.client.0.smithi043.stdout:7/432: stat d3/d1e/d1f/d54 0 2024-04-25T23:01:07.044 INFO:tasks.workunit.client.0.smithi043.stdout:5/457: mknod d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/c9c 0 2024-04-25T23:01:07.044 INFO:tasks.workunit.client.0.smithi043.stdout:3/516: chown d7/d39/f4a 56 1 2024-04-25T23:01:07.045 INFO:tasks.workunit.client.0.smithi043.stdout:1/374: creat d0/d9/f80 x:0 0 0 2024-04-25T23:01:07.046 INFO:tasks.workunit.client.0.smithi043.stdout:0/424: creat d1b/d55/d5e/f85 x:0 0 0 2024-04-25T23:01:07.046 INFO:tasks.workunit.client.0.smithi043.stdout:7/433: write d3/d1e/d41/f4a [1936789,99887] 0 2024-04-25T23:01:07.046 INFO:tasks.workunit.client.0.smithi043.stdout:5/458: write d0/d22/f7b [373550,28201] 0 2024-04-25T23:01:07.047 INFO:tasks.workunit.client.0.smithi043.stdout:5/459: chown d0/f35 1744532 1 2024-04-25T23:01:07.047 INFO:tasks.workunit.client.0.smithi043.stdout:0/425: creat d1b/d23/f86 x:0 0 0 2024-04-25T23:01:07.048 INFO:tasks.workunit.client.0.smithi043.stdout:3/517: rename d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/l93 to d7/d26/d2d/dab/laf 0 2024-04-25T23:01:07.048 INFO:tasks.workunit.client.0.smithi043.stdout:1/375: getdents d0/d9/d7b 0 2024-04-25T23:01:07.049 INFO:tasks.workunit.client.0.smithi043.stdout:9/430: dwrite d8/de/d12/d16/f40 [0,4194304] 0 2024-04-25T23:01:07.050 INFO:tasks.workunit.client.0.smithi043.stdout:3/518: read d7/f18 [5903064,86467] 0 2024-04-25T23:01:07.051 INFO:tasks.workunit.client.0.smithi043.stdout:8/301: dread d3/d4/db/d4e/d5c/d2e/f46 [0,4194304] 0 2024-04-25T23:01:07.051 INFO:tasks.workunit.client.0.smithi043.stdout:4/471: truncate d3/de/f73 3408717 0 2024-04-25T23:01:07.052 INFO:tasks.workunit.client.0.smithi043.stdout:1/376: creat d0/d9/d7b/f81 x:0 0 0 2024-04-25T23:01:07.052 INFO:tasks.workunit.client.0.smithi043.stdout:7/434: truncate d3/da/df/d11/f20 284333 0 2024-04-25T23:01:07.052 INFO:tasks.workunit.client.0.smithi043.stdout:9/431: rmdir d8/de/d44/d5d 39 2024-04-25T23:01:07.053 INFO:tasks.workunit.client.0.smithi043.stdout:3/519: mkdir d7/d26/d88/db0 0 2024-04-25T23:01:07.053 INFO:tasks.workunit.client.0.smithi043.stdout:9/432: read d8/fd [581004,9634] 0 2024-04-25T23:01:07.053 INFO:tasks.workunit.client.0.smithi043.stdout:4/472: fsync d3/de/fd 0 2024-04-25T23:01:07.053 INFO:tasks.workunit.client.0.smithi043.stdout:8/302: creat d3/d4/db/df/d10/f65 x:0 0 0 2024-04-25T23:01:07.053 INFO:tasks.workunit.client.0.smithi043.stdout:7/435: readlink d3/da/l57 0 2024-04-25T23:01:07.054 INFO:tasks.workunit.client.0.smithi043.stdout:1/377: rmdir d0/d3d/d4f/d69 0 2024-04-25T23:01:07.054 INFO:tasks.workunit.client.0.smithi043.stdout:3/520: mkdir d7/d26/db1 0 2024-04-25T23:01:07.055 INFO:tasks.workunit.client.0.smithi043.stdout:9/433: mknod d8/de/c97 0 2024-04-25T23:01:07.056 INFO:tasks.workunit.client.0.smithi043.stdout:7/436: truncate d3/d1e/d1f/f7f 459830 0 2024-04-25T23:01:07.058 INFO:tasks.workunit.client.0.smithi043.stdout:9/434: chown d8/de/d12/d15/d2f/d84/f66 0 1 2024-04-25T23:01:07.058 INFO:tasks.workunit.client.0.smithi043.stdout:3/521: write d7/d26/d59/f71 [144231,8464] 0 2024-04-25T23:01:07.058 INFO:tasks.workunit.client.0.smithi043.stdout:8/303: mkdir d3/d4/db/d4e/d5c/d59/d61/d66 0 2024-04-25T23:01:07.058 INFO:tasks.workunit.client.0.smithi043.stdout:5/460: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/f83 [0,4194304] 0 2024-04-25T23:01:07.059 INFO:tasks.workunit.client.0.smithi043.stdout:3/522: rename d7/d39 to d7/d26/d59/d7c/db2 0 2024-04-25T23:01:07.060 INFO:tasks.workunit.client.0.smithi043.stdout:6/407: dread d1/d5/f1d [0,4194304] 0 2024-04-25T23:01:07.060 INFO:tasks.workunit.client.0.smithi043.stdout:9/435: unlink d8/de/d12/d15/d2f/f2d 0 2024-04-25T23:01:07.060 INFO:tasks.workunit.client.0.smithi043.stdout:8/304: creat d3/d4/db/df/d10/d33/f67 x:0 0 0 2024-04-25T23:01:07.060 INFO:tasks.workunit.client.0.smithi043.stdout:5/461: creat d0/f9d x:0 0 0 2024-04-25T23:01:07.061 INFO:tasks.workunit.client.0.smithi043.stdout:6/408: symlink d1/l84 0 2024-04-25T23:01:07.062 INFO:tasks.workunit.client.0.smithi043.stdout:9/436: creat d8/de/d12/d16/d24/f98 x:0 0 0 2024-04-25T23:01:07.062 INFO:tasks.workunit.client.0.smithi043.stdout:3/523: truncate d7/d26/d59/d7c/db2/d52/fae 264001 0 2024-04-25T23:01:07.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/462: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f65 [234221,39105] 0 2024-04-25T23:01:07.065 INFO:tasks.workunit.client.0.smithi043.stdout:5/463: unlink d0/d2c/c38 0 2024-04-25T23:01:07.065 INFO:tasks.workunit.client.0.smithi043.stdout:5/464: dread - d0/f9d zero size 2024-04-25T23:01:07.065 INFO:tasks.workunit.client.0.smithi043.stdout:7/437: dread d3/d1e/d41/f7a [0,4194304] 0 2024-04-25T23:01:07.065 INFO:tasks.workunit.client.0.smithi043.stdout:5/465: creat d0/d22/f9e x:0 0 0 2024-04-25T23:01:07.066 INFO:tasks.workunit.client.0.smithi043.stdout:7/438: mknod d3/d1e/d41/d63/c86 0 2024-04-25T23:01:07.068 INFO:tasks.workunit.client.0.smithi043.stdout:7/439: write d3/da/f62 [531081,38670] 0 2024-04-25T23:01:07.071 INFO:tasks.workunit.client.0.smithi043.stdout:7/440: write d3/d1e/d41/f66 [2395,13722] 0 2024-04-25T23:01:07.072 INFO:tasks.workunit.client.0.smithi043.stdout:6/409: dwrite d1/d5/d3b/d62/f69 [0,4194304] 0 2024-04-25T23:01:07.072 INFO:tasks.workunit.client.0.smithi043.stdout:5/466: mknod d0/d2c/d39/d1c/d25/d7a/d2d/d5f/c9f 0 2024-04-25T23:01:07.072 INFO:tasks.workunit.client.0.smithi043.stdout:9/437: dwrite d8/de/d12/d16/f75 [0,4194304] 0 2024-04-25T23:01:07.073 INFO:tasks.workunit.client.0.smithi043.stdout:3/524: dwrite d7/d26/d27/d34/f24 [0,4194304] 0 2024-04-25T23:01:07.074 INFO:tasks.workunit.client.0.smithi043.stdout:7/441: rmdir d3/d1e/d41 39 2024-04-25T23:01:07.074 INFO:tasks.workunit.client.0.smithi043.stdout:6/410: chown d1/d5/d3b/d4c/d21/d55/c82 9646 1 2024-04-25T23:01:07.074 INFO:tasks.workunit.client.0.smithi043.stdout:3/525: chown d7/d26/d2d/f53 4963 1 2024-04-25T23:01:07.075 INFO:tasks.workunit.client.0.smithi043.stdout:5/467: rename d0/d2c/d39/d1c/d25/d7a/d41 to d0/d2c/d39/d1c/d25/d7a/d41/d4a/d60/da0 22 2024-04-25T23:01:07.076 INFO:tasks.workunit.client.0.smithi043.stdout:3/526: creat d7/d26/d27/d34/d1a/fb3 x:0 0 0 2024-04-25T23:01:07.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/468: unlink d0/d2c/d39/d1c/d25/d7a/d2d/d8b/l97 0 2024-04-25T23:01:07.077 INFO:tasks.workunit.client.0.smithi043.stdout:3/527: symlink d7/d26/d88/lb4 0 2024-04-25T23:01:07.078 INFO:tasks.workunit.client.0.smithi043.stdout:6/411: write d1/d5/d3b/d4c/d21/d55/d68/f36 [4525442,92596] 0 2024-04-25T23:01:07.079 INFO:tasks.workunit.client.0.smithi043.stdout:6/412: dread - d1/d5/d3b/d4c/d21/d55/d6d/f70 zero size 2024-04-25T23:01:07.080 INFO:tasks.workunit.client.0.smithi043.stdout:9/438: dwrite d8/de/d12/d15/d2f/f6d [0,4194304] 0 2024-04-25T23:01:07.081 INFO:tasks.workunit.client.0.smithi043.stdout:9/439: write d8/de/f42 [719068,27954] 0 2024-04-25T23:01:07.081 INFO:tasks.workunit.client.0.smithi043.stdout:5/469: rename d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fe to d0/d2c/d39/d1c/d25/d7a/d41/fa1 0 2024-04-25T23:01:07.082 INFO:tasks.workunit.client.0.smithi043.stdout:6/413: fdatasync d1/d2a/f76 0 2024-04-25T23:01:07.083 INFO:tasks.workunit.client.0.smithi043.stdout:9/440: creat d8/de/d12/d15/d68/f99 x:0 0 0 2024-04-25T23:01:07.084 INFO:tasks.workunit.client.0.smithi043.stdout:9/441: symlink d8/de/d12/d15/d6c/l9a 0 2024-04-25T23:01:07.085 INFO:tasks.workunit.client.0.smithi043.stdout:0/426: dread f1a [0,4194304] 0 2024-04-25T23:01:07.086 INFO:tasks.workunit.client.0.smithi043.stdout:0/427: sync 2024-04-25T23:01:07.093 INFO:tasks.workunit.client.0.smithi043.stdout:9/442: dwrite d8/de/d12/d16/d24/f2a [0,4194304] 0 2024-04-25T23:01:07.094 INFO:tasks.workunit.client.0.smithi043.stdout:9/443: fdatasync d8/de/d12/d15/d68/f88 0 2024-04-25T23:01:07.094 INFO:tasks.workunit.client.0.smithi043.stdout:3/528: truncate d7/d26/d27/d34/d1a/f50 2851126 0 2024-04-25T23:01:07.095 INFO:tasks.workunit.client.0.smithi043.stdout:9/444: creat d8/de/d12/d15/f9b x:0 0 0 2024-04-25T23:01:07.097 INFO:tasks.workunit.client.0.smithi043.stdout:9/445: unlink d8/de/d12/d15/d68/f99 0 2024-04-25T23:01:07.097 INFO:tasks.workunit.client.0.smithi043.stdout:1/378: dread d0/d9/f44 [0,4194304] 0 2024-04-25T23:01:07.097 INFO:tasks.workunit.client.0.smithi043.stdout:9/446: mknod d8/de/d8c/c9c 0 2024-04-25T23:01:07.097 INFO:tasks.workunit.client.0.smithi043.stdout:3/529: link d7/d26/d59/d7c/db2/d52/l9b d7/d26/d27/d56/lb5 0 2024-04-25T23:01:07.098 INFO:tasks.workunit.client.0.smithi043.stdout:1/379: symlink d0/d3d/d4f/l82 0 2024-04-25T23:01:07.098 INFO:tasks.workunit.client.0.smithi043.stdout:8/305: dread d3/d4/db/f4b [0,4194304] 0 2024-04-25T23:01:07.098 INFO:tasks.workunit.client.0.smithi043.stdout:3/530: fsync d7/d26/f5e 0 2024-04-25T23:01:07.099 INFO:tasks.workunit.client.0.smithi043.stdout:0/428: dread d1b/f4a [0,4194304] 0 2024-04-25T23:01:07.099 INFO:tasks.workunit.client.0.smithi043.stdout:1/380: fdatasync d0/d16/f22 0 2024-04-25T23:01:07.099 INFO:tasks.workunit.client.0.smithi043.stdout:3/531: chown d7/d26/d2d/l79 59080358 1 2024-04-25T23:01:07.100 INFO:tasks.workunit.client.0.smithi043.stdout:8/306: mkdir d3/d4/db/d14/d4c/d68 0 2024-04-25T23:01:07.100 INFO:tasks.workunit.client.0.smithi043.stdout:0/429: chown d1b/d31/d3c/d50/c6f 1292613 1 2024-04-25T23:01:07.100 INFO:tasks.workunit.client.0.smithi043.stdout:1/381: rmdir d0/d2f/d4b 39 2024-04-25T23:01:07.100 INFO:tasks.workunit.client.0.smithi043.stdout:8/307: chown d3/d4/f25 176 1 2024-04-25T23:01:07.101 INFO:tasks.workunit.client.0.smithi043.stdout:1/382: creat d0/d2f/d4b/f83 x:0 0 0 2024-04-25T23:01:07.101 INFO:tasks.workunit.client.0.smithi043.stdout:8/308: stat d3/d4/db/df/d10/f65 0 2024-04-25T23:01:07.101 INFO:tasks.workunit.client.0.smithi043.stdout:1/383: creat d0/d16/d5a/f84 x:0 0 0 2024-04-25T23:01:07.102 INFO:tasks.workunit.client.0.smithi043.stdout:8/309: stat d3/d4/db/d14/f19 0 2024-04-25T23:01:07.102 INFO:tasks.workunit.client.0.smithi043.stdout:8/310: unlink d3/f35 0 2024-04-25T23:01:07.108 INFO:tasks.workunit.client.0.smithi043.stdout:2/333: dread d2/d3/d22/f26 [0,4194304] 0 2024-04-25T23:01:07.109 INFO:tasks.workunit.client.0.smithi043.stdout:3/532: dwrite d7/d26/d59/f72 [0,4194304] 0 2024-04-25T23:01:07.111 INFO:tasks.workunit.client.0.smithi043.stdout:0/430: dwrite d1b/d23/d39/f4f [0,4194304] 0 2024-04-25T23:01:07.111 INFO:tasks.workunit.client.0.smithi043.stdout:2/334: chown d2/d3/f47 1156903107 1 2024-04-25T23:01:07.113 INFO:tasks.workunit.client.0.smithi043.stdout:0/431: stat d1b/d31/d3c/f6a 0 2024-04-25T23:01:07.113 INFO:tasks.workunit.client.0.smithi043.stdout:9/447: dwrite d8/de/d44/d5d/d4f/f91 [0,4194304] 0 2024-04-25T23:01:07.114 INFO:tasks.workunit.client.0.smithi043.stdout:1/384: dwrite d0/d2f/d4b/f75 [0,4194304] 0 2024-04-25T23:01:07.115 INFO:tasks.workunit.client.0.smithi043.stdout:4/473: dread d3/d21/d6b/f7f [0,4194304] 0 2024-04-25T23:01:07.115 INFO:tasks.workunit.client.0.smithi043.stdout:4/474: readlink d3/d19/l4c 0 2024-04-25T23:01:07.116 INFO:tasks.workunit.client.0.smithi043.stdout:8/311: dwrite d3/d4/db/df/d10/d33/f67 [0,4194304] 0 2024-04-25T23:01:07.116 INFO:tasks.workunit.client.0.smithi043.stdout:9/448: write d8/de/d44/d5d/d4f/f91 [3647959,59291] 0 2024-04-25T23:01:07.116 INFO:tasks.workunit.client.0.smithi043.stdout:2/335: creat d2/d3/d13/d40/f6b x:0 0 0 2024-04-25T23:01:07.117 INFO:tasks.workunit.client.0.smithi043.stdout:1/385: symlink d0/d16/d5a/d5b/l85 0 2024-04-25T23:01:07.117 INFO:tasks.workunit.client.0.smithi043.stdout:4/475: unlink d3/d21/f59 0 2024-04-25T23:01:07.118 INFO:tasks.workunit.client.0.smithi043.stdout:1/386: dread - d0/d2f/d4b/f7c zero size 2024-04-25T23:01:07.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/336: read - d2/d3/f4a zero size 2024-04-25T23:01:07.119 INFO:tasks.workunit.client.0.smithi043.stdout:9/449: write d8/de/d12/d16/f40 [1648318,110462] 0 2024-04-25T23:01:07.119 INFO:tasks.workunit.client.0.smithi043.stdout:1/387: readlink d0/d3c/l7f 0 2024-04-25T23:01:07.119 INFO:tasks.workunit.client.0.smithi043.stdout:7/442: dread d3/da/df/f48 [4194304,4194304] 0 2024-04-25T23:01:07.120 INFO:tasks.workunit.client.0.smithi043.stdout:8/312: creat d3/d4/db/d4e/f69 x:0 0 0 2024-04-25T23:01:07.120 INFO:tasks.workunit.client.0.smithi043.stdout:3/533: rename d7/d26/d2d/f74 to d7/d26/d27/d34/fb6 0 2024-04-25T23:01:07.122 INFO:tasks.workunit.client.0.smithi043.stdout:1/388: mkdir d0/d86 0 2024-04-25T23:01:07.122 INFO:tasks.workunit.client.0.smithi043.stdout:2/337: symlink d2/d3/d22/d23/d43/d5d/l6c 0 2024-04-25T23:01:07.122 INFO:tasks.workunit.client.0.smithi043.stdout:7/443: chown d3/da/l57 2993361 1 2024-04-25T23:01:07.122 INFO:tasks.workunit.client.0.smithi043.stdout:8/313: mkdir d3/d4/db/d14/d4c/d6a 0 2024-04-25T23:01:07.123 INFO:tasks.workunit.client.0.smithi043.stdout:9/450: rename d8/de/d44/l87 to d8/de/d44/l9d 0 2024-04-25T23:01:07.123 INFO:tasks.workunit.client.0.smithi043.stdout:4/476: link d3/ca8 d3/de/d46/d6a/d8f/caa 0 2024-04-25T23:01:07.123 INFO:tasks.workunit.client.0.smithi043.stdout:2/338: rename d2/d3 to d2/d3/d6d 22 2024-04-25T23:01:07.125 INFO:tasks.workunit.client.0.smithi043.stdout:2/339: readlink d2/d3/d22/d23/l1f 0 2024-04-25T23:01:07.125 INFO:tasks.workunit.client.0.smithi043.stdout:7/444: truncate d3/da/df/d11/d26/f43 2081032 0 2024-04-25T23:01:07.126 INFO:tasks.workunit.client.0.smithi043.stdout:0/432: dwrite d1b/d31/d3c/f48 [0,4194304] 0 2024-04-25T23:01:07.126 INFO:tasks.workunit.client.0.smithi043.stdout:8/314: creat d3/d4/db/d4e/d5c/d59/d61/d66/f6b x:0 0 0 2024-04-25T23:01:07.126 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:07.124+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:07.126 INFO:tasks.workunit.client.0.smithi043.stdout:0/433: stat d1b/l79 0 2024-04-25T23:01:07.127 INFO:tasks.workunit.client.0.smithi043.stdout:2/340: creat d2/d3/d13/f6e x:0 0 0 2024-04-25T23:01:07.127 INFO:tasks.workunit.client.0.smithi043.stdout:0/434: rmdir d1b/d31/d3c/d72 39 2024-04-25T23:01:07.128 INFO:tasks.workunit.client.0.smithi043.stdout:8/315: getdents d3/d4/db/d14/d4c/d68 0 2024-04-25T23:01:07.128 INFO:tasks.workunit.client.0.smithi043.stdout:2/341: write d2/d3/d22/f26 [3759689,71540] 0 2024-04-25T23:01:07.128 INFO:tasks.workunit.client.0.smithi043.stdout:8/316: stat d3/c55 0 2024-04-25T23:01:07.130 INFO:tasks.workunit.client.0.smithi043.stdout:1/389: dwrite d0/d16/d5a/f6e [0,4194304] 0 2024-04-25T23:01:07.130 INFO:tasks.workunit.client.0.smithi043.stdout:8/317: unlink d3/d1d/f37 0 2024-04-25T23:01:07.130 INFO:tasks.workunit.client.0.smithi043.stdout:2/342: creat d2/d3/d22/f6f x:0 0 0 2024-04-25T23:01:07.131 INFO:tasks.workunit.client.0.smithi043.stdout:1/390: write d0/d2f/d4b/f7c [96192,25006] 0 2024-04-25T23:01:07.132 INFO:tasks.workunit.client.0.smithi043.stdout:7/445: dwrite d3/d52/f60 [0,4194304] 0 2024-04-25T23:01:07.135 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:07.135 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:07.136 INFO:tasks.workunit.client.0.smithi043.stdout:1/391: mknod d0/d2f/d4b/c87 0 2024-04-25T23:01:07.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/451: write d8/de/d12/d16/d24/f33 [3152034,1882] 0 2024-04-25T23:01:07.137 INFO:tasks.workunit.client.0.smithi043.stdout:6/414: dread d1/d5/d3b/d4c/f11 [0,4194304] 0 2024-04-25T23:01:07.137 INFO:tasks.workunit.client.0.smithi043.stdout:4/477: truncate d3/de/d27/d45/f88 629637 0 2024-04-25T23:01:07.138 INFO:tasks.workunit.client.0.smithi043.stdout:2/343: dwrite d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:07.138 INFO:tasks.workunit.client.0.smithi043.stdout:1/392: write d0/f1a [782906,71807] 0 2024-04-25T23:01:07.138 INFO:tasks.workunit.client.0.smithi043.stdout:8/318: dwrite d3/d4/db/df/d10/f15 [0,4194304] 0 2024-04-25T23:01:07.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/344: dread - d2/d3/f47 zero size 2024-04-25T23:01:07.140 INFO:tasks.workunit.client.0.smithi043.stdout:8/319: chown d3/d4/db 1844 1 2024-04-25T23:01:07.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/345: truncate d2/d3/f47 53824 0 2024-04-25T23:01:07.140 INFO:tasks.workunit.client.0.smithi043.stdout:6/415: fsync d1/f29 0 2024-04-25T23:01:07.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/393: symlink d0/d9/d63/l88 0 2024-04-25T23:01:07.140 INFO:tasks.workunit.client.0.smithi043.stdout:8/320: symlink d3/d4/db/d14/d4c/d68/l6c 0 2024-04-25T23:01:07.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/346: stat d2/d3/f2f 0 2024-04-25T23:01:07.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/321: readlink d3/d1d/l3d 0 2024-04-25T23:01:07.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/347: dread - d2/d3/d22/f60 zero size 2024-04-25T23:01:07.143 INFO:tasks.workunit.client.0.smithi043.stdout:8/322: mkdir d3/d4/d6d 0 2024-04-25T23:01:07.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/394: truncate d0/fa 2884769 0 2024-04-25T23:01:07.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/348: symlink d2/d3/l70 0 2024-04-25T23:01:07.146 INFO:tasks.workunit.client.0.smithi043.stdout:1/395: chown d0/l53 4654298 1 2024-04-25T23:01:07.147 INFO:tasks.workunit.client.0.smithi043.stdout:7/446: dwrite d3/da/df/d11/f2f [0,4194304] 0 2024-04-25T23:01:07.148 INFO:tasks.workunit.client.0.smithi043.stdout:4/478: dwrite d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:07.149 INFO:tasks.workunit.client.0.smithi043.stdout:7/447: mknod d3/da/d78/c87 0 2024-04-25T23:01:07.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/349: creat d2/d3/d13/d18/f71 x:0 0 0 2024-04-25T23:01:07.149 INFO:tasks.workunit.client.0.smithi043.stdout:1/396: rename d0/d3c/l42 to d0/d16/l89 0 2024-04-25T23:01:07.150 INFO:tasks.workunit.client.0.smithi043.stdout:7/448: readlink d3/l28 0 2024-04-25T23:01:07.150 INFO:tasks.workunit.client.0.smithi043.stdout:1/397: write d0/d2f/d4b/f75 [4809545,7300] 0 2024-04-25T23:01:07.153 INFO:tasks.workunit.client.0.smithi043.stdout:7/449: creat d3/d1e/d1f/d54/d7d/f88 x:0 0 0 2024-04-25T23:01:07.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/452: dwrite d8/f59 [0,4194304] 0 2024-04-25T23:01:07.154 INFO:tasks.workunit.client.0.smithi043.stdout:7/450: write d3/d1e/f47 [762579,129589] 0 2024-04-25T23:01:07.154 INFO:tasks.workunit.client.0.smithi043.stdout:9/453: chown d8/de/d12/d15/d2f/d84 18 1 2024-04-25T23:01:07.155 INFO:tasks.workunit.client.0.smithi043.stdout:1/398: rename d0/d16/c5c to d0/d86/c8a 0 2024-04-25T23:01:07.155 INFO:tasks.workunit.client.0.smithi043.stdout:6/416: truncate d1/d5/d3b/d4c/d21/d55/d68/f36 1072072 0 2024-04-25T23:01:07.157 INFO:tasks.workunit.client.0.smithi043.stdout:4/479: dwrite d3/de/f13 [4194304,4194304] 0 2024-04-25T23:01:07.159 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:07.160 INFO:tasks.workunit.client.0.smithi043.stdout:2/350: link d2/d3/d22/f26 d2/d3/d22/d23/f72 0 2024-04-25T23:01:07.161 INFO:tasks.workunit.client.0.smithi043.stdout:1/399: creat d0/d9/d63/f8b x:0 0 0 2024-04-25T23:01:07.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/454: creat d8/de/d44/d47/d6a/f9e x:0 0 0 2024-04-25T23:01:07.162 INFO:tasks.workunit.client.0.smithi043.stdout:2/351: write d2/d3/d22/d23/f5f [632962,43318] 0 2024-04-25T23:01:07.162 INFO:tasks.workunit.client.0.smithi043.stdout:2/352: chown d2/c4c 807691320 1 2024-04-25T23:01:07.163 INFO:tasks.workunit.client.0.smithi043.stdout:5/470: dread d0/d2c/d39/d1c/d25/d7a/f44 [0,4194304] 0 2024-04-25T23:01:07.163 INFO:tasks.workunit.client.0.smithi043.stdout:2/353: write d2/d3e/f3f [1791935,3801] 0 2024-04-25T23:01:07.164 INFO:tasks.workunit.client.0.smithi043.stdout:7/451: creat d3/d1e/d41/f89 x:0 0 0 2024-04-25T23:01:07.164 INFO:tasks.workunit.client.0.smithi043.stdout:1/400: mknod d0/d9/d63/c8c 0 2024-04-25T23:01:07.165 INFO:tasks.workunit.client.0.smithi043.stdout:6/417: creat d1/d5/d3b/f85 x:0 0 0 2024-04-25T23:01:07.165 INFO:tasks.workunit.client.0.smithi043.stdout:2/354: truncate d2/d3/d22/d48/f5a 981388 0 2024-04-25T23:01:07.166 INFO:tasks.workunit.client.0.smithi043.stdout:9/455: getdents d8/de/d12/d15/d2f 0 2024-04-25T23:01:07.167 INFO:tasks.workunit.client.0.smithi043.stdout:1/401: mknod d0/d16/d5a/d5b/c8d 0 2024-04-25T23:01:07.168 INFO:tasks.workunit.client.0.smithi043.stdout:5/471: link d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e d0/d2c/d39/d1c/d25/fa2 0 2024-04-25T23:01:07.169 INFO:tasks.workunit.client.0.smithi043.stdout:7/452: link d3/f5 d3/d1e/d1f/d54/d7d/f8a 0 2024-04-25T23:01:07.170 INFO:tasks.workunit.client.0.smithi043.stdout:7/453: chown d3/c3b 22391693 1 2024-04-25T23:01:07.171 INFO:tasks.workunit.client.0.smithi043.stdout:9/456: write d8/de/d12/d16/d24/f62 [320604,21084] 0 2024-04-25T23:01:07.171 INFO:tasks.workunit.client.0.smithi043.stdout:5/472: mknod d0/d2c/d39/d1c/d25/d7a/d41/d47/ca3 0 2024-04-25T23:01:07.174 INFO:tasks.workunit.client.0.smithi043.stdout:6/418: dwrite d1/d5/f2c [0,4194304] 0 2024-04-25T23:01:07.174 INFO:tasks.workunit.client.0.smithi043.stdout:2/355: dwrite d2/d3/d22/d48/f64 [0,4194304] 0 2024-04-25T23:01:07.175 INFO:tasks.workunit.client.0.smithi043.stdout:9/457: truncate d8/de/d44/d5d/d4f/f95 981164 0 2024-04-25T23:01:07.175 INFO:tasks.workunit.client.0.smithi043.stdout:0/435: dread d1b/d42/f5b [0,4194304] 0 2024-04-25T23:01:07.176 INFO:tasks.workunit.client.0.smithi043.stdout:1/402: dwrite d0/d2f/f71 [0,4194304] 0 2024-04-25T23:01:07.177 INFO:tasks.workunit.client.0.smithi043.stdout:9/458: write d8/de/d12/d15/d68/f88 [428337,78262] 0 2024-04-25T23:01:07.183 INFO:tasks.workunit.client.0.smithi043.stdout:6/419: symlink d1/d5/d3b/d4c/d21/d38/d60/l86 0 2024-04-25T23:01:07.183 INFO:tasks.workunit.client.0.smithi043.stdout:0/436: unlink d1b/f2b 0 2024-04-25T23:01:07.183 INFO:tasks.workunit.client.0.smithi043.stdout:1/403: readlink d0/d16/l89 0 2024-04-25T23:01:07.185 INFO:tasks.workunit.client.0.smithi043.stdout:4/480: truncate d3/fa 210939 0 2024-04-25T23:01:07.185 INFO:tasks.workunit.client.0.smithi043.stdout:9/459: mknod d8/de/d44/d47/c9f 0 2024-04-25T23:01:07.185 INFO:tasks.workunit.client.0.smithi043.stdout:7/454: link d3/da/df/d11/f15 d3/da/d64/f8b 0 2024-04-25T23:01:07.185 INFO:tasks.workunit.client.0.smithi043.stdout:5/473: creat d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 x:0 0 0 2024-04-25T23:01:07.186 INFO:tasks.workunit.client.0.smithi043.stdout:1/404: symlink d0/d2f/l8e 0 2024-04-25T23:01:07.186 INFO:tasks.workunit.client.0.smithi043.stdout:0/437: getdents d1b/d7f 0 2024-04-25T23:01:07.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/438: dread - d1b/d31/f49 zero size 2024-04-25T23:01:07.187 INFO:tasks.workunit.client.0.smithi043.stdout:4/481: unlink d3/de/l36 0 2024-04-25T23:01:07.187 INFO:tasks.workunit.client.0.smithi043.stdout:5/474: chown d0/d2c/d39/f5b 16753 1 2024-04-25T23:01:07.187 INFO:tasks.workunit.client.0.smithi043.stdout:1/405: mkdir d0/d2f/d4b/d8f 0 2024-04-25T23:01:07.188 INFO:tasks.workunit.client.0.smithi043.stdout:7/455: write d3/d1e/d41/f4a [1500162,103048] 0 2024-04-25T23:01:07.188 INFO:tasks.workunit.client.0.smithi043.stdout:9/460: truncate d8/de/d12/d16/d24/f62 1886670 0 2024-04-25T23:01:07.188 INFO:tasks.workunit.client.0.smithi043.stdout:5/475: write d0/d2c/d39/f88 [470127,85152] 0 2024-04-25T23:01:07.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/482: creat d3/d19/fab x:0 0 0 2024-04-25T23:01:07.189 INFO:tasks.workunit.client.0.smithi043.stdout:9/461: write d8/de/d12/d15/d2f/f50 [903944,55503] 0 2024-04-25T23:01:07.190 INFO:tasks.workunit.client.0.smithi043.stdout:7/456: creat d3/da/df/f8c x:0 0 0 2024-04-25T23:01:07.191 INFO:tasks.workunit.client.0.smithi043.stdout:5/476: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f5c [1042966,120] 0 2024-04-25T23:01:07.192 INFO:tasks.workunit.client.0.smithi043.stdout:6/420: dwrite d1/d5/d3b/f3c [0,4194304] 0 2024-04-25T23:01:07.193 INFO:tasks.workunit.client.0.smithi043.stdout:1/406: write d0/d2f/d4b/f83 [303876,20859] 0 2024-04-25T23:01:07.193 INFO:tasks.workunit.client.0.smithi043.stdout:6/421: dread - d1/d5/d3b/d4c/f58 zero size 2024-04-25T23:01:07.197 INFO:tasks.workunit.client.0.smithi043.stdout:0/439: dwrite d1b/d23/d39/f46 [0,4194304] 0 2024-04-25T23:01:07.197 INFO:tasks.workunit.client.0.smithi043.stdout:2/356: dread d2/fc [0,4194304] 0 2024-04-25T23:01:07.198 INFO:tasks.workunit.client.0.smithi043.stdout:2/357: chown d2/d3/d13/l14 0 1 2024-04-25T23:01:07.198 INFO:tasks.workunit.client.0.smithi043.stdout:3/534: dread d7/d26/d59/d7c/db2/f4a [0,4194304] 0 2024-04-25T23:01:07.200 INFO:tasks.workunit.client.0.smithi043.stdout:5/477: dwrite d0/d2c/d39/f34 [0,4194304] 0 2024-04-25T23:01:07.200 INFO:tasks.workunit.client.0.smithi043.stdout:7/457: dread d3/f7b [0,4194304] 0 2024-04-25T23:01:07.200 INFO:tasks.workunit.client.0.smithi043.stdout:8/323: dread d3/d4/f8 [4194304,4194304] 0 2024-04-25T23:01:07.201 INFO:tasks.workunit.client.0.smithi043.stdout:7/458: chown d3/da/l10 3034792 1 2024-04-25T23:01:07.202 INFO:tasks.workunit.client.0.smithi043.stdout:1/407: truncate d0/d16/f5e 2648950 0 2024-04-25T23:01:07.203 INFO:tasks.workunit.client.0.smithi043.stdout:7/459: chown d3/da/df/c76 2026 1 2024-04-25T23:01:07.203 INFO:tasks.workunit.client.0.smithi043.stdout:8/324: fdatasync d3/d4/db/df/d10/f65 0 2024-04-25T23:01:07.203 INFO:tasks.workunit.client.0.smithi043.stdout:3/535: dread d7/d26/d27/d34/d1a/f50 [0,4194304] 0 2024-04-25T23:01:07.203 INFO:tasks.workunit.client.0.smithi043.stdout:9/462: link d8/de/d12/c58 d8/de/d12/d15/d2f/ca0 0 2024-04-25T23:01:07.203 INFO:tasks.workunit.client.0.smithi043.stdout:2/358: chown d2/d3/d22/d23/f57 3715 1 2024-04-25T23:01:07.203 INFO:tasks.workunit.client.0.smithi043.stdout:7/460: stat d3/da/l57 0 2024-04-25T23:01:07.204 INFO:tasks.workunit.client.0.smithi043.stdout:3/536: read - d7/d26/d59/fa2 zero size 2024-04-25T23:01:07.204 INFO:tasks.workunit.client.0.smithi043.stdout:8/325: truncate d3/d1d/f27 9080594 0 2024-04-25T23:01:07.204 INFO:tasks.workunit.client.0.smithi043.stdout:1/408: rmdir d0/d3d 39 2024-04-25T23:01:07.204 INFO:tasks.workunit.client.0.smithi043.stdout:9/463: mkdir d8/de/d44/d5d/da1 0 2024-04-25T23:01:07.205 INFO:tasks.workunit.client.0.smithi043.stdout:6/422: dwrite d1/d5/d3b/d4c/d1a/f27 [0,4194304] 0 2024-04-25T23:01:07.206 INFO:tasks.workunit.client.0.smithi043.stdout:0/440: truncate d1b/d23/f3d 1638791 0 2024-04-25T23:01:07.206 INFO:tasks.workunit.client.0.smithi043.stdout:6/423: readlink d1/d5/d3b/d4c/d1a/l4b 0 2024-04-25T23:01:07.207 INFO:tasks.workunit.client.0.smithi043.stdout:7/461: mkdir d3/da/df/d11/d8d 0 2024-04-25T23:01:07.207 INFO:tasks.workunit.client.0.smithi043.stdout:5/478: creat d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa5 x:0 0 0 2024-04-25T23:01:07.208 INFO:tasks.workunit.client.0.smithi043.stdout:8/326: truncate d3/d4/db/df/d10/d33/f1a 370771 0 2024-04-25T23:01:07.208 INFO:tasks.workunit.client.0.smithi043.stdout:9/464: creat d8/de/d12/fa2 x:0 0 0 2024-04-25T23:01:07.208 INFO:tasks.workunit.client.0.smithi043.stdout:7/462: chown d3/d1e/d41/f66 3 1 2024-04-25T23:01:07.208 INFO:tasks.workunit.client.0.smithi043.stdout:6/424: creat d1/d5/d3b/d4c/d21/d38/f87 x:0 0 0 2024-04-25T23:01:07.209 INFO:tasks.workunit.client.0.smithi043.stdout:1/409: dread d0/d16/d5a/f6e [0,4194304] 0 2024-04-25T23:01:07.209 INFO:tasks.workunit.client.0.smithi043.stdout:5/479: unlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa5 0 2024-04-25T23:01:07.209 INFO:tasks.workunit.client.0.smithi043.stdout:6/425: write d1/d5/d3b/d4c/f58 [154500,10995] 0 2024-04-25T23:01:07.209 INFO:tasks.workunit.client.0.smithi043.stdout:7/463: chown d3/da/df/d11/d26/c32 60 1 2024-04-25T23:01:07.210 INFO:tasks.workunit.client.0.smithi043.stdout:1/410: creat d0/d9/d63/f90 x:0 0 0 2024-04-25T23:01:07.210 INFO:tasks.workunit.client.0.smithi043.stdout:6/426: mknod d1/d5/d3b/d4c/d21/d55/c88 0 2024-04-25T23:01:07.211 INFO:tasks.workunit.client.0.smithi043.stdout:8/327: read d3/d4/f8 [3082420,97409] 0 2024-04-25T23:01:07.211 INFO:tasks.workunit.client.0.smithi043.stdout:5/480: write d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 [36194,94677] 0 2024-04-25T23:01:07.211 INFO:tasks.workunit.client.0.smithi043.stdout:7/464: creat d3/da/df/d11/d26/f8e x:0 0 0 2024-04-25T23:01:07.212 INFO:tasks.workunit.client.0.smithi043.stdout:6/427: readlink d1/d5/d3b/d4c/d21/d55/d57/l5f 0 2024-04-25T23:01:07.213 INFO:tasks.workunit.client.0.smithi043.stdout:7/465: write d3/d1e/d1f/f51 [1107403,111678] 0 2024-04-25T23:01:07.213 INFO:tasks.workunit.client.0.smithi043.stdout:5/481: chown d0/d2c/d39/d1c/d25/d7a/d2d/d8b 334469 1 2024-04-25T23:01:07.213 INFO:tasks.workunit.client.0.smithi043.stdout:8/328: mkdir d3/d4/db/df/d62/d6e 0 2024-04-25T23:01:07.213 INFO:tasks.workunit.client.0.smithi043.stdout:4/483: sync 2024-04-25T23:01:07.215 INFO:tasks.workunit.client.0.smithi043.stdout:7/466: write d3/da/df/d11/f2f [3351368,4670] 0 2024-04-25T23:01:07.215 INFO:tasks.workunit.client.0.smithi043.stdout:9/465: dwrite d8/f5a [4194304,4194304] 0 2024-04-25T23:01:07.215 INFO:tasks.workunit.client.0.smithi043.stdout:1/411: dread d0/f26 [0,4194304] 0 2024-04-25T23:01:07.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/428: mknod d1/d5/d3b/d4c/d21/d46/c89 0 2024-04-25T23:01:07.216 INFO:tasks.workunit.client.0.smithi043.stdout:5/482: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/fa6 x:0 0 0 2024-04-25T23:01:07.216 INFO:tasks.workunit.client.0.smithi043.stdout:9/466: write d8/f59 [4022768,92022] 0 2024-04-25T23:01:07.217 INFO:tasks.workunit.client.0.smithi043.stdout:5/483: stat d0/d6a/l8f 0 2024-04-25T23:01:07.218 INFO:tasks.workunit.client.0.smithi043.stdout:7/467: rename d3/d1e/d41 to d3/d1e/d41/d8f 22 2024-04-25T23:01:07.218 INFO:tasks.workunit.client.0.smithi043.stdout:7/468: rmdir d3/d1e/d1f/d54/d7d 39 2024-04-25T23:01:07.220 INFO:tasks.workunit.client.0.smithi043.stdout:0/441: truncate d1b/d42/f64 2618 0 2024-04-25T23:01:07.221 INFO:tasks.workunit.client.0.smithi043.stdout:4/484: write d3/d37/d7a/fa1 [340769,44434] 0 2024-04-25T23:01:07.221 INFO:tasks.workunit.client.0.smithi043.stdout:0/442: write d1b/d23/f3e [1540249,66970] 0 2024-04-25T23:01:07.222 INFO:tasks.workunit.client.0.smithi043.stdout:9/467: dread d8/de/d12/d16/f30 [0,4194304] 0 2024-04-25T23:01:07.222 INFO:tasks.workunit.client.0.smithi043.stdout:0/443: mknod d1b/d31/d3c/d50/c87 0 2024-04-25T23:01:07.223 INFO:tasks.workunit.client.0.smithi043.stdout:5/484: write d0/f40 [833338,99482] 0 2024-04-25T23:01:07.223 INFO:tasks.workunit.client.0.smithi043.stdout:0/444: write d1b/f45 [1720345,79264] 0 2024-04-25T23:01:07.224 INFO:tasks.workunit.client.0.smithi043.stdout:0/445: fdatasync f11 0 2024-04-25T23:01:07.225 INFO:tasks.workunit.client.0.smithi043.stdout:5/485: creat d0/d2c/d39/d1c/d5e/fa7 x:0 0 0 2024-04-25T23:01:07.226 INFO:tasks.workunit.client.0.smithi043.stdout:5/486: unlink d0/d2c/f7f 0 2024-04-25T23:01:07.228 INFO:tasks.workunit.client.0.smithi043.stdout:2/359: dread d2/d3/d22/d23/f37 [0,4194304] 0 2024-04-25T23:01:07.228 INFO:tasks.workunit.client.0.smithi043.stdout:1/412: dread d0/d3c/f79 [0,4194304] 0 2024-04-25T23:01:07.228 INFO:tasks.workunit.client.0.smithi043.stdout:5/487: rename d0/l16 to d0/d2c/d39/la8 0 2024-04-25T23:01:07.228 INFO:tasks.workunit.client.0.smithi043.stdout:4/485: dread d3/d21/f64 [0,4194304] 0 2024-04-25T23:01:07.229 INFO:tasks.workunit.client.0.smithi043.stdout:9/468: dwrite d8/de/d12/d15/d2f/f50 [0,4194304] 0 2024-04-25T23:01:07.229 INFO:tasks.workunit.client.0.smithi043.stdout:1/413: fsync d0/d3d/f50 0 2024-04-25T23:01:07.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/360: mknod d2/d66/c73 0 2024-04-25T23:01:07.229 INFO:tasks.workunit.client.0.smithi043.stdout:1/414: stat d0/d2f/f48 0 2024-04-25T23:01:07.230 INFO:tasks.workunit.client.0.smithi043.stdout:6/429: dread d1/d5/f22 [0,4194304] 0 2024-04-25T23:01:07.231 INFO:tasks.workunit.client.0.smithi043.stdout:2/361: creat d2/d3/d13/d40/f74 x:0 0 0 2024-04-25T23:01:07.232 INFO:tasks.workunit.client.0.smithi043.stdout:1/415: symlink d0/d86/l91 0 2024-04-25T23:01:07.233 INFO:tasks.workunit.client.0.smithi043.stdout:6/430: mknod d1/d5/c8a 0 2024-04-25T23:01:07.234 INFO:tasks.workunit.client.0.smithi043.stdout:4/486: getdents d3/d19/d34/d76 0 2024-04-25T23:01:07.234 INFO:tasks.workunit.client.0.smithi043.stdout:1/416: stat d0/d9/d63/c6f 0 2024-04-25T23:01:07.234 INFO:tasks.workunit.client.0.smithi043.stdout:5/488: dread d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e [0,4194304] 0 2024-04-25T23:01:07.236 INFO:tasks.workunit.client.0.smithi043.stdout:4/487: creat d3/de/d46/d6a/fac x:0 0 0 2024-04-25T23:01:07.236 INFO:tasks.workunit.client.0.smithi043.stdout:7/469: dwrite d3/da/df/d11/f20 [0,4194304] 0 2024-04-25T23:01:07.237 INFO:tasks.workunit.client.0.smithi043.stdout:6/431: mknod d1/d5/d3b/d4c/c8b 0 2024-04-25T23:01:07.238 INFO:tasks.workunit.client.0.smithi043.stdout:4/488: fsync d3/d21/d6b/f75 0 2024-04-25T23:01:07.238 INFO:tasks.workunit.client.0.smithi043.stdout:8/329: dwrite d3/d4/db/df/d10/d33/f1a [0,4194304] 0 2024-04-25T23:01:07.238 INFO:tasks.workunit.client.0.smithi043.stdout:8/330: sync 2024-04-25T23:01:07.238 INFO:tasks.workunit.client.0.smithi043.stdout:7/470: dread - d3/da/df/d11/d26/f83 zero size 2024-04-25T23:01:07.239 INFO:tasks.workunit.client.0.smithi043.stdout:8/331: stat d3/d4/db/d14/d4c/d68 0 2024-04-25T23:01:07.240 INFO:tasks.workunit.client.0.smithi043.stdout:7/471: fsync d3/d1e/d41/f7a 0 2024-04-25T23:01:07.241 INFO:tasks.workunit.client.0.smithi043.stdout:6/432: rename d1/d5/fd to d1/d5/d3b/d4c/d21/d38/f8c 0 2024-04-25T23:01:07.241 INFO:tasks.workunit.client.0.smithi043.stdout:9/469: dread d8/de/d12/d16/d24/f62 [0,4194304] 0 2024-04-25T23:01:07.241 INFO:tasks.workunit.client.0.smithi043.stdout:6/433: chown d1/d5/d3b/d4c 117316693 1 2024-04-25T23:01:07.243 INFO:tasks.workunit.client.0.smithi043.stdout:4/489: rename d3/ca8 to d3/d21/d6b/d87/d8a/cad 0 2024-04-25T23:01:07.243 INFO:tasks.workunit.client.0.smithi043.stdout:1/417: dwrite d0/d16/f2d [0,4194304] 0 2024-04-25T23:01:07.244 INFO:tasks.workunit.client.0.smithi043.stdout:6/434: mknod d1/d5/c8d 0 2024-04-25T23:01:07.245 INFO:tasks.workunit.client.0.smithi043.stdout:9/470: truncate d8/de/d44/f60 3072052 0 2024-04-25T23:01:07.246 INFO:tasks.workunit.client.0.smithi043.stdout:3/537: dread d7/d26/d27/d34/d1a/d40/f47 [0,4194304] 0 2024-04-25T23:01:07.246 INFO:tasks.workunit.client.0.smithi043.stdout:8/332: getdents d3/d4/db/d14/d4c/d68 0 2024-04-25T23:01:07.246 INFO:tasks.workunit.client.0.smithi043.stdout:1/418: creat d0/d2f/d4b/f92 x:0 0 0 2024-04-25T23:01:07.247 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:07.246+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:07.247 INFO:tasks.workunit.client.0.smithi043.stdout:4/490: creat d3/de/d46/d6a/d8f/d8e/fae x:0 0 0 2024-04-25T23:01:07.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/333: chown d3/d4/db/d14/d4c/d6a 12724 1 2024-04-25T23:01:07.247 INFO:tasks.workunit.client.0.smithi043.stdout:9/471: rmdir d8/de/d12/d15/d68 39 2024-04-25T23:01:07.247 INFO:tasks.workunit.client.0.smithi043.stdout:3/538: readlink d7/d26/d27/d34/d1a/l1c 0 2024-04-25T23:01:07.248 INFO:tasks.workunit.client.0.smithi043.stdout:1/419: creat d0/d9/d7b/f93 x:0 0 0 2024-04-25T23:01:07.248 INFO:tasks.workunit.client.0.smithi043.stdout:7/472: link d3/da/l57 d3/da/df/d11/l90 0 2024-04-25T23:01:07.248 INFO:tasks.workunit.client.0.smithi043.stdout:9/472: chown d8/f96 7 1 2024-04-25T23:01:07.249 INFO:tasks.workunit.client.0.smithi043.stdout:8/334: chown d3/d4/db/d4e/f69 94196 1 2024-04-25T23:01:07.250 INFO:tasks.workunit.client.0.smithi043.stdout:1/420: rmdir d0/d16 39 2024-04-25T23:01:07.250 INFO:tasks.workunit.client.0.smithi043.stdout:7/473: readlink d3/da/df/d11/l3a 0 2024-04-25T23:01:07.250 INFO:tasks.workunit.client.0.smithi043.stdout:6/435: dwrite d1/d5/d3b/d4c/d1a/f2e [0,4194304] 0 2024-04-25T23:01:07.251 INFO:tasks.workunit.client.0.smithi043.stdout:9/473: link d8/de/d12/d16/d24/f2a d8/de/d44/d5d/da1/fa3 0 2024-04-25T23:01:07.251 INFO:tasks.workunit.client.0.smithi043.stdout:8/335: fdatasync d3/d4/db/df/d10/f3b 0 2024-04-25T23:01:07.251 INFO:tasks.workunit.client.0.smithi043.stdout:1/421: read - d0/d3d/d4f/f64 zero size 2024-04-25T23:01:07.252 INFO:tasks.workunit.client.0.smithi043.stdout:3/539: unlink d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/l9f 0 2024-04-25T23:01:07.253 INFO:tasks.workunit.client.0.smithi043.stdout:6/436: mkdir d1/d5/d3b/d4c/d21/d46/d8e 0 2024-04-25T23:01:07.253 INFO:tasks.workunit.client.0.smithi043.stdout:1/422: mkdir d0/d16/d94 0 2024-04-25T23:01:07.253 INFO:tasks.workunit.client.0.smithi043.stdout:8/336: creat d3/d4/db/d4e/d5c/d59/d61/d66/f6f x:0 0 0 2024-04-25T23:01:07.253 INFO:tasks.workunit.client.0.smithi043.stdout:9/474: readlink d8/de/d12/d15/d68/l6b 0 2024-04-25T23:01:07.253 INFO:tasks.workunit.client.0.smithi043.stdout:7/474: getdents d3/d1e/d41/d63 0 2024-04-25T23:01:07.254 INFO:tasks.workunit.client.0.smithi043.stdout:3/540: rename d7/d26/db1 to d7/d26/d27/d56/db7 0 2024-04-25T23:01:07.255 INFO:tasks.workunit.client.0.smithi043.stdout:7/475: dread - d3/da/df/f8c zero size 2024-04-25T23:01:07.255 INFO:tasks.workunit.client.0.smithi043.stdout:3/541: readlink d7/d26/d27/d34/l9c 0 2024-04-25T23:01:07.255 INFO:tasks.workunit.client.0.smithi043.stdout:4/491: dwrite d3/d21/f25 [0,4194304] 0 2024-04-25T23:01:07.256 INFO:tasks.workunit.client.0.smithi043.stdout:8/337: creat d3/d4/db/d14/d56/f70 x:0 0 0 2024-04-25T23:01:07.256 INFO:tasks.workunit.client.0.smithi043.stdout:4/492: read d3/f3c [1298314,25638] 0 2024-04-25T23:01:07.256 INFO:tasks.workunit.client.0.smithi043.stdout:8/338: sync 2024-04-25T23:01:07.257 INFO:tasks.workunit.client.0.smithi043.stdout:0/446: dread d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:07.257 INFO:tasks.workunit.client.0.smithi043.stdout:8/339: readlink d3/d4/db/d4e/l52 0 2024-04-25T23:01:07.257 INFO:tasks.workunit.client.0.smithi043.stdout:4/493: dread - d3/de/d46/d6a/d8f/d8e/fae zero size 2024-04-25T23:01:07.258 INFO:tasks.workunit.client.0.smithi043.stdout:1/423: rename d0/d9/d63/f8b to d0/d3d/f95 0 2024-04-25T23:01:07.258 INFO:tasks.workunit.client.0.smithi043.stdout:0/447: write f11 [795731,82388] 0 2024-04-25T23:01:07.258 INFO:tasks.workunit.client.0.smithi043.stdout:8/340: creat d3/d4/f71 x:0 0 0 2024-04-25T23:01:07.258 INFO:tasks.workunit.client.0.smithi043.stdout:3/542: write d7/d26/d27/d34/d1a/d28/f3c [3710116,65924] 0 2024-04-25T23:01:07.259 INFO:tasks.workunit.client.0.smithi043.stdout:4/494: dread - d3/de/d46/d95/f99 zero size 2024-04-25T23:01:07.259 INFO:tasks.workunit.client.0.smithi043.stdout:8/341: write d3/f48 [133666,48244] 0 2024-04-25T23:01:07.260 INFO:tasks.workunit.client.0.smithi043.stdout:7/476: symlink d3/l91 0 2024-04-25T23:01:07.260 INFO:tasks.workunit.client.0.smithi043.stdout:1/424: creat d0/d9/d7b/f96 x:0 0 0 2024-04-25T23:01:07.260 INFO:tasks.workunit.client.0.smithi043.stdout:3/543: mkdir d7/d26/d88/db8 0 2024-04-25T23:01:07.260 INFO:tasks.workunit.client.0.smithi043.stdout:8/342: rmdir d3/d4 39 2024-04-25T23:01:07.262 INFO:tasks.workunit.client.0.smithi043.stdout:7/477: rename d3/d1e/d1f/f7f to d3/d1e/d41/f92 0 2024-04-25T23:01:07.262 INFO:tasks.workunit.client.0.smithi043.stdout:9/475: truncate d8/de/d12/d16/f25 22765 0 2024-04-25T23:01:07.262 INFO:tasks.workunit.client.0.smithi043.stdout:4/495: truncate d3/d21/f3d 128865 0 2024-04-25T23:01:07.262 INFO:tasks.workunit.client.0.smithi043.stdout:4/496: chown d3/d21/d6b/d87 258627703 1 2024-04-25T23:01:07.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/425: getdents d0/d2f/d4b 0 2024-04-25T23:01:07.263 INFO:tasks.workunit.client.0.smithi043.stdout:8/343: link d3/d4/db/df/d10/f3b d3/d4/db/d4e/d5c/d2e/f72 0 2024-04-25T23:01:07.263 INFO:tasks.workunit.client.0.smithi043.stdout:9/476: creat d8/de/d44/d5d/da1/fa4 x:0 0 0 2024-04-25T23:01:07.264 INFO:tasks.workunit.client.0.smithi043.stdout:7/478: creat d3/da/df/d11/f93 x:0 0 0 2024-04-25T23:01:07.264 INFO:tasks.workunit.client.0.smithi043.stdout:4/497: creat d3/d21/d84/faf x:0 0 0 2024-04-25T23:01:07.264 INFO:tasks.workunit.client.0.smithi043.stdout:1/426: creat d0/d9/d63/f97 x:0 0 0 2024-04-25T23:01:07.264 INFO:tasks.workunit.client.0.smithi043.stdout:9/477: readlink d8/de/d44/d5d/d4f/l74 0 2024-04-25T23:01:07.265 INFO:tasks.workunit.client.0.smithi043.stdout:8/344: symlink d3/d4/db/d14/d4c/l73 0 2024-04-25T23:01:07.265 INFO:tasks.workunit.client.0.smithi043.stdout:9/478: readlink l6 0 2024-04-25T23:01:07.265 INFO:tasks.workunit.client.0.smithi043.stdout:9/479: sync 2024-04-25T23:01:07.265 INFO:tasks.workunit.client.0.smithi043.stdout:4/498: stat d3/d37/d4d/l53 0 2024-04-25T23:01:07.265 INFO:tasks.workunit.client.0.smithi043.stdout:8/345: chown d3/d4/db/d4e/d5c 772459 1 2024-04-25T23:01:07.267 INFO:tasks.workunit.client.0.smithi043.stdout:9/480: rename d8/de/d12/d15/f53 to d8/de/d12/d15/d2f/fa5 0 2024-04-25T23:01:07.267 INFO:tasks.workunit.client.0.smithi043.stdout:1/427: symlink d0/d2f/d4b/d8f/l98 0 2024-04-25T23:01:07.267 INFO:tasks.workunit.client.0.smithi043.stdout:9/481: sync 2024-04-25T23:01:07.267 INFO:tasks.workunit.client.0.smithi043.stdout:7/479: creat d3/da/df/d11/f94 x:0 0 0 2024-04-25T23:01:07.268 INFO:tasks.workunit.client.0.smithi043.stdout:3/544: dwrite d7/d26/d2d/fa3 [0,4194304] 0 2024-04-25T23:01:07.268 INFO:tasks.workunit.client.0.smithi043.stdout:8/346: rename d3/d4/db/d4e/f69 to d3/d4/db/df/d62/d6e/f74 0 2024-04-25T23:01:07.268 INFO:tasks.workunit.client.0.smithi043.stdout:2/362: dread d2/d3/f42 [0,4194304] 0 2024-04-25T23:01:07.270 INFO:tasks.workunit.client.0.smithi043.stdout:3/545: write d7/d26/d59/d7c/db2/d87/fa5 [828933,34086] 0 2024-04-25T23:01:07.272 INFO:tasks.workunit.client.0.smithi043.stdout:9/482: unlink d8/de/l4b 0 2024-04-25T23:01:07.272 INFO:tasks.workunit.client.0.smithi043.stdout:2/363: creat d2/f75 x:0 0 0 2024-04-25T23:01:07.272 INFO:tasks.workunit.client.0.smithi043.stdout:7/480: creat d3/d1e/d41/d63/f95 x:0 0 0 2024-04-25T23:01:07.272 INFO:tasks.workunit.client.0.smithi043.stdout:8/347: symlink d3/d4/db/df/l75 0 2024-04-25T23:01:07.272 INFO:tasks.workunit.client.0.smithi043.stdout:3/546: unlink d7/d26/d2d/f53 0 2024-04-25T23:01:07.273 INFO:tasks.workunit.client.0.smithi043.stdout:4/499: dread d3/de/f14 [0,4194304] 0 2024-04-25T23:01:07.274 INFO:tasks.workunit.client.0.smithi043.stdout:9/483: mkdir d8/de/d12/d15/d2f/da6 0 2024-04-25T23:01:07.274 INFO:tasks.workunit.client.0.smithi043.stdout:8/348: read - d3/d4/d36/f64 zero size 2024-04-25T23:01:07.274 INFO:tasks.workunit.client.0.smithi043.stdout:3/547: creat d7/d26/d2d/fb9 x:0 0 0 2024-04-25T23:01:07.275 INFO:tasks.workunit.client.0.smithi043.stdout:8/349: stat d3/d4/db/d14/f19 0 2024-04-25T23:01:07.275 INFO:tasks.workunit.client.0.smithi043.stdout:9/484: symlink d8/de/d12/d15/d2f/d84/la7 0 2024-04-25T23:01:07.275 INFO:tasks.workunit.client.0.smithi043.stdout:4/500: truncate d3/de/d46/d95/f99 341681 0 2024-04-25T23:01:07.275 INFO:tasks.workunit.client.0.smithi043.stdout:3/548: symlink d7/d26/d27/d34/d1a/d40/lba 0 2024-04-25T23:01:07.276 INFO:tasks.workunit.client.0.smithi043.stdout:8/350: creat d3/d4/d36/f76 x:0 0 0 2024-04-25T23:01:07.277 INFO:tasks.workunit.client.0.smithi043.stdout:9/485: write d8/de/f3e [1427200,100349] 0 2024-04-25T23:01:07.277 INFO:tasks.workunit.client.0.smithi043.stdout:1/428: dwrite d0/f5 [4194304,4194304] 0 2024-04-25T23:01:07.277 INFO:tasks.workunit.client.0.smithi043.stdout:9/486: sync 2024-04-25T23:01:07.277 INFO:tasks.workunit.client.0.smithi043.stdout:4/501: rename d3/de/d27/d45/f88 to d3/d37/d4d/fb0 0 2024-04-25T23:01:07.278 INFO:tasks.workunit.client.0.smithi043.stdout:1/429: chown d0/d3d/d4f 3 1 2024-04-25T23:01:07.278 INFO:tasks.workunit.client.0.smithi043.stdout:8/351: write d3/d4/db/f4a [1404632,41471] 0 2024-04-25T23:01:07.279 INFO:tasks.workunit.client.0.smithi043.stdout:4/502: write d3/d19/f82 [3317928,36097] 0 2024-04-25T23:01:07.279 INFO:tasks.workunit.client.0.smithi043.stdout:3/549: rename d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/c94 to d7/d26/d59/d7c/cbb 0 2024-04-25T23:01:07.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/430: chown d0/d3d/c6a 191240 1 2024-04-25T23:01:07.280 INFO:tasks.workunit.client.0.smithi043.stdout:2/364: dwrite d2/d3/d22/f6f [0,4194304] 0 2024-04-25T23:01:07.280 INFO:tasks.workunit.client.0.smithi043.stdout:4/503: rmdir d3/d37/d7a 39 2024-04-25T23:01:07.281 INFO:tasks.workunit.client.0.smithi043.stdout:8/352: fdatasync d3/d4/db/d14/f2c 0 2024-04-25T23:01:07.281 INFO:tasks.workunit.client.0.smithi043.stdout:1/431: dread - d0/d16/f76 zero size 2024-04-25T23:01:07.282 INFO:tasks.workunit.client.0.smithi043.stdout:2/365: write d2/d3/d22/d23/d43/d5d/f54 [270260,14149] 0 2024-04-25T23:01:07.282 INFO:tasks.workunit.client.0.smithi043.stdout:4/504: truncate d3/d19/fab 210274 0 2024-04-25T23:01:07.284 INFO:tasks.workunit.client.0.smithi043.stdout:1/432: creat d0/d2f/d4b/d8f/f99 x:0 0 0 2024-04-25T23:01:07.284 INFO:tasks.workunit.client.0.smithi043.stdout:4/505: unlink d3/f7 0 2024-04-25T23:01:07.284 INFO:tasks.workunit.client.0.smithi043.stdout:9/487: link d8/de/d12/d16/c8b d8/de/d12/d15/d2f/d84/d31/ca8 0 2024-04-25T23:01:07.285 INFO:tasks.workunit.client.0.smithi043.stdout:9/488: sync 2024-04-25T23:01:07.285 INFO:tasks.workunit.client.0.smithi043.stdout:1/433: dread - d0/d9/d63/f97 zero size 2024-04-25T23:01:07.285 INFO:tasks.workunit.client.0.smithi043.stdout:2/366: chown d2/d3/d13/d18/c25 0 1 2024-04-25T23:01:07.285 INFO:tasks.workunit.client.0.smithi043.stdout:9/489: dread - d8/de/d12/d15/f9b zero size 2024-04-25T23:01:07.288 INFO:tasks.workunit.client.0.smithi043.stdout:9/490: symlink d8/de/d44/d47/d6a/la9 0 2024-04-25T23:01:07.288 INFO:tasks.workunit.client.0.smithi043.stdout:2/367: rename d2/d3e to d2/d3/d22/d23/d76 0 2024-04-25T23:01:07.288 INFO:tasks.workunit.client.0.smithi043.stdout:5/489: dread d0/d2c/d39/d1c/d25/d7a/d41/fa1 [0,4194304] 0 2024-04-25T23:01:07.289 INFO:tasks.workunit.client.0.smithi043.stdout:7/481: dwrite d3/da/df/d11/d26/f74 [0,4194304] 0 2024-04-25T23:01:07.290 INFO:tasks.workunit.client.0.smithi043.stdout:3/550: dwrite d7/d26/d27/d34/d1a/d40/f64 [0,4194304] 0 2024-04-25T23:01:07.293 INFO:tasks.workunit.client.0.smithi043.stdout:1/434: link d0/d9/c5d d0/d16/c9a 0 2024-04-25T23:01:07.294 INFO:tasks.workunit.client.0.smithi043.stdout:4/506: dwrite d3/d21/d6b/d87/d8a/f94 [0,4194304] 0 2024-04-25T23:01:07.295 INFO:tasks.workunit.client.0.smithi043.stdout:5/490: write d0/fd [2133005,13449] 0 2024-04-25T23:01:07.295 INFO:tasks.workunit.client.0.smithi043.stdout:7/482: rename d3/d1e/d1f/d54/d7d to d3/d96 0 2024-04-25T23:01:07.296 INFO:tasks.workunit.client.0.smithi043.stdout:1/435: mknod d0/d2f/d4b/c9b 0 2024-04-25T23:01:07.297 INFO:tasks.workunit.client.0.smithi043.stdout:6/437: dread d1/d5/d3b/d4c/d1a/f5a [0,4194304] 0 2024-04-25T23:01:07.298 INFO:tasks.workunit.client.0.smithi043.stdout:4/507: creat d3/d21/d6b/d87/fb1 x:0 0 0 2024-04-25T23:01:07.298 INFO:tasks.workunit.client.0.smithi043.stdout:0/448: dread d1b/d31/d3c/f43 [0,4194304] 0 2024-04-25T23:01:07.300 INFO:tasks.workunit.client.0.smithi043.stdout:7/483: creat d3/d1e/d1f/d6b/d72/f97 x:0 0 0 2024-04-25T23:01:07.300 INFO:tasks.workunit.client.0.smithi043.stdout:1/436: mknod d0/d2f/d4b/c9c 0 2024-04-25T23:01:07.300 INFO:tasks.workunit.client.0.smithi043.stdout:2/368: dwrite d2/d3/d22/d48/f5a [0,4194304] 0 2024-04-25T23:01:07.301 INFO:tasks.workunit.client.0.smithi043.stdout:9/491: dwrite d8/de/d44/d5d/d4f/f91 [0,4194304] 0 2024-04-25T23:01:07.305 INFO:tasks.workunit.client.0.smithi043.stdout:5/491: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9 0 2024-04-25T23:01:07.307 INFO:tasks.workunit.client.0.smithi043.stdout:0/449: write d1b/d31/f81 [951154,88803] 0 2024-04-25T23:01:07.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/450: dread - d1b/d31/d3c/f6a zero size 2024-04-25T23:01:07.310 INFO:tasks.workunit.client.0.smithi043.stdout:7/484: stat d3/le 0 2024-04-25T23:01:07.310 INFO:tasks.workunit.client.0.smithi043.stdout:3/551: rename d7/d26/d59/d7c/fa0 to d7/d26/fbc 0 2024-04-25T23:01:07.310 INFO:tasks.workunit.client.0.smithi043.stdout:8/353: dread d3/d4/db/d4e/d5c/f1e [0,4194304] 0 2024-04-25T23:01:07.311 INFO:tasks.workunit.client.0.smithi043.stdout:5/492: unlink d0/d2c/d39/d1c/l7e 0 2024-04-25T23:01:07.312 INFO:tasks.workunit.client.0.smithi043.stdout:2/369: mkdir d2/d3/d22/d77 0 2024-04-25T23:01:07.312 INFO:tasks.workunit.client.0.smithi043.stdout:0/451: creat d1b/d42/f88 x:0 0 0 2024-04-25T23:01:07.312 INFO:tasks.workunit.client.0.smithi043.stdout:1/437: dwrite d0/d16/f4a [0,4194304] 0 2024-04-25T23:01:07.312 INFO:tasks.workunit.client.0.smithi043.stdout:7/485: mkdir d3/d1e/d41/d63/d98 0 2024-04-25T23:01:07.313 INFO:tasks.workunit.client.0.smithi043.stdout:8/354: rmdir d3/d4/db/d14 39 2024-04-25T23:01:07.313 INFO:tasks.workunit.client.0.smithi043.stdout:0/452: mknod d1b/d7f/c89 0 2024-04-25T23:01:07.315 INFO:tasks.workunit.client.0.smithi043.stdout:4/508: dwrite d3/f41 [0,4194304] 0 2024-04-25T23:01:07.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/438: dwrite d1/d5/d3b/d4c/d1a/f2e [4194304,4194304] 0 2024-04-25T23:01:07.317 INFO:tasks.workunit.client.0.smithi043.stdout:2/370: write d2/d3/f27 [3267912,40205] 0 2024-04-25T23:01:07.319 INFO:tasks.workunit.client.0.smithi043.stdout:0/453: creat d1b/d31/f8a x:0 0 0 2024-04-25T23:01:07.319 INFO:tasks.workunit.client.0.smithi043.stdout:4/509: mknod d3/de/d27/d5c/d67/cb2 0 2024-04-25T23:01:07.319 INFO:tasks.workunit.client.0.smithi043.stdout:0/454: stat d1b/d23/d39 0 2024-04-25T23:01:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:9/492: dwrite d8/de/d12/d16/d24/f2a [0,4194304] 0 2024-04-25T23:01:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:2/371: mkdir d2/d3/d13/d18/d78 0 2024-04-25T23:01:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/439: mkdir d1/d5/d3b/d4c/d21/d55/d68/d30/d8f 0 2024-04-25T23:01:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:1/438: rmdir d0/d16/d94 0 2024-04-25T23:01:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/486: mkdir d3/da/df/d79/d99 0 2024-04-25T23:01:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/552: rename d7/d26/c4d to d7/d26/d59/d7c/db2/cbd 0 2024-04-25T23:01:07.323 INFO:tasks.workunit.client.0.smithi043.stdout:9/493: read d8/de/d12/d16/f30 [290523,25448] 0 2024-04-25T23:01:07.323 INFO:tasks.workunit.client.0.smithi043.stdout:1/439: write d0/f72 [586021,102219] 0 2024-04-25T23:01:07.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/440: creat d1/d5/d3b/d62/f90 x:0 0 0 2024-04-25T23:01:07.324 INFO:tasks.workunit.client.0.smithi043.stdout:8/355: rename d3/d1d to d3/d4/db/d14/d4c/d77 0 2024-04-25T23:01:07.324 INFO:tasks.workunit.client.0.smithi043.stdout:3/553: chown d7/d26/d27/d34/d1a/d40/f64 107761 1 2024-04-25T23:01:07.324 INFO:tasks.workunit.client.0.smithi043.stdout:9/494: dread - d8/de/d12/d16/d24/f98 zero size 2024-04-25T23:01:07.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/441: write d1/d5/d3b/d4c/d21/d55/d68/f42 [1028311,126734] 0 2024-04-25T23:01:07.325 INFO:tasks.workunit.client.0.smithi043.stdout:3/554: creat d7/d26/d59/fbe x:0 0 0 2024-04-25T23:01:07.325 INFO:tasks.workunit.client.0.smithi043.stdout:4/510: write d3/d19/f22 [2063264,30737] 0 2024-04-25T23:01:07.326 INFO:tasks.workunit.client.0.smithi043.stdout:1/440: truncate d0/d9/d7b/f7e 115293 0 2024-04-25T23:01:07.326 INFO:tasks.workunit.client.0.smithi043.stdout:5/493: truncate d0/d2c/d39/d1c/d25/f27 8151601 0 2024-04-25T23:01:07.327 INFO:tasks.workunit.client.0.smithi043.stdout:8/356: symlink d3/l78 0 2024-04-25T23:01:07.327 INFO:tasks.workunit.client.0.smithi043.stdout:0/455: rename d1b/d55/d5e to d1b/d8b 0 2024-04-25T23:01:07.327 INFO:tasks.workunit.client.0.smithi043.stdout:9/495: creat d8/de/d8c/faa x:0 0 0 2024-04-25T23:01:07.327 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:07.324+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:07.327 INFO:tasks.workunit.client.0.smithi043.stdout:2/372: fdatasync d2/d3/d22/f49 0 2024-04-25T23:01:07.328 INFO:tasks.workunit.client.0.smithi043.stdout:0/456: rmdir d1b/d55 39 2024-04-25T23:01:07.328 INFO:tasks.workunit.client.0.smithi043.stdout:8/357: stat d3/d4/db/d14/d3e/f43 0 2024-04-25T23:01:07.329 INFO:tasks.workunit.client.0.smithi043.stdout:4/511: symlink d3/d37/d7a/lb3 0 2024-04-25T23:01:07.329 INFO:tasks.workunit.client.0.smithi043.stdout:6/442: mkdir d1/d5/d3b/d4c/d21/d55/d6d/d91 0 2024-04-25T23:01:07.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/496: mknod d8/de/d12/d15/d68/cab 0 2024-04-25T23:01:07.331 INFO:tasks.workunit.client.0.smithi043.stdout:7/487: dwrite d3/da/df/d11/f93 [0,4194304] 0 2024-04-25T23:01:07.331 INFO:tasks.workunit.client.0.smithi043.stdout:0/457: fsync d1b/d42/f5b 0 2024-04-25T23:01:07.331 INFO:tasks.workunit.client.0.smithi043.stdout:5/494: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/faa x:0 0 0 2024-04-25T23:01:07.333 INFO:tasks.workunit.client.0.smithi043.stdout:9/497: readlink d8/de/d44/d5d/d4f/l74 0 2024-04-25T23:01:07.333 INFO:tasks.workunit.client.0.smithi043.stdout:5/495: truncate d0/d22/f9e 20503 0 2024-04-25T23:01:07.333 INFO:tasks.workunit.client.0.smithi043.stdout:0/458: write d1b/d8b/f60 [771368,31500] 0 2024-04-25T23:01:07.334 INFO:tasks.workunit.client.0.smithi043.stdout:8/358: truncate d3/d4/db/d4e/d5c/d59/d61/d66/f6f 251187 0 2024-04-25T23:01:07.334 INFO:tasks.workunit.client.0.smithi043.stdout:0/459: stat d1b/c2d 0 2024-04-25T23:01:07.337 INFO:tasks.workunit.client.0.smithi043.stdout:6/443: rename d1/d5/d3b/d4c/d21/d38/l47 to d1/d5/d3b/d4c/d21/d55/l92 0 2024-04-25T23:01:07.338 INFO:tasks.workunit.client.0.smithi043.stdout:1/441: dwrite d0/d16/f2d [0,4194304] 0 2024-04-25T23:01:07.338 INFO:tasks.workunit.client.0.smithi043.stdout:5/496: rmdir d0/d2c/d39/d1c/d5e 39 2024-04-25T23:01:07.338 INFO:tasks.workunit.client.0.smithi043.stdout:2/373: dwrite d2/f75 [0,4194304] 0 2024-04-25T23:01:07.340 INFO:tasks.workunit.client.0.smithi043.stdout:7/488: link d3/da/f44 d3/d1e/d41/d63/d98/f9a 0 2024-04-25T23:01:07.340 INFO:tasks.workunit.client.0.smithi043.stdout:9/498: write d8/de/d12/d16/d24/f62 [1111312,87934] 0 2024-04-25T23:01:07.340 INFO:tasks.workunit.client.0.smithi043.stdout:1/442: chown d0/d16/c52 1045760085 1 2024-04-25T23:01:07.341 INFO:tasks.workunit.client.0.smithi043.stdout:3/555: dread d7/d26/d59/d7c/db2/d52/f5d [0,4194304] 0 2024-04-25T23:01:07.341 INFO:tasks.workunit.client.0.smithi043.stdout:1/443: write d0/d2f/f48 [8526467,117808] 0 2024-04-25T23:01:07.343 INFO:tasks.workunit.client.0.smithi043.stdout:4/512: link d3/fa d3/d21/d6b/d87/fb4 0 2024-04-25T23:01:07.344 INFO:tasks.workunit.client.0.smithi043.stdout:6/444: rmdir d1/d5/d3b/d4c/d21/d55/d57 39 2024-04-25T23:01:07.344 INFO:tasks.workunit.client.0.smithi043.stdout:5/497: creat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fab x:0 0 0 2024-04-25T23:01:07.344 INFO:tasks.workunit.client.0.smithi043.stdout:9/499: mknod d8/de/d12/d15/d2f/d84/cac 0 2024-04-25T23:01:07.345 INFO:tasks.workunit.client.0.smithi043.stdout:3/556: mknod d7/d26/d27/d34/d1a/d40/cbf 0 2024-04-25T23:01:07.345 INFO:tasks.workunit.client.0.smithi043.stdout:8/359: dwrite d3/d4/db/f4a [0,4194304] 0 2024-04-25T23:01:07.345 INFO:tasks.workunit.client.0.smithi043.stdout:7/489: dread d3/f5 [0,4194304] 0 2024-04-25T23:01:07.348 INFO:tasks.workunit.client.0.smithi043.stdout:0/460: rename d1b/d23/l41 to d1b/d31/d3c/l8c 0 2024-04-25T23:01:07.348 INFO:tasks.workunit.client.0.smithi043.stdout:9/500: fdatasync d8/de/d44/f45 0 2024-04-25T23:01:07.348 INFO:tasks.workunit.client.0.smithi043.stdout:3/557: mknod d7/d26/d27/d34/d1a/cc0 0 2024-04-25T23:01:07.349 INFO:tasks.workunit.client.0.smithi043.stdout:5/498: dread - d0/d2c/d39/d1c/d5e/fa7 zero size 2024-04-25T23:01:07.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/490: fdatasync d3/da/df/d11/f20 0 2024-04-25T23:01:07.350 INFO:tasks.workunit.client.0.smithi043.stdout:6/445: creat d1/d5/d3b/d4c/f93 x:0 0 0 2024-04-25T23:01:07.351 INFO:tasks.workunit.client.0.smithi043.stdout:5/499: fsync d0/f5 0 2024-04-25T23:01:07.353 INFO:tasks.workunit.client.0.smithi043.stdout:0/461: creat d1b/d55/f8d x:0 0 0 2024-04-25T23:01:07.354 INFO:tasks.workunit.client.0.smithi043.stdout:1/444: dwrite d0/d9/f25 [0,4194304] 0 2024-04-25T23:01:07.355 INFO:tasks.workunit.client.0.smithi043.stdout:2/374: dwrite d2/d3/d22/f26 [0,4194304] 0 2024-04-25T23:01:07.356 INFO:tasks.workunit.client.0.smithi043.stdout:1/445: symlink d0/d2f/d4b/l9d 0 2024-04-25T23:01:07.357 INFO:tasks.workunit.client.0.smithi043.stdout:2/375: readlink d2/d3/d13/l14 0 2024-04-25T23:01:07.358 INFO:tasks.workunit.client.0.smithi043.stdout:6/446: mkdir d1/d5/d3b/d4c/d21/d55/d6d/d91/d94 0 2024-04-25T23:01:07.360 INFO:tasks.workunit.client.0.smithi043.stdout:4/513: dwrite d3/d21/f63 [0,4194304] 0 2024-04-25T23:01:07.361 INFO:tasks.workunit.client.0.smithi043.stdout:8/360: dwrite d3/d4/db/df/d10/f3b [0,4194304] 0 2024-04-25T23:01:07.361 INFO:tasks.workunit.client.0.smithi043.stdout:8/361: readlink d3/d4/db/d14/d4c/d68/l6c 0 2024-04-25T23:01:07.362 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:07.363 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:07.366 INFO:tasks.workunit.client.0.smithi043.stdout:8/362: unlink d3/d4/db/df/d10/c42 0 2024-04-25T23:01:07.367 INFO:tasks.workunit.client.0.smithi043.stdout:6/447: creat d1/d5/f95 x:0 0 0 2024-04-25T23:01:07.367 INFO:tasks.workunit.client.0.smithi043.stdout:8/363: mknod d3/d4/db/d14/d56/c79 0 2024-04-25T23:01:07.368 INFO:tasks.workunit.client.0.smithi043.stdout:6/448: rename d1/d5/d3b/d4c/d21/d55/d57 to d1/d5/d3b/d4c/d21/d55/d6d/d96 0 2024-04-25T23:01:07.369 INFO:tasks.workunit.client.0.smithi043.stdout:6/449: dread - d1/d5/d3b/d4c/d21/d55/d6d/f70 zero size 2024-04-25T23:01:07.371 INFO:tasks.workunit.client.0.smithi043.stdout:5/500: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e [0,4194304] 0 2024-04-25T23:01:07.373 INFO:tasks.workunit.client.0.smithi043.stdout:6/450: rename d1/d5/f56 to d1/d5/d3b/d4c/d21/f97 0 2024-04-25T23:01:07.373 INFO:tasks.workunit.client.0.smithi043.stdout:2/376: write d2/d3/d22/d23/f37 [616595,96342] 0 2024-04-25T23:01:07.375 INFO:tasks.workunit.client.0.smithi043.stdout:9/501: read d8/f5a [643518,84242] 0 2024-04-25T23:01:07.375 INFO:tasks.workunit.client.0.smithi043.stdout:5/501: symlink d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/lac 0 2024-04-25T23:01:07.375 INFO:tasks.workunit.client.0.smithi043.stdout:2/377: dread - d2/d3/d22/d23/f57 zero size 2024-04-25T23:01:07.376 INFO:tasks.workunit.client.0.smithi043.stdout:8/364: dwrite d3/d4/db/df/d10/f65 [0,4194304] 0 2024-04-25T23:01:07.376 INFO:tasks.workunit.client.0.smithi043.stdout:8/365: readlink d3/d4/db/d14/d4c/d77/l3d 0 2024-04-25T23:01:07.376 INFO:tasks.workunit.client.0.smithi043.stdout:5/502: write d0/d2c/d39/d1c/d25/d7a/d2d/f74 [96581,60140] 0 2024-04-25T23:01:07.377 INFO:tasks.workunit.client.0.smithi043.stdout:2/378: chown d2/d3/d13/l5b 294 1 2024-04-25T23:01:07.378 INFO:tasks.workunit.client.0.smithi043.stdout:8/366: link d3/d4/d36/f76 d3/d4/db/d14/d4c/d68/f7a 0 2024-04-25T23:01:07.378 INFO:tasks.workunit.client.0.smithi043.stdout:5/503: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/fad x:0 0 0 2024-04-25T23:01:07.378 INFO:tasks.workunit.client.0.smithi043.stdout:8/367: dread - d3/d4/d36/f64 zero size 2024-04-25T23:01:07.379 INFO:tasks.workunit.client.0.smithi043.stdout:2/379: rename d2/d3/d22/f6f to d2/d3/d13/d18/f79 0 2024-04-25T23:01:07.380 INFO:tasks.workunit.client.0.smithi043.stdout:5/504: symlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/lae 0 2024-04-25T23:01:07.381 INFO:tasks.workunit.client.0.smithi043.stdout:8/368: getdents d3/d4/db/d4e/d5c/d59/d61 0 2024-04-25T23:01:07.381 INFO:tasks.workunit.client.0.smithi043.stdout:2/380: rmdir d2/d3/d13/d18/d78 0 2024-04-25T23:01:07.382 INFO:tasks.workunit.client.0.smithi043.stdout:5/505: unlink d0/d2c/d39/d1c/d25/d7a/d41/d47/fa6 0 2024-04-25T23:01:07.383 INFO:tasks.workunit.client.0.smithi043.stdout:1/446: dwrite d0/d16/f5e [0,4194304] 0 2024-04-25T23:01:07.383 INFO:tasks.workunit.client.0.smithi043.stdout:5/506: chown d0/ca 112227 1 2024-04-25T23:01:07.387 INFO:tasks.workunit.client.0.smithi043.stdout:1/447: rename d0/d2f/d4b/f74 to d0/d9/f9e 0 2024-04-25T23:01:07.387 INFO:tasks.workunit.client.0.smithi043.stdout:5/507: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b/daf 0 2024-04-25T23:01:07.387 INFO:tasks.workunit.client.0.smithi043.stdout:2/381: creat d2/d3/d22/d23/d43/d67/f7a x:0 0 0 2024-04-25T23:01:07.387 INFO:tasks.workunit.client.0.smithi043.stdout:1/448: stat d0/d16/l4c 0 2024-04-25T23:01:07.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:07.389 INFO:tasks.workunit.client.0.smithi043.stdout:1/449: rename d0/d3c/l7f to d0/d3d/d4f/l9f 0 2024-04-25T23:01:07.389 INFO:tasks.workunit.client.0.smithi043.stdout:8/369: dwrite d3/d4/d36/f64 [0,4194304] 0 2024-04-25T23:01:07.389 INFO:tasks.workunit.client.0.smithi043.stdout:6/451: dwrite d1/d5/d3b/d4c/d21/d55/d68/f36 [0,4194304] 0 2024-04-25T23:01:07.391 INFO:tasks.workunit.client.0.smithi043.stdout:2/382: dread d2/d3/d22/d48/f5a [0,4194304] 0 2024-04-25T23:01:07.392 INFO:tasks.workunit.client.0.smithi043.stdout:1/450: creat d0/d86/fa0 x:0 0 0 2024-04-25T23:01:07.395 INFO:tasks.workunit.client.0.smithi043.stdout:6/452: dwrite d1/d5/d3b/f44 [0,4194304] 0 2024-04-25T23:01:07.397 INFO:tasks.workunit.client.0.smithi043.stdout:4/514: sync 2024-04-25T23:01:07.397 INFO:tasks.workunit.client.0.smithi043.stdout:3/558: sync 2024-04-25T23:01:07.398 INFO:tasks.workunit.client.0.smithi043.stdout:2/383: creat d2/d3/d13/d40/f7b x:0 0 0 2024-04-25T23:01:07.398 INFO:tasks.workunit.client.0.smithi043.stdout:9/502: dread d8/de/d12/d16/f25 [0,4194304] 0 2024-04-25T23:01:07.398 INFO:tasks.workunit.client.0.smithi043.stdout:1/451: symlink d0/d3d/la1 0 2024-04-25T23:01:07.398 INFO:tasks.workunit.client.0.smithi043.stdout:6/453: unlink d1/d5/d3b/d4c/f77 0 2024-04-25T23:01:07.399 INFO:tasks.workunit.client.0.smithi043.stdout:5/508: truncate d0/d2c/d39/d1c/d25/d4e/f58 2532467 0 2024-04-25T23:01:07.399 INFO:tasks.workunit.client.0.smithi043.stdout:4/515: dread - d3/d21/d84/faf zero size 2024-04-25T23:01:07.399 INFO:tasks.workunit.client.0.smithi043.stdout:9/503: chown d8/de/d12/d16/d24/f33 114281 1 2024-04-25T23:01:07.400 INFO:tasks.workunit.client.0.smithi043.stdout:2/384: unlink d2/d3/c10 0 2024-04-25T23:01:07.400 INFO:tasks.workunit.client.0.smithi043.stdout:6/454: symlink d1/d5/d3b/d4c/d1a/l98 0 2024-04-25T23:01:07.400 INFO:tasks.workunit.client.0.smithi043.stdout:3/559: stat d7/d26/d59/d7c/db2/d52/f89 0 2024-04-25T23:01:07.400 INFO:tasks.workunit.client.0.smithi043.stdout:2/385: chown d2/d3/d13/l14 0 1 2024-04-25T23:01:07.401 INFO:tasks.workunit.client.0.smithi043.stdout:7/491: dread d3/d1e/f50 [0,4194304] 0 2024-04-25T23:01:07.401 INFO:tasks.workunit.client.0.smithi043.stdout:2/386: write d2/d3/f47 [46259,123411] 0 2024-04-25T23:01:07.403 INFO:tasks.workunit.client.0.smithi043.stdout:4/516: mkdir d3/de/d46/d6a/d8f/d8e/db5 0 2024-04-25T23:01:07.403 INFO:tasks.workunit.client.0.smithi043.stdout:9/504: mkdir d8/de/d12/d15/d2f/dad 0 2024-04-25T23:01:07.403 INFO:tasks.workunit.client.0.smithi043.stdout:1/452: getdents d0/d2f/d4b/d8f 0 2024-04-25T23:01:07.403 INFO:tasks.workunit.client.0.smithi043.stdout:3/560: creat d7/d26/d27/d34/d1a/d40/fc1 x:0 0 0 2024-04-25T23:01:07.403 INFO:tasks.workunit.client.0.smithi043.stdout:6/455: mkdir d1/d5/d3b/d4c/d21/d38/d99 0 2024-04-25T23:01:07.403 INFO:tasks.workunit.client.0.smithi043.stdout:5/509: creat d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/fb0 x:0 0 0 2024-04-25T23:01:07.403 INFO:tasks.workunit.client.0.smithi043.stdout:4/517: mkdir d3/db6 0 2024-04-25T23:01:07.404 INFO:tasks.workunit.client.0.smithi043.stdout:5/510: stat d0/d2c/d39/d1c/d25/d7a/d2d/d8b 0 2024-04-25T23:01:07.404 INFO:tasks.workunit.client.0.smithi043.stdout:1/453: creat d0/d2f/d4b/fa2 x:0 0 0 2024-04-25T23:01:07.404 INFO:tasks.workunit.client.0.smithi043.stdout:3/561: stat d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f9a 0 2024-04-25T23:01:07.404 INFO:tasks.workunit.client.0.smithi043.stdout:6/456: mkdir d1/d5/d3b/d9a 0 2024-04-25T23:01:07.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/562: chown d7/d26/d59/d7c 635636 1 2024-04-25T23:01:07.405 INFO:tasks.workunit.client.0.smithi043.stdout:8/370: read d3/d4/db/d14/f19 [136398,119757] 0 2024-04-25T23:01:07.405 INFO:tasks.workunit.client.0.smithi043.stdout:1/454: chown d0/d2f/d4b/f75 118 1 2024-04-25T23:01:07.406 INFO:tasks.workunit.client.0.smithi043.stdout:5/511: write d0/d2c/d39/d1c/d5e/fa7 [804367,129105] 0 2024-04-25T23:01:07.406 INFO:tasks.workunit.client.0.smithi043.stdout:6/457: stat d1/d5/d3b/d4c/d21/d55/d68/c81 0 2024-04-25T23:01:07.407 INFO:tasks.workunit.client.0.smithi043.stdout:1/455: creat d0/d86/fa3 x:0 0 0 2024-04-25T23:01:07.407 INFO:tasks.workunit.client.0.smithi043.stdout:8/371: write d3/d4/d36/f45 [779203,96490] 0 2024-04-25T23:01:07.408 INFO:tasks.workunit.client.0.smithi043.stdout:3/563: write d7/d26/d27/d34/d1a/f1d [2365005,20126] 0 2024-04-25T23:01:07.408 INFO:tasks.workunit.client.0.smithi043.stdout:5/512: chown d0/d2c/d39/la8 3 1 2024-04-25T23:01:07.409 INFO:tasks.workunit.client.0.smithi043.stdout:4/518: dread d3/f24 [0,4194304] 0 2024-04-25T23:01:07.409 INFO:tasks.workunit.client.0.smithi043.stdout:1/456: write d0/d16/f4a [2646369,29343] 0 2024-04-25T23:01:07.409 INFO:tasks.workunit.client.0.smithi043.stdout:6/458: symlink d1/d5/d3b/l9b 0 2024-04-25T23:01:07.410 INFO:tasks.workunit.client.0.smithi043.stdout:2/387: dwrite d2/d3/d22/d23/d76/f6a [0,4194304] 0 2024-04-25T23:01:07.411 INFO:tasks.workunit.client.0.smithi043.stdout:3/564: truncate d7/d26/d27/d34/f37 845838 0 2024-04-25T23:01:07.412 INFO:tasks.workunit.client.0.smithi043.stdout:4/519: symlink d3/d19/lb7 0 2024-04-25T23:01:07.413 INFO:tasks.workunit.client.0.smithi043.stdout:1/457: rename d0/d9/d7b to d0/d16/d5a/d5b/da4 0 2024-04-25T23:01:07.413 INFO:tasks.workunit.client.0.smithi043.stdout:6/459: unlink d1/d5/d3b/d4c/d21/d55/d68/d30/l6c 0 2024-04-25T23:01:07.413 INFO:tasks.workunit.client.0.smithi043.stdout:3/565: symlink d7/d26/d27/d34/d1a/lc2 0 2024-04-25T23:01:07.413 INFO:tasks.workunit.client.0.smithi043.stdout:4/520: rmdir d3/d19 39 2024-04-25T23:01:07.414 INFO:tasks.workunit.client.0.smithi043.stdout:3/566: creat d7/d26/d97/fc3 x:0 0 0 2024-04-25T23:01:07.414 INFO:tasks.workunit.client.0.smithi043.stdout:4/521: read - d3/d37/d4d/f8c zero size 2024-04-25T23:01:07.415 INFO:tasks.workunit.client.0.smithi043.stdout:6/460: mkdir d1/d5/d3b/d4c/d21/d46/d8e/d9c 0 2024-04-25T23:01:07.415 INFO:tasks.workunit.client.0.smithi043.stdout:6/461: dread - d1/d5/f95 zero size 2024-04-25T23:01:07.416 INFO:tasks.workunit.client.0.smithi043.stdout:3/567: truncate d7/d26/d2d/f36 657817 0 2024-04-25T23:01:07.416 INFO:tasks.workunit.client.0.smithi043.stdout:5/513: read d0/d22/f6d [137010,60832] 0 2024-04-25T23:01:07.416 INFO:tasks.workunit.client.0.smithi043.stdout:8/372: read d3/d4/db/df/d10/d33/f1f [934327,58840] 0 2024-04-25T23:01:07.416 INFO:tasks.workunit.client.0.smithi043.stdout:7/492: dwrite d3/da/df/f3f [0,4194304] 0 2024-04-25T23:01:07.417 INFO:tasks.workunit.client.0.smithi043.stdout:6/462: write d1/d5/d3b/d4c/f25 [223285,7109] 0 2024-04-25T23:01:07.418 INFO:tasks.workunit.client.0.smithi043.stdout:5/514: fsync d0/d2c/d39/d1c/d25/d7a/d2d/f8a 0 2024-04-25T23:01:07.418 INFO:tasks.workunit.client.0.smithi043.stdout:7/493: chown d3/da/d78/c87 141196 1 2024-04-25T23:01:07.421 INFO:tasks.workunit.client.0.smithi043.stdout:8/373: symlink d3/d4/db/d4e/l7b 0 2024-04-25T23:01:07.421 INFO:tasks.workunit.client.0.smithi043.stdout:5/515: creat d0/d6a/fb1 x:0 0 0 2024-04-25T23:01:07.421 INFO:tasks.workunit.client.0.smithi043.stdout:1/458: dwrite d0/d3d/f50 [0,4194304] 0 2024-04-25T23:01:07.422 INFO:tasks.workunit.client.0.smithi043.stdout:4/522: dwrite d3/f96 [0,4194304] 0 2024-04-25T23:01:07.422 INFO:tasks.workunit.client.0.smithi043.stdout:8/374: write d3/d4/db/d4e/d5c/d59/d61/d66/f6f [563039,8170] 0 2024-04-25T23:01:07.422 INFO:tasks.workunit.client.0.smithi043.stdout:0/462: dread f11 [0,4194304] 0 2024-04-25T23:01:07.423 INFO:tasks.workunit.client.0.smithi043.stdout:4/523: read - d3/d21/d6b/d87/d8a/f9e zero size 2024-04-25T23:01:07.423 INFO:tasks.workunit.client.0.smithi043.stdout:6/463: creat d1/d5/d3b/d4c/d21/d38/d99/f9d x:0 0 0 2024-04-25T23:01:07.425 INFO:tasks.workunit.client.0.smithi043.stdout:8/375: rmdir d3/d4/db/d4e 39 2024-04-25T23:01:07.425 INFO:tasks.workunit.client.0.smithi043.stdout:4/524: write d3/d21/f30 [157372,33401] 0 2024-04-25T23:01:07.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/494: rename d3/d1e/d41 to d3/d9b 0 2024-04-25T23:01:07.426 INFO:tasks.workunit.client.0.smithi043.stdout:0/463: unlink d1b/d55/f5a 0 2024-04-25T23:01:07.426 INFO:tasks.workunit.client.0.smithi043.stdout:4/525: readlink d3/d21/l65 0 2024-04-25T23:01:07.427 INFO:tasks.workunit.client.0.smithi043.stdout:4/526: dread - d3/d21/d6b/d87/d8a/f9e zero size 2024-04-25T23:01:07.428 INFO:tasks.workunit.client.0.smithi043.stdout:7/495: creat d3/d1e/d1f/d6b/d72/f9c x:0 0 0 2024-04-25T23:01:07.428 INFO:tasks.workunit.client.0.smithi043.stdout:2/388: truncate d2/d3/d22/d23/d43/d5d/f54 177312 0 2024-04-25T23:01:07.429 INFO:tasks.workunit.client.0.smithi043.stdout:1/459: dwrite d0/d16/d5a/d5b/f70 [0,4194304] 0 2024-04-25T23:01:07.429 INFO:tasks.workunit.client.0.smithi043.stdout:8/376: write d3/d4/db/d14/d56/f70 [817326,126090] 0 2024-04-25T23:01:07.431 INFO:tasks.workunit.client.0.smithi043.stdout:2/389: symlink d2/d3/d22/d23/d76/l7c 0 2024-04-25T23:01:07.431 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:07.430+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:07.432 INFO:tasks.workunit.client.0.smithi043.stdout:2/390: read d2/d3/d22/d23/d76/f6a [1899366,35227] 0 2024-04-25T23:01:07.432 INFO:tasks.workunit.client.0.smithi043.stdout:6/464: dwrite d1/d5/d3b/d4c/d21/f4f [0,4194304] 0 2024-04-25T23:01:07.433 INFO:tasks.workunit.client.0.smithi043.stdout:6/465: creat d1/d5/d3b/d4c/d21/d55/d68/f9e x:0 0 0 2024-04-25T23:01:07.434 INFO:tasks.workunit.client.0.smithi043.stdout:6/466: symlink d1/d5/d3b/d4c/d21/d38/d99/l9f 0 2024-04-25T23:01:07.435 INFO:tasks.workunit.client.0.smithi043.stdout:6/467: write d1/d5/d3b/d4c/d1a/f54 [4656246,41572] 0 2024-04-25T23:01:07.436 INFO:tasks.workunit.client.0.smithi043.stdout:0/464: truncate d1b/d8b/f60 510215 0 2024-04-25T23:01:07.437 INFO:tasks.workunit.client.0.smithi043.stdout:2/391: truncate d2/d3/d22/d48/f5a 3406045 0 2024-04-25T23:01:07.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/465: write d1b/d23/f53 [261463,41263] 0 2024-04-25T23:01:07.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/466: chown d1b/c25 285 1 2024-04-25T23:01:07.439 INFO:tasks.workunit.client.0.smithi043.stdout:6/468: truncate d1/f13 3175815 0 2024-04-25T23:01:07.440 INFO:tasks.workunit.client.0.smithi043.stdout:2/392: rename d2/d3/d13/d18/f71 to d2/d3/d22/d23/d43/d5d/f7d 0 2024-04-25T23:01:07.441 INFO:tasks.workunit.client.0.smithi043.stdout:4/527: dwrite d3/d21/d6b/d87/f8b [0,4194304] 0 2024-04-25T23:01:07.441 INFO:tasks.workunit.client.0.smithi043.stdout:2/393: write d2/d3/f34 [2084903,87276] 0 2024-04-25T23:01:07.442 INFO:tasks.workunit.client.0.smithi043.stdout:2/394: dread - d2/d3/d13/d40/f51 zero size 2024-04-25T23:01:07.442 INFO:tasks.workunit.client.0.smithi043.stdout:2/395: dread - d2/d3/f4a zero size 2024-04-25T23:01:07.443 INFO:tasks.workunit.client.0.smithi043.stdout:4/528: rmdir d3/d21/d6b/d87 39 2024-04-25T23:01:07.443 INFO:tasks.workunit.client.0.smithi043.stdout:2/396: unlink d2/d3/d22/f60 0 2024-04-25T23:01:07.444 INFO:tasks.workunit.client.0.smithi043.stdout:6/469: getdents d1/d5/d3b/d4c/d1a 0 2024-04-25T23:01:07.444 INFO:tasks.workunit.client.0.smithi043.stdout:2/397: read d2/d3/d22/f26 [1415237,121476] 0 2024-04-25T23:01:07.445 INFO:tasks.workunit.client.0.smithi043.stdout:4/529: rename d3/d37/d7a/c80 to d3/d37/d4d/cb8 0 2024-04-25T23:01:07.446 INFO:tasks.workunit.client.0.smithi043.stdout:2/398: symlink d2/d3/d22/d63/l7e 0 2024-04-25T23:01:07.446 INFO:tasks.workunit.client.0.smithi043.stdout:6/470: creat d1/d5/d3b/d4c/fa0 x:0 0 0 2024-04-25T23:01:07.446 INFO:tasks.workunit.client.0.smithi043.stdout:4/530: mkdir d3/de/d27/d5c/db9 0 2024-04-25T23:01:07.446 INFO:tasks.workunit.client.0.smithi043.stdout:3/568: sync 2024-04-25T23:01:07.447 INFO:tasks.workunit.client.0.smithi043.stdout:5/516: sync 2024-04-25T23:01:07.448 INFO:tasks.workunit.client.0.smithi043.stdout:4/531: rename d3/de/f35 to d3/d21/da5/fba 0 2024-04-25T23:01:07.448 INFO:tasks.workunit.client.0.smithi043.stdout:6/471: write d1/d5/d3b/d4c/d21/d55/d68/f36 [3800451,73389] 0 2024-04-25T23:01:07.449 INFO:tasks.workunit.client.0.smithi043.stdout:0/467: dwrite d1b/d8b/f85 [0,4194304] 0 2024-04-25T23:01:07.449 INFO:tasks.workunit.client.0.smithi043.stdout:4/532: chown d3/d37/c38 314 1 2024-04-25T23:01:07.450 INFO:tasks.workunit.client.0.smithi043.stdout:5/517: creat d0/d2c/d39/d1c/d25/d7a/d2d/fb2 x:0 0 0 2024-04-25T23:01:07.450 INFO:tasks.workunit.client.0.smithi043.stdout:3/569: creat d7/d26/d59/d7c/db2/fc4 x:0 0 0 2024-04-25T23:01:07.450 INFO:tasks.workunit.client.0.smithi043.stdout:9/505: dread d8/de/f3e [0,4194304] 0 2024-04-25T23:01:07.451 INFO:tasks.workunit.client.0.smithi043.stdout:6/472: creat d1/d5/d3b/d4c/d21/d55/d6d/fa1 x:0 0 0 2024-04-25T23:01:07.451 INFO:tasks.workunit.client.0.smithi043.stdout:0/468: mknod d1b/d55/c8e 0 2024-04-25T23:01:07.451 INFO:tasks.workunit.client.0.smithi043.stdout:4/533: chown d3/d21/d6b/d87 26940 1 2024-04-25T23:01:07.453 INFO:tasks.workunit.client.0.smithi043.stdout:4/534: symlink d3/d21/lbb 0 2024-04-25T23:01:07.453 INFO:tasks.workunit.client.0.smithi043.stdout:6/473: chown d1/d2a/c6f 960295148 1 2024-04-25T23:01:07.454 INFO:tasks.workunit.client.0.smithi043.stdout:3/570: rename d7/d26/d59/d7c/db2/d52/f89 to d7/d26/d2d/dab/fc5 0 2024-04-25T23:01:07.454 INFO:tasks.workunit.client.0.smithi043.stdout:0/469: mkdir d1b/d55/d8f 0 2024-04-25T23:01:07.454 INFO:tasks.workunit.client.0.smithi043.stdout:9/506: truncate d8/de/d44/f45 1884731 0 2024-04-25T23:01:07.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/399: dwrite d2/d3/d13/d18/f79 [4194304,4194304] 0 2024-04-25T23:01:07.455 INFO:tasks.workunit.client.0.smithi043.stdout:6/474: write d1/d5/d3b/f7a [230390,93063] 0 2024-04-25T23:01:07.455 INFO:tasks.workunit.client.0.smithi043.stdout:4/535: read - d3/de/d46/d6a/d8f/d8e/fae zero size 2024-04-25T23:01:07.455 INFO:tasks.workunit.client.0.smithi043.stdout:9/507: fsync d8/de/d44/d47/f8a 0 2024-04-25T23:01:07.456 INFO:tasks.workunit.client.0.smithi043.stdout:2/400: stat d2/d3/d13/d18/f19 0 2024-04-25T23:01:07.456 INFO:tasks.workunit.client.0.smithi043.stdout:3/571: fdatasync d7/d26/f78 0 2024-04-25T23:01:07.456 INFO:tasks.workunit.client.0.smithi043.stdout:5/518: read d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 [35302,74568] 0 2024-04-25T23:01:07.457 INFO:tasks.workunit.client.0.smithi043.stdout:4/536: dread d3/de/f14 [0,4194304] 0 2024-04-25T23:01:07.457 INFO:tasks.workunit.client.0.smithi043.stdout:2/401: write d2/fc [1003910,63283] 0 2024-04-25T23:01:07.458 INFO:tasks.workunit.client.0.smithi043.stdout:3/572: chown d7/d26/d27/d34/d1a/d28/fa6 1995314 1 2024-04-25T23:01:07.458 INFO:tasks.workunit.client.0.smithi043.stdout:2/402: read d2/d3/d22/f26 [95262,34209] 0 2024-04-25T23:01:07.459 INFO:tasks.workunit.client.0.smithi043.stdout:6/475: mkdir d1/d5/d3b/d4c/d21/d55/da2 0 2024-04-25T23:01:07.460 INFO:tasks.workunit.client.0.smithi043.stdout:9/508: write d8/de/d12/d16/d24/f28 [914809,54051] 0 2024-04-25T23:01:07.460 INFO:tasks.workunit.client.0.smithi043.stdout:3/573: symlink d7/d26/d27/lc6 0 2024-04-25T23:01:07.460 INFO:tasks.workunit.client.0.smithi043.stdout:5/519: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f96 [43510,98083] 0 2024-04-25T23:01:07.461 INFO:tasks.workunit.client.0.smithi043.stdout:2/403: mkdir d2/d7f 0 2024-04-25T23:01:07.461 INFO:tasks.workunit.client.0.smithi043.stdout:4/537: chown d3/d19/l5d 9 1 2024-04-25T23:01:07.461 INFO:tasks.workunit.client.0.smithi043.stdout:7/496: dread d3/d1e/f39 [0,4194304] 0 2024-04-25T23:01:07.462 INFO:tasks.workunit.client.0.smithi043.stdout:2/404: fdatasync d2/d3/f47 0 2024-04-25T23:01:07.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/470: dwrite f1a [0,4194304] 0 2024-04-25T23:01:07.464 INFO:tasks.workunit.client.0.smithi043.stdout:1/460: dread d0/d16/f1b [0,4194304] 0 2024-04-25T23:01:07.464 INFO:tasks.workunit.client.0.smithi043.stdout:3/574: rmdir d7/d26/d27/d34/d1a/d40/d8f/d51 39 2024-04-25T23:01:07.465 INFO:tasks.workunit.client.0.smithi043.stdout:9/509: rmdir d8/de/d8c 39 2024-04-25T23:01:07.465 INFO:tasks.workunit.client.0.smithi043.stdout:7/497: link d3/da/df/f8c d3/da/df/d79/f9d 0 2024-04-25T23:01:07.466 INFO:tasks.workunit.client.0.smithi043.stdout:1/461: truncate d0/d16/f65 839124 0 2024-04-25T23:01:07.466 INFO:tasks.workunit.client.0.smithi043.stdout:3/575: readlink d7/d26/d2d/l79 0 2024-04-25T23:01:07.467 INFO:tasks.workunit.client.0.smithi043.stdout:4/538: rmdir d3/d21/d9b 0 2024-04-25T23:01:07.467 INFO:tasks.workunit.client.0.smithi043.stdout:0/471: mkdir d1b/d23/d39/d90 0 2024-04-25T23:01:07.468 INFO:tasks.workunit.client.0.smithi043.stdout:3/576: unlink d7/d26/c83 0 2024-04-25T23:01:07.468 INFO:tasks.workunit.client.0.smithi043.stdout:1/462: symlink d0/d16/d5a/la5 0 2024-04-25T23:01:07.469 INFO:tasks.workunit.client.0.smithi043.stdout:6/476: dwrite d1/d2a/f5e [0,4194304] 0 2024-04-25T23:01:07.469 INFO:tasks.workunit.client.0.smithi043.stdout:9/510: creat d8/de/d44/d65/fae x:0 0 0 2024-04-25T23:01:07.469 INFO:tasks.workunit.client.0.smithi043.stdout:7/498: link d3/d1e/d1f/d6b/d72/f77 d3/d1e/f9e 0 2024-04-25T23:01:07.471 INFO:tasks.workunit.client.0.smithi043.stdout:5/520: dwrite d0/d2c/d39/d1c/d25/d7a/d41/f86 [0,4194304] 0 2024-04-25T23:01:07.471 INFO:tasks.workunit.client.0.smithi043.stdout:9/511: dread - d8/de/d44/d5d/da1/fa4 zero size 2024-04-25T23:01:07.472 INFO:tasks.workunit.client.0.smithi043.stdout:1/463: mkdir d0/d2f/d4b/da6 0 2024-04-25T23:01:07.473 INFO:tasks.workunit.client.0.smithi043.stdout:6/477: unlink d1/d2a/c6f 0 2024-04-25T23:01:07.474 INFO:tasks.workunit.client.0.smithi043.stdout:9/512: fdatasync d8/de/d44/d5d/da1/fa3 0 2024-04-25T23:01:07.474 INFO:tasks.workunit.client.0.smithi043.stdout:2/405: dwrite d2/d3/d22/fe [0,4194304] 0 2024-04-25T23:01:07.477 INFO:tasks.workunit.client.0.smithi043.stdout:4/539: truncate d3/f3c 260192 0 2024-04-25T23:01:07.477 INFO:tasks.workunit.client.0.smithi043.stdout:3/577: read d7/d26/d59/d7c/db2/d52/fae [231262,12775] 0 2024-04-25T23:01:07.478 INFO:tasks.workunit.client.0.smithi043.stdout:3/578: chown d7/d26/d59/d7c/db2/d52/fae 56013 1 2024-04-25T23:01:07.479 INFO:tasks.workunit.client.0.smithi043.stdout:5/521: rename d0/d2c/d39/d1c/d25/f56 to d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fb3 0 2024-04-25T23:01:07.479 INFO:tasks.workunit.client.0.smithi043.stdout:1/464: rmdir d0/d16/d5a/d5b/da4 39 2024-04-25T23:01:07.480 INFO:tasks.workunit.client.0.smithi043.stdout:2/406: link d2/d3/d22/d23/d43/d5d/f4d d2/d7f/f80 0 2024-04-25T23:01:07.481 INFO:tasks.workunit.client.0.smithi043.stdout:6/478: mknod d1/d5/d3b/d4c/ca3 0 2024-04-25T23:01:07.481 INFO:tasks.workunit.client.0.smithi043.stdout:1/465: symlink d0/d2f/d4b/da6/la7 0 2024-04-25T23:01:07.481 INFO:tasks.workunit.client.0.smithi043.stdout:3/579: symlink d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/lc7 0 2024-04-25T23:01:07.481 INFO:tasks.workunit.client.0.smithi043.stdout:9/513: read d8/de/d12/d15/d2f/f56 [3171828,70224] 0 2024-04-25T23:01:07.481 INFO:tasks.workunit.client.0.smithi043.stdout:4/540: getdents d3/d21 0 2024-04-25T23:01:07.481 INFO:tasks.workunit.client.0.smithi043.stdout:5/522: write d0/d2c/d39/d1c/d25/d7a/d2d/f8a [1034538,109916] 0 2024-04-25T23:01:07.482 INFO:tasks.workunit.client.0.smithi043.stdout:7/499: dread d3/f7b [0,4194304] 0 2024-04-25T23:01:07.482 INFO:tasks.workunit.client.0.smithi043.stdout:2/407: write d2/d3/d13/d40/f6b [476342,104881] 0 2024-04-25T23:01:07.482 INFO:tasks.workunit.client.0.smithi043.stdout:1/466: creat d0/d3d/fa8 x:0 0 0 2024-04-25T23:01:07.483 INFO:tasks.workunit.client.0.smithi043.stdout:5/523: creat d0/d6a/fb4 x:0 0 0 2024-04-25T23:01:07.483 INFO:tasks.workunit.client.0.smithi043.stdout:6/479: rmdir d1/d5/d3b/d9a 0 2024-04-25T23:01:07.484 INFO:tasks.workunit.client.0.smithi043.stdout:8/377: dread d3/d4/db/df/d10/d33/f67 [0,4194304] 0 2024-04-25T23:01:07.484 INFO:tasks.workunit.client.0.smithi043.stdout:2/408: chown d2/d3/d22/d77 208776 1 2024-04-25T23:01:07.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/467: write d0/d3d/f50 [2135234,93917] 0 2024-04-25T23:01:07.484 INFO:tasks.workunit.client.0.smithi043.stdout:8/378: sync 2024-04-25T23:01:07.484 INFO:tasks.workunit.client.0.smithi043.stdout:3/580: write d7/d26/d27/d56/f91 [999940,34] 0 2024-04-25T23:01:07.485 INFO:tasks.workunit.client.0.smithi043.stdout:4/541: truncate d3/de/d46/d95/f99 1188366 0 2024-04-25T23:01:07.486 INFO:tasks.workunit.client.0.smithi043.stdout:4/542: rmdir d3/d21/d84 39 2024-04-25T23:01:07.486 INFO:tasks.workunit.client.0.smithi043.stdout:5/524: creat d0/d2c/d39/d1c/d25/d7a/fb5 x:0 0 0 2024-04-25T23:01:07.487 INFO:tasks.workunit.client.0.smithi043.stdout:6/480: getdents d1/d5/d3b/d62 0 2024-04-25T23:01:07.487 INFO:tasks.workunit.client.0.smithi043.stdout:3/581: dread - d7/d26/d59/d7c/db2/d52/f58 zero size 2024-04-25T23:01:07.487 INFO:tasks.workunit.client.0.smithi043.stdout:4/543: chown d3/d37/d7a 11 1 2024-04-25T23:01:07.487 INFO:tasks.workunit.client.0.smithi043.stdout:7/500: getdents d3/da/df/d11 0 2024-04-25T23:01:07.488 INFO:tasks.workunit.client.0.smithi043.stdout:7/501: readlink d3/l5c 0 2024-04-25T23:01:07.488 INFO:tasks.workunit.client.0.smithi043.stdout:9/514: dread d8/de/f3e [0,4194304] 0 2024-04-25T23:01:07.491 INFO:tasks.workunit.client.0.smithi043.stdout:3/582: rename d7/d26/d27/d56/fa9 to d7/d26/d27/d34/d1a/d40/d8f/d51/fc8 0 2024-04-25T23:01:07.492 INFO:tasks.workunit.client.0.smithi043.stdout:6/481: write d1/f13 [1419266,86584] 0 2024-04-25T23:01:07.492 INFO:tasks.workunit.client.0.smithi043.stdout:7/502: mkdir d3/da/df/d11/d8d/d9f 0 2024-04-25T23:01:07.492 INFO:tasks.workunit.client.0.smithi043.stdout:9/515: fsync d8/de/d44/f45 0 2024-04-25T23:01:07.492 INFO:tasks.workunit.client.0.smithi043.stdout:2/409: dread d2/d3/d22/d23/f5f [0,4194304] 0 2024-04-25T23:01:07.493 INFO:tasks.workunit.client.0.smithi043.stdout:4/544: fdatasync d3/d19/f22 0 2024-04-25T23:01:07.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/516: chown l7 29 1 2024-04-25T23:01:07.495 INFO:tasks.workunit.client.0.smithi043.stdout:1/468: dwrite d0/d2f/d4b/fa2 [0,4194304] 0 2024-04-25T23:01:07.496 INFO:tasks.workunit.client.0.smithi043.stdout:3/583: fsync d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/faa 0 2024-04-25T23:01:07.496 INFO:tasks.workunit.client.0.smithi043.stdout:8/379: dwrite d3/d4/db/d14/d3e/f43 [0,4194304] 0 2024-04-25T23:01:07.496 INFO:tasks.workunit.client.0.smithi043.stdout:5/525: dwrite d0/d2c/f4c [0,4194304] 0 2024-04-25T23:01:07.497 INFO:tasks.workunit.client.0.smithi043.stdout:4/545: creat d3/de/d46/d95/fbc x:0 0 0 2024-04-25T23:01:07.497 INFO:tasks.workunit.client.0.smithi043.stdout:9/517: creat d8/de/d44/d65/faf x:0 0 0 2024-04-25T23:01:07.498 INFO:tasks.workunit.client.0.smithi043.stdout:9/518: readlink d8/de/d44/d47/l86 0 2024-04-25T23:01:07.499 INFO:tasks.workunit.client.0.smithi043.stdout:2/410: fdatasync d2/d3/d22/d23/d43/d5d/f54 0 2024-04-25T23:01:07.499 INFO:tasks.workunit.client.0.smithi043.stdout:8/380: mkdir d3/d4/d7c 0 2024-04-25T23:01:07.500 INFO:tasks.workunit.client.0.smithi043.stdout:8/381: stat d3/d4/f71 0 2024-04-25T23:01:07.500 INFO:tasks.workunit.client.0.smithi043.stdout:6/482: read d1/f13 [2904089,26764] 0 2024-04-25T23:01:07.502 INFO:tasks.workunit.client.0.smithi043.stdout:7/503: dwrite d3/da/df/f48 [0,4194304] 0 2024-04-25T23:01:07.506 INFO:tasks.workunit.client.0.smithi043.stdout:4/546: creat d3/de/d27/d45/fbd x:0 0 0 2024-04-25T23:01:07.506 INFO:tasks.workunit.client.0.smithi043.stdout:3/584: rename d7/d26/d27/f48 to d7/d26/d59/d7c/db2/d52/fc9 0 2024-04-25T23:01:07.506 INFO:tasks.workunit.client.0.smithi043.stdout:9/519: symlink d8/de/d12/d15/d2f/d84/d31/lb0 0 2024-04-25T23:01:07.506 INFO:tasks.workunit.client.0.smithi043.stdout:2/411: unlink d2/d3/d22/d23/d76/c61 0 2024-04-25T23:01:07.506 INFO:tasks.workunit.client.0.smithi043.stdout:8/382: mkdir d3/d4/d7d 0 2024-04-25T23:01:07.506 INFO:tasks.workunit.client.0.smithi043.stdout:6/483: unlink d1/d5/d3b/d4c/d1a/l98 0 2024-04-25T23:01:07.506 INFO:tasks.workunit.client.0.smithi043.stdout:7/504: symlink d3/da/d78/la0 0 2024-04-25T23:01:07.507 INFO:tasks.workunit.client.0.smithi043.stdout:8/383: read - d3/d4/db/df/f58 zero size 2024-04-25T23:01:07.508 INFO:tasks.workunit.client.0.smithi043.stdout:3/585: write d7/d26/d2d/fb9 [577032,94055] 0 2024-04-25T23:01:07.508 INFO:tasks.workunit.client.0.smithi043.stdout:2/412: truncate d2/d3/f2f 3694046 0 2024-04-25T23:01:07.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/469: dwrite d0/d9/f9e [0,4194304] 0 2024-04-25T23:01:07.509 INFO:tasks.workunit.client.0.smithi043.stdout:4/547: creat d3/de/d46/d95/fbe x:0 0 0 2024-04-25T23:01:07.509 INFO:tasks.workunit.client.0.smithi043.stdout:5/526: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/f8a [0,4194304] 0 2024-04-25T23:01:07.510 INFO:tasks.workunit.client.0.smithi043.stdout:8/384: write d3/d4/db/d4e/d5c/d2e/f72 [896261,104660] 0 2024-04-25T23:01:07.511 INFO:tasks.workunit.client.0.smithi043.stdout:5/527: chown d0/d2c/d39/d1c/d25/d7a/d2d/d5f 25495 1 2024-04-25T23:01:07.512 INFO:tasks.workunit.client.0.smithi043.stdout:6/484: symlink d1/d5/d3b/d4c/d21/d55/la4 0 2024-04-25T23:01:07.513 INFO:tasks.workunit.client.0.smithi043.stdout:1/470: mknod d0/d3c/ca9 0 2024-04-25T23:01:07.513 INFO:tasks.workunit.client.0.smithi043.stdout:5/528: fdatasync d0/f17 0 2024-04-25T23:01:07.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/520: link d8/de/d44/d47/f8a d8/de/d12/d15/d68/fb1 0 2024-04-25T23:01:07.516 INFO:tasks.workunit.client.0.smithi043.stdout:1/471: mkdir d0/d86/daa 0 2024-04-25T23:01:07.516 INFO:tasks.workunit.client.0.smithi043.stdout:8/385: rmdir d3/d4/db/d14/d4c/d6a 0 2024-04-25T23:01:07.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/529: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/fb6 x:0 0 0 2024-04-25T23:01:07.517 INFO:tasks.workunit.client.0.smithi043.stdout:9/521: creat d8/de/d8c/fb2 x:0 0 0 2024-04-25T23:01:07.517 INFO:tasks.workunit.client.0.smithi043.stdout:3/586: dwrite d7/d26/d27/d56/f6c [0,4194304] 0 2024-04-25T23:01:07.519 INFO:tasks.workunit.client.0.smithi043.stdout:7/505: read d3/d9b/d63/d98/f9a [58605,77064] 0 2024-04-25T23:01:07.519 INFO:tasks.workunit.client.0.smithi043.stdout:8/386: mknod d3/d4/db/d4e/c7e 0 2024-04-25T23:01:07.520 INFO:tasks.workunit.client.0.smithi043.stdout:5/530: rename d0/d2c/d39/d63/l75 to d0/d2c/d39/d1c/d25/d7a/d41/d47/lb7 0 2024-04-25T23:01:07.521 INFO:tasks.workunit.client.0.smithi043.stdout:4/548: dwrite d3/de/d27/d5c/d67/fa2 [0,4194304] 0 2024-04-25T23:01:07.521 INFO:tasks.workunit.client.0.smithi043.stdout:6/485: truncate d1/d5/d3b/d4c/f15 3121187 0 2024-04-25T23:01:07.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/587: write d7/d26/d59/d7c/db2/f4a [1925034,124568] 0 2024-04-25T23:01:07.522 INFO:tasks.workunit.client.0.smithi043.stdout:0/472: dread fb [0,4194304] 0 2024-04-25T23:01:07.525 INFO:tasks.workunit.client.0.smithi043.stdout:0/473: stat d1b/d23/d39/f67 0 2024-04-25T23:01:07.525 INFO:tasks.workunit.client.0.smithi043.stdout:8/387: chown d3/d4/db/d4e/c5a 57907 1 2024-04-25T23:01:07.525 INFO:tasks.workunit.client.0.smithi043.stdout:4/549: mknod d3/d19/cbf 0 2024-04-25T23:01:07.525 INFO:tasks.workunit.client.0.smithi043.stdout:6/486: chown d1/d5/d3b/d4c/d21/d46/f75 7873 1 2024-04-25T23:01:07.525 INFO:tasks.workunit.client.0.smithi043.stdout:7/506: getdents d3/da/df/d11/d8d/d9f 0 2024-04-25T23:01:07.525 INFO:tasks.workunit.client.0.smithi043.stdout:2/413: dwrite d2/d3/d13/f1e [4194304,4194304] 0 2024-04-25T23:01:07.525 INFO:tasks.workunit.client.0.smithi043.stdout:9/522: getdents d8/de/d12/d15/d2f/d84/d31 0 2024-04-25T23:01:07.526 INFO:tasks.workunit.client.0.smithi043.stdout:8/388: stat d3/d4/d36 0 2024-04-25T23:01:07.526 INFO:tasks.workunit.client.0.smithi043.stdout:1/472: dwrite d0/d2f/f48 [4194304,4194304] 0 2024-04-25T23:01:07.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/507: symlink d3/da/df/d11/d8d/la1 0 2024-04-25T23:01:07.527 INFO:tasks.workunit.client.0.smithi043.stdout:6/487: read - d1/d5/d3b/d4c/d21/d55/d6d/d96/f71 zero size 2024-04-25T23:01:07.528 INFO:tasks.workunit.client.0.smithi043.stdout:1/473: symlink d0/d3c/lab 0 2024-04-25T23:01:07.528 INFO:tasks.workunit.client.0.smithi043.stdout:2/414: write d2/d3/d22/f26 [4800825,90329] 0 2024-04-25T23:01:07.529 INFO:tasks.workunit.client.0.smithi043.stdout:8/389: symlink d3/d4/d7c/l7f 0 2024-04-25T23:01:07.529 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:07.526+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:07.531 INFO:tasks.workunit.client.0.smithi043.stdout:0/474: rmdir d1b/d31/d3c/d72 39 2024-04-25T23:01:07.531 INFO:tasks.workunit.client.0.smithi043.stdout:4/550: creat d3/d21/d6b/fc0 x:0 0 0 2024-04-25T23:01:07.531 INFO:tasks.workunit.client.0.smithi043.stdout:2/415: fdatasync d2/d3/d22/d48/f64 0 2024-04-25T23:01:07.531 INFO:tasks.workunit.client.0.smithi043.stdout:0/475: write d1b/d42/f5b [900617,60806] 0 2024-04-25T23:01:07.531 INFO:tasks.workunit.client.0.smithi043.stdout:4/551: dread d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:07.532 INFO:tasks.workunit.client.0.smithi043.stdout:9/523: getdents d8/de/d44/d47 0 2024-04-25T23:01:07.532 INFO:tasks.workunit.client.0.smithi043.stdout:3/588: dwrite d7/d26/d27/d34/d1a/d40/fc1 [0,4194304] 0 2024-04-25T23:01:07.532 INFO:tasks.workunit.client.0.smithi043.stdout:7/508: rename d3/da/df/d11/d26/f49 to d3/da/df/d11/d8d/d9f/fa2 0 2024-04-25T23:01:07.535 INFO:tasks.workunit.client.0.smithi043.stdout:2/416: creat d2/d7f/f81 x:0 0 0 2024-04-25T23:01:07.535 INFO:tasks.workunit.client.0.smithi043.stdout:9/524: read d8/de/f78 [2016942,49445] 0 2024-04-25T23:01:07.536 INFO:tasks.workunit.client.0.smithi043.stdout:4/552: fsync d3/d21/f64 0 2024-04-25T23:01:07.536 INFO:tasks.workunit.client.0.smithi043.stdout:7/509: stat d3/d9b/c46 0 2024-04-25T23:01:07.539 INFO:tasks.workunit.client.0.smithi043.stdout:0/476: truncate d1b/d31/d3c/d72/f78 349442 0 2024-04-25T23:01:07.539 INFO:tasks.workunit.client.0.smithi043.stdout:4/553: rename d3/f5 to d3/de/d27/d45/fc1 0 2024-04-25T23:01:07.539 INFO:tasks.workunit.client.0.smithi043.stdout:6/488: dwrite d1/d5/d3b/d4c/d1a/f2e [0,4194304] 0 2024-04-25T23:01:07.539 INFO:tasks.workunit.client.0.smithi043.stdout:2/417: chown d2/d3/d13/d18/c25 3331 1 2024-04-25T23:01:07.541 INFO:tasks.workunit.client.0.smithi043.stdout:0/477: mkdir d1b/d23/d91 0 2024-04-25T23:01:07.541 INFO:tasks.workunit.client.0.smithi043.stdout:4/554: rmdir d3/de 39 2024-04-25T23:01:07.541 INFO:tasks.workunit.client.0.smithi043.stdout:2/418: rename d2/d3/d13/d18/l45 to d2/d66/l82 0 2024-04-25T23:01:07.542 INFO:tasks.workunit.client.0.smithi043.stdout:7/510: getdents d3/d52 0 2024-04-25T23:01:07.542 INFO:tasks.workunit.client.0.smithi043.stdout:1/474: dwrite d0/d16/d5a/d5b/da4/f93 [0,4194304] 0 2024-04-25T23:01:07.543 INFO:tasks.workunit.client.0.smithi043.stdout:0/478: fdatasync d1b/d31/f49 0 2024-04-25T23:01:07.543 INFO:tasks.workunit.client.0.smithi043.stdout:0/479: readlink d1b/l21 0 2024-04-25T23:01:07.543 INFO:tasks.workunit.client.0.smithi043.stdout:4/555: truncate d3/de/d46/d6a/fac 757 0 2024-04-25T23:01:07.544 INFO:tasks.workunit.client.0.smithi043.stdout:0/480: stat d1b/d42/c4c 0 2024-04-25T23:01:07.544 INFO:tasks.workunit.client.0.smithi043.stdout:6/489: rename d1/d5/d3b/d4c/d21/d38/f8c to d1/d5/d3b/d4c/d21/d38/d60/fa5 0 2024-04-25T23:01:07.544 INFO:tasks.workunit.client.0.smithi043.stdout:7/511: fsync d3/da/df/f8c 0 2024-04-25T23:01:07.545 INFO:tasks.workunit.client.0.smithi043.stdout:0/481: creat d1b/d23/d39/d90/f92 x:0 0 0 2024-04-25T23:01:07.545 INFO:tasks.workunit.client.0.smithi043.stdout:7/512: read - d3/d9b/f89 zero size 2024-04-25T23:01:07.546 INFO:tasks.workunit.client.0.smithi043.stdout:6/490: creat d1/d5/d3b/d4c/d21/d55/fa6 x:0 0 0 2024-04-25T23:01:07.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/475: symlink d0/lac 0 2024-04-25T23:01:07.550 INFO:tasks.workunit.client.0.smithi043.stdout:1/476: write d0/d16/f76 [160079,25581] 0 2024-04-25T23:01:07.550 INFO:tasks.workunit.client.0.smithi043.stdout:6/491: creat d1/d5/d3b/d4c/d21/d55/d6d/d96/fa7 x:0 0 0 2024-04-25T23:01:07.550 INFO:tasks.workunit.client.0.smithi043.stdout:1/477: mknod d0/d9/cad 0 2024-04-25T23:01:07.551 INFO:tasks.workunit.client.0.smithi043.stdout:6/492: fdatasync d1/d5/d3b/d4c/f15 0 2024-04-25T23:01:07.551 INFO:tasks.workunit.client.0.smithi043.stdout:1/478: creat d0/d9/fae x:0 0 0 2024-04-25T23:01:07.551 INFO:tasks.workunit.client.0.smithi043.stdout:4/556: dwrite d3/f3c [0,4194304] 0 2024-04-25T23:01:07.551 INFO:tasks.workunit.client.0.smithi043.stdout:1/479: creat d0/d9/faf x:0 0 0 2024-04-25T23:01:07.552 INFO:tasks.workunit.client.0.smithi043.stdout:6/493: mknod d1/d5/d3b/d4c/ca8 0 2024-04-25T23:01:07.552 INFO:tasks.workunit.client.0.smithi043.stdout:5/531: dread d0/d2c/d39/d1c/d25/d7a/f44 [0,4194304] 0 2024-04-25T23:01:07.552 INFO:tasks.workunit.client.0.smithi043.stdout:4/557: creat d3/d21/d6b/d87/d9a/fc2 x:0 0 0 2024-04-25T23:01:07.552 INFO:tasks.workunit.client.0.smithi043.stdout:7/513: dwrite d3/da/df/d11/d26/f83 [0,4194304] 0 2024-04-25T23:01:07.553 INFO:tasks.workunit.client.0.smithi043.stdout:7/514: chown d3/d96/f8a 3462 1 2024-04-25T23:01:07.554 INFO:tasks.workunit.client.0.smithi043.stdout:5/532: mkdir d0/d22/db8 0 2024-04-25T23:01:07.554 INFO:tasks.workunit.client.0.smithi043.stdout:4/558: mknod d3/cc3 0 2024-04-25T23:01:07.555 INFO:tasks.workunit.client.0.smithi043.stdout:7/515: write d3/d9b/f92 [444064,41936] 0 2024-04-25T23:01:07.555 INFO:tasks.workunit.client.0.smithi043.stdout:6/494: link d1/d5/d3b/d4c/d21/d55/d6d/d96/f71 d1/d5/d3b/d4c/d21/d46/d8e/fa9 0 2024-04-25T23:01:07.555 INFO:tasks.workunit.client.0.smithi043.stdout:5/533: chown d0/d2c/d39/d1c/d25/d7a/d41/d4a/d60 43 1 2024-04-25T23:01:07.556 INFO:tasks.workunit.client.0.smithi043.stdout:7/516: write d3/da/df/d79/f82 [79960,102441] 0 2024-04-25T23:01:07.557 INFO:tasks.workunit.client.0.smithi043.stdout:7/517: rmdir d3/d1e/d1f/d6b/d72 39 2024-04-25T23:01:07.557 INFO:tasks.workunit.client.0.smithi043.stdout:6/495: creat d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/faa x:0 0 0 2024-04-25T23:01:07.557 INFO:tasks.workunit.client.0.smithi043.stdout:7/518: creat d3/da/d64/fa3 x:0 0 0 2024-04-25T23:01:07.558 INFO:tasks.workunit.client.0.smithi043.stdout:6/496: read - d1/d5/d3b/d4c/d21/f7d zero size 2024-04-25T23:01:07.558 INFO:tasks.workunit.client.0.smithi043.stdout:7/519: truncate d3/da/df/d11/f93 5051310 0 2024-04-25T23:01:07.559 INFO:tasks.workunit.client.0.smithi043.stdout:6/497: write d1/d5/d3b/d4c/d21/d38/f59 [772920,59752] 0 2024-04-25T23:01:07.560 INFO:tasks.workunit.client.0.smithi043.stdout:7/520: mkdir d3/da/df/d11/d8d/da4 0 2024-04-25T23:01:07.560 INFO:tasks.workunit.client.0.smithi043.stdout:6/498: creat d1/d5/d3b/d4c/d21/fab x:0 0 0 2024-04-25T23:01:07.560 INFO:tasks.workunit.client.0.smithi043.stdout:7/521: truncate d3/d1e/d1f/f51 4646483 0 2024-04-25T23:01:07.561 INFO:tasks.workunit.client.0.smithi043.stdout:6/499: creat d1/d5/d3b/fac x:0 0 0 2024-04-25T23:01:07.562 INFO:tasks.workunit.client.0.smithi043.stdout:4/559: dwrite d3/d21/d6b/d87/f8b [0,4194304] 0 2024-04-25T23:01:07.562 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:07.562 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:07.563 INFO:tasks.workunit.client.0.smithi043.stdout:4/560: write d3/de/d46/d95/f99 [368340,2556] 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:4/561: truncate d3/d21/f3d 465392 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:8/390: truncate d3/d4/db/d4e/d5c/d59/d61/d66/f6f 7334 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:6/500: rename d1/d5/d3b/d4c/fa0 to d1/d5/fad 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:8/391: truncate d3/d4/d36/f76 725806 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:6/501: stat d1/d5/d3b/d4c/d21/fab 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:8/392: creat d3/d4/db/d4e/f80 x:0 0 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:6/502: write d1/d5/d3b/d4c/d21/d38/d99/f9d [292131,73849] 0 2024-04-25T23:01:07.567 INFO:tasks.workunit.client.0.smithi043.stdout:8/393: fdatasync d3/d4/db/d14/d56/d5d/f63 0 2024-04-25T23:01:07.568 INFO:tasks.workunit.client.0.smithi043.stdout:3/589: write d7/d26/d2d/f36 [1019921,81491] 0 2024-04-25T23:01:07.568 INFO:tasks.workunit.client.0.smithi043.stdout:6/503: mkdir d1/d5/d3b/d4c/d21/dae 0 2024-04-25T23:01:07.568 INFO:tasks.workunit.client.0.smithi043.stdout:3/590: dread - d7/d26/d59/d7c/fa1 zero size 2024-04-25T23:01:07.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/525: sync 2024-04-25T23:01:07.568 INFO:tasks.workunit.client.0.smithi043.stdout:5/534: sync 2024-04-25T23:01:07.569 INFO:tasks.workunit.client.0.smithi043.stdout:1/480: sync 2024-04-25T23:01:07.569 INFO:tasks.workunit.client.0.smithi043.stdout:0/482: truncate d1b/f4a 372713 0 2024-04-25T23:01:07.569 INFO:tasks.workunit.client.0.smithi043.stdout:8/394: link d3/d4/db/df/d62/d6e/f74 d3/d4/db/d14/d56/d5d/f81 0 2024-04-25T23:01:07.570 INFO:tasks.workunit.client.0.smithi043.stdout:0/483: rmdir d1b/d55 39 2024-04-25T23:01:07.570 INFO:tasks.workunit.client.0.smithi043.stdout:3/591: creat d7/d26/fca x:0 0 0 2024-04-25T23:01:07.571 INFO:tasks.workunit.client.0.smithi043.stdout:6/504: getdents d1/d5/d3b/d4c/d1a 0 2024-04-25T23:01:07.571 INFO:tasks.workunit.client.0.smithi043.stdout:1/481: creat d0/d2f/fb0 x:0 0 0 2024-04-25T23:01:07.571 INFO:tasks.workunit.client.0.smithi043.stdout:5/535: rmdir d0/d2c/d39/d1c/d25/d7a/d41/d47/d81 39 2024-04-25T23:01:07.572 INFO:tasks.workunit.client.0.smithi043.stdout:3/592: readlink d7/d26/d27/d34/l77 0 2024-04-25T23:01:07.572 INFO:tasks.workunit.client.0.smithi043.stdout:0/484: mknod d1b/d31/d3c/c93 0 2024-04-25T23:01:07.573 INFO:tasks.workunit.client.0.smithi043.stdout:5/536: dread - d0/f9d zero size 2024-04-25T23:01:07.573 INFO:tasks.workunit.client.0.smithi043.stdout:4/562: dwrite d3/d19/fab [0,4194304] 0 2024-04-25T23:01:07.573 INFO:tasks.workunit.client.0.smithi043.stdout:1/482: chown d0/fa 69 1 2024-04-25T23:01:07.574 INFO:tasks.workunit.client.0.smithi043.stdout:0/485: read d1b/d8b/f85 [4109908,46307] 0 2024-04-25T23:01:07.576 INFO:tasks.workunit.client.0.smithi043.stdout:6/505: symlink d1/d5/d3b/laf 0 2024-04-25T23:01:07.576 INFO:tasks.workunit.client.0.smithi043.stdout:3/593: mknod d7/d26/d27/d56/ccb 0 2024-04-25T23:01:07.576 INFO:tasks.workunit.client.0.smithi043.stdout:0/486: readlink d1b/l1c 0 2024-04-25T23:01:07.576 INFO:tasks.workunit.client.0.smithi043.stdout:5/537: symlink d0/d2c/d39/d1c/d25/d7a/d2d/d5f/lb9 0 2024-04-25T23:01:07.576 INFO:tasks.workunit.client.0.smithi043.stdout:4/563: creat d3/d21/d84/fc4 x:0 0 0 2024-04-25T23:01:07.578 INFO:tasks.workunit.client.0.smithi043.stdout:1/483: rename d0/d16/f76 to d0/d2f/d4b/d8f/fb1 0 2024-04-25T23:01:07.578 INFO:tasks.workunit.client.0.smithi043.stdout:0/487: write d1b/d31/d3c/f6a [1027,85228] 0 2024-04-25T23:01:07.578 INFO:tasks.workunit.client.0.smithi043.stdout:8/395: dread d3/d4/d36/f64 [0,4194304] 0 2024-04-25T23:01:07.578 INFO:tasks.workunit.client.0.smithi043.stdout:5/538: symlink d0/lba 0 2024-04-25T23:01:07.578 INFO:tasks.workunit.client.0.smithi043.stdout:4/564: chown d3/d21/l56 276040 1 2024-04-25T23:01:07.579 INFO:tasks.workunit.client.0.smithi043.stdout:9/526: dwrite d8/de/d12/d15/d2f/f50 [0,4194304] 0 2024-04-25T23:01:07.579 INFO:tasks.workunit.client.0.smithi043.stdout:3/594: mkdir d7/d26/d27/d34/d1a/d28/d9e/dcc 0 2024-04-25T23:01:07.579 INFO:tasks.workunit.client.0.smithi043.stdout:6/506: mknod d1/d5/d3b/d4c/d21/d55/d68/cb0 0 2024-04-25T23:01:07.580 INFO:tasks.workunit.client.0.smithi043.stdout:5/539: rmdir d0/d2c/d39/d1c/d25/d7a/d41/d4a/d60 39 2024-04-25T23:01:07.581 INFO:tasks.workunit.client.0.smithi043.stdout:6/507: creat d1/d5/d3b/d4c/d21/d46/d8e/fb1 x:0 0 0 2024-04-25T23:01:07.581 INFO:tasks.workunit.client.0.smithi043.stdout:5/540: write d0/d22/f6d [3218823,99812] 0 2024-04-25T23:01:07.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:07.583 INFO:tasks.workunit.client.0.smithi043.stdout:1/484: rename d0/d16/d5a/d5b/da4/f96 to d0/fb2 0 2024-04-25T23:01:07.584 INFO:tasks.workunit.client.0.smithi043.stdout:4/565: truncate d3/d21/f63 3575081 0 2024-04-25T23:01:07.584 INFO:tasks.workunit.client.0.smithi043.stdout:5/541: dread - d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/faa zero size 2024-04-25T23:01:07.585 INFO:tasks.workunit.client.0.smithi043.stdout:1/485: symlink d0/d9/lb3 0 2024-04-25T23:01:07.585 INFO:tasks.workunit.client.0.smithi043.stdout:3/595: dread d7/d26/d2d/dab/fc5 [0,4194304] 0 2024-04-25T23:01:07.586 INFO:tasks.workunit.client.0.smithi043.stdout:1/486: dread - d0/d16/d5a/d5b/da4/f81 zero size 2024-04-25T23:01:07.587 INFO:tasks.workunit.client.0.smithi043.stdout:2/419: dread d2/d3/f2c [0,4194304] 0 2024-04-25T23:01:07.587 INFO:tasks.workunit.client.0.smithi043.stdout:8/396: dwrite d3/d4/db/d14/d56/f70 [0,4194304] 0 2024-04-25T23:01:07.588 INFO:tasks.workunit.client.0.smithi043.stdout:5/542: symlink d0/d2c/d39/d1c/d25/d7a/d41/d47/lbb 0 2024-04-25T23:01:07.588 INFO:tasks.workunit.client.0.smithi043.stdout:2/420: fsync d2/d3/d13/f6e 0 2024-04-25T23:01:07.589 INFO:tasks.workunit.client.0.smithi043.stdout:8/397: write d3/f48 [1028128,75295] 0 2024-04-25T23:01:07.590 INFO:tasks.workunit.client.0.smithi043.stdout:8/398: stat d3/d4/db/d4e/l52 0 2024-04-25T23:01:07.590 INFO:tasks.workunit.client.0.smithi043.stdout:6/508: dwrite d1/d5/d3b/d62/f73 [0,4194304] 0 2024-04-25T23:01:07.591 INFO:tasks.workunit.client.0.smithi043.stdout:1/487: link d0/d2f/d4b/f7c d0/d9/fb4 0 2024-04-25T23:01:07.591 INFO:tasks.workunit.client.0.smithi043.stdout:8/399: creat d3/d4/d36/f82 x:0 0 0 2024-04-25T23:01:07.594 INFO:tasks.workunit.client.0.smithi043.stdout:8/400: creat d3/d4/db/df/f83 x:0 0 0 2024-04-25T23:01:07.594 INFO:tasks.workunit.client.0.smithi043.stdout:1/488: truncate d0/d2f/d4b/d8f/f99 309363 0 2024-04-25T23:01:07.595 INFO:tasks.workunit.client.0.smithi043.stdout:3/596: dwrite d7/d26/d59/f7a [0,4194304] 0 2024-04-25T23:01:07.596 INFO:tasks.workunit.client.0.smithi043.stdout:5/543: dwrite d0/f17 [0,4194304] 0 2024-04-25T23:01:07.596 INFO:tasks.workunit.client.0.smithi043.stdout:7/522: sync 2024-04-25T23:01:07.598 INFO:tasks.workunit.client.0.smithi043.stdout:8/401: creat d3/d4/db/d4e/d5c/f84 x:0 0 0 2024-04-25T23:01:07.598 INFO:tasks.workunit.client.0.smithi043.stdout:3/597: symlink d7/d26/d27/d34/d1a/d40/d8f/d51/lcd 0 2024-04-25T23:01:07.598 INFO:tasks.workunit.client.0.smithi043.stdout:8/402: write d3/d4/db/df/f83 [457102,102916] 0 2024-04-25T23:01:07.599 INFO:tasks.workunit.client.0.smithi043.stdout:0/488: dread d1b/d31/d3c/d72/f78 [0,4194304] 0 2024-04-25T23:01:07.600 INFO:tasks.workunit.client.0.smithi043.stdout:0/489: rename d1b/d23/d7a/l82 to d1b/d31/l94 0 2024-04-25T23:01:07.602 INFO:tasks.workunit.client.0.smithi043.stdout:1/489: dread d0/d16/f1b [0,4194304] 0 2024-04-25T23:01:07.602 INFO:tasks.workunit.client.0.smithi043.stdout:1/490: write d0/d2f/d4b/f83 [60040,76940] 0 2024-04-25T23:01:07.604 INFO:tasks.workunit.client.0.smithi043.stdout:1/491: symlink d0/d16/d5a/d5b/da4/lb5 0 2024-04-25T23:01:07.606 INFO:tasks.workunit.client.0.smithi043.stdout:7/523: read d3/d1e/d1f/f6a [2425892,47139] 0 2024-04-25T23:01:07.607 INFO:tasks.workunit.client.0.smithi043.stdout:0/490: truncate d1b/d23/f3e 605331 0 2024-04-25T23:01:07.607 INFO:tasks.workunit.client.0.smithi043.stdout:0/491: readlink d1b/l7e 0 2024-04-25T23:01:07.607 INFO:tasks.workunit.client.0.smithi043.stdout:7/524: chown d3/d1e/d1f/d6b 117912133 1 2024-04-25T23:01:07.607 INFO:tasks.workunit.client.0.smithi043.stdout:0/492: dread - d1b/d42/f88 zero size 2024-04-25T23:01:07.608 INFO:tasks.workunit.client.0.smithi043.stdout:0/493: write d1b/f37 [2025161,125738] 0 2024-04-25T23:01:07.608 INFO:tasks.workunit.client.0.smithi043.stdout:7/525: getdents d3/da 0 2024-04-25T23:01:07.609 INFO:tasks.workunit.client.0.smithi043.stdout:7/526: fdatasync d3/d96/f88 0 2024-04-25T23:01:07.609 INFO:tasks.workunit.client.0.smithi043.stdout:5/544: read d0/d2c/d39/d1c/d25/f27 [5727808,75608] 0 2024-04-25T23:01:07.609 INFO:tasks.workunit.client.0.smithi043.stdout:0/494: mknod d1b/d7f/c95 0 2024-04-25T23:01:07.610 INFO:tasks.workunit.client.0.smithi043.stdout:5/545: chown d0/d2c/d39/d1c/d25/d7a/d2d/d5f 149866 1 2024-04-25T23:01:07.610 INFO:tasks.workunit.client.0.smithi043.stdout:0/495: rename d1b/f3f to d1b/d31/f96 0 2024-04-25T23:01:07.611 INFO:tasks.workunit.client.0.smithi043.stdout:7/527: truncate d3/da/df/d11/d26/f8e 395085 0 2024-04-25T23:01:07.612 INFO:tasks.workunit.client.0.smithi043.stdout:7/528: link d3/da/d78/l81 d3/da/la5 0 2024-04-25T23:01:07.613 INFO:tasks.workunit.client.0.smithi043.stdout:4/566: sync 2024-04-25T23:01:07.614 INFO:tasks.workunit.client.0.smithi043.stdout:4/567: write d3/d21/d84/faf [71549,6111] 0 2024-04-25T23:01:07.616 INFO:tasks.workunit.client.0.smithi043.stdout:4/568: write d3/de/f13 [8908915,13999] 0 2024-04-25T23:01:07.617 INFO:tasks.workunit.client.0.smithi043.stdout:4/569: rmdir d3/de 39 2024-04-25T23:01:07.618 INFO:tasks.workunit.client.0.smithi043.stdout:4/570: fsync d3/d19/f22 0 2024-04-25T23:01:07.618 INFO:tasks.workunit.client.0.smithi043.stdout:1/492: dread d0/d9/f21 [0,4194304] 0 2024-04-25T23:01:07.618 INFO:tasks.workunit.client.0.smithi043.stdout:0/496: dwrite f1a [0,4194304] 0 2024-04-25T23:01:07.619 INFO:tasks.workunit.client.0.smithi043.stdout:4/571: fsync d3/d21/f64 0 2024-04-25T23:01:07.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/598: sync 2024-04-25T23:01:07.620 INFO:tasks.workunit.client.0.smithi043.stdout:1/493: getdents d0/d2f/d4b 0 2024-04-25T23:01:07.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/572: creat d3/d37/d4d/fc5 x:0 0 0 2024-04-25T23:01:07.621 INFO:tasks.workunit.client.0.smithi043.stdout:2/421: dread d2/d3/d22/d48/f64 [0,4194304] 0 2024-04-25T23:01:07.621 INFO:tasks.workunit.client.0.smithi043.stdout:1/494: stat d0/l36 0 2024-04-25T23:01:07.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/546: dread d0/f40 [0,4194304] 0 2024-04-25T23:01:07.622 INFO:tasks.workunit.client.0.smithi043.stdout:1/495: read d0/d16/d5a/d5b/da4/f93 [397796,29617] 0 2024-04-25T23:01:07.623 INFO:tasks.workunit.client.0.smithi043.stdout:5/547: chown d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91 70 1 2024-04-25T23:01:07.623 INFO:tasks.workunit.client.0.smithi043.stdout:3/599: mkdir d7/d26/d2d/dce 0 2024-04-25T23:01:07.624 INFO:tasks.workunit.client.0.smithi043.stdout:4/573: mkdir d3/de/d46/dc6 0 2024-04-25T23:01:07.624 INFO:tasks.workunit.client.0.smithi043.stdout:2/422: getdents d2/d7f 0 2024-04-25T23:01:07.624 INFO:tasks.workunit.client.0.smithi043.stdout:3/600: dread - d7/d26/d59/d7c/db2/d52/f58 zero size 2024-04-25T23:01:07.625 INFO:tasks.workunit.client.0.smithi043.stdout:5/548: mknod d0/d2c/d39/d1c/d25/d7a/d92/cbc 0 2024-04-25T23:01:07.625 INFO:tasks.workunit.client.0.smithi043.stdout:4/574: write d3/d19/f1e [5077157,89741] 0 2024-04-25T23:01:07.628 INFO:tasks.workunit.client.0.smithi043.stdout:3/601: creat d7/d26/d59/d7c/db2/d87/fcf x:0 0 0 2024-04-25T23:01:07.628 INFO:tasks.workunit.client.0.smithi043.stdout:6/509: dread d1/d2a/f4e [0,4194304] 0 2024-04-25T23:01:07.628 INFO:tasks.workunit.client.0.smithi043.stdout:5/549: truncate d0/d22/f6d 4898374 0 2024-04-25T23:01:07.628 INFO:tasks.workunit.client.0.smithi043.stdout:2/423: write d2/d3/f42 [2220191,104387] 0 2024-04-25T23:01:07.628 INFO:tasks.workunit.client.0.smithi043.stdout:7/529: dwrite d3/da/df/f3f [0,4194304] 0 2024-04-25T23:01:07.629 INFO:tasks.workunit.client.0.smithi043.stdout:4/575: chown d3/d19/f8d 41307933 1 2024-04-25T23:01:07.629 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:07.624+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:07.630 INFO:tasks.workunit.client.0.smithi043.stdout:6/510: readlink d1/d5/d3b/d4c/d21/d55/d68/l18 0 2024-04-25T23:01:07.630 INFO:tasks.workunit.client.0.smithi043.stdout:7/530: readlink d3/d1e/d1f/l3c 0 2024-04-25T23:01:07.630 INFO:tasks.workunit.client.0.smithi043.stdout:9/527: dread d8/de/d12/d15/d2f/f56 [0,4194304] 0 2024-04-25T23:01:07.630 INFO:tasks.workunit.client.0.smithi043.stdout:3/602: chown d7/d26/d59/f69 1 1 2024-04-25T23:01:07.631 INFO:tasks.workunit.client.0.smithi043.stdout:6/511: write d1/f1f [3731842,85964] 0 2024-04-25T23:01:07.631 INFO:tasks.workunit.client.0.smithi043.stdout:9/528: chown d8/de/d8c/fb2 0 1 2024-04-25T23:01:07.631 INFO:tasks.workunit.client.0.smithi043.stdout:6/512: chown d1/f1f 522219587 1 2024-04-25T23:01:07.631 INFO:tasks.workunit.client.0.smithi043.stdout:6/513: sync 2024-04-25T23:01:07.632 INFO:tasks.workunit.client.0.smithi043.stdout:9/529: write d8/de/d44/d65/faf [486630,114036] 0 2024-04-25T23:01:07.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/576: mkdir d3/de/d27/d45/dc7 0 2024-04-25T23:01:07.632 INFO:tasks.workunit.client.0.smithi043.stdout:9/530: sync 2024-04-25T23:01:07.632 INFO:tasks.workunit.client.0.smithi043.stdout:3/603: mkdir d7/d26/d27/d34/d1a/d40/d8f/dd0 0 2024-04-25T23:01:07.633 INFO:tasks.workunit.client.0.smithi043.stdout:7/531: rename d3/da/l10 to d3/da/d64/la6 0 2024-04-25T23:01:07.633 INFO:tasks.workunit.client.0.smithi043.stdout:1/496: dwrite d0/d16/d5a/f6e [0,4194304] 0 2024-04-25T23:01:07.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/550: truncate d0/d2c/f4c 2902809 0 2024-04-25T23:01:07.634 INFO:tasks.workunit.client.0.smithi043.stdout:8/403: dread d3/d4/db/d14/f41 [0,4194304] 0 2024-04-25T23:01:07.635 INFO:tasks.workunit.client.0.smithi043.stdout:6/514: creat d1/d5/d3b/d4c/d21/d55/fb2 x:0 0 0 2024-04-25T23:01:07.635 INFO:tasks.workunit.client.0.smithi043.stdout:4/577: mkdir d3/de/d27/d45/dc7/dc8 0 2024-04-25T23:01:07.635 INFO:tasks.workunit.client.0.smithi043.stdout:1/497: chown d0/d9/l37 7 1 2024-04-25T23:01:07.637 INFO:tasks.workunit.client.0.smithi043.stdout:6/515: stat d1/d5/d3b/f3c 0 2024-04-25T23:01:07.637 INFO:tasks.workunit.client.0.smithi043.stdout:9/531: read d8/de/d44/f45 [243171,57421] 0 2024-04-25T23:01:07.637 INFO:tasks.workunit.client.0.smithi043.stdout:3/604: write d7/d26/d59/d7c/db2/fc4 [273702,98049] 0 2024-04-25T23:01:07.638 INFO:tasks.workunit.client.0.smithi043.stdout:5/551: read d0/d2c/d39/f34 [3731175,113831] 0 2024-04-25T23:01:07.638 INFO:tasks.workunit.client.0.smithi043.stdout:2/424: dwrite d2/d7f/f81 [0,4194304] 0 2024-04-25T23:01:07.638 INFO:tasks.workunit.client.0.smithi043.stdout:4/578: write d3/de/d27/d5c/d67/fa2 [4684475,125495] 0 2024-04-25T23:01:07.639 INFO:tasks.workunit.client.0.smithi043.stdout:6/516: mknod d1/d5/d3b/d62/cb3 0 2024-04-25T23:01:07.639 INFO:tasks.workunit.client.0.smithi043.stdout:7/532: truncate d3/f19 849583 0 2024-04-25T23:01:07.640 INFO:tasks.workunit.client.0.smithi043.stdout:3/605: rmdir d7/d26/d59 39 2024-04-25T23:01:07.640 INFO:tasks.workunit.client.0.smithi043.stdout:4/579: creat d3/d37/d7a/fc9 x:0 0 0 2024-04-25T23:01:07.640 INFO:tasks.workunit.client.0.smithi043.stdout:5/552: chown d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/fad 509 1 2024-04-25T23:01:07.641 INFO:tasks.workunit.client.0.smithi043.stdout:9/532: rename d8/de/d12/d15/d2f/d84/d31/lb0 to d8/de/d12/d15/d2f/da6/lb3 0 2024-04-25T23:01:07.641 INFO:tasks.workunit.client.0.smithi043.stdout:1/498: getdents d0/d16/d5a/d5b/da4 0 2024-04-25T23:01:07.641 INFO:tasks.workunit.client.0.smithi043.stdout:4/580: readlink d3/d21/lbb 0 2024-04-25T23:01:07.641 INFO:tasks.workunit.client.0.smithi043.stdout:6/517: symlink d1/lb4 0 2024-04-25T23:01:07.641 INFO:tasks.workunit.client.0.smithi043.stdout:2/425: truncate d2/d3/d22/d23/d43/d67/f7a 3101 0 2024-04-25T23:01:07.642 INFO:tasks.workunit.client.0.smithi043.stdout:7/533: write d3/d1e/d1f/d6b/d72/f9c [1012788,68484] 0 2024-04-25T23:01:07.642 INFO:tasks.workunit.client.0.smithi043.stdout:3/606: fdatasync d7/d26/d59/d7c/db2/d52/f58 0 2024-04-25T23:01:07.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/533: creat d8/de/d12/d15/d2f/d84/d31/fb4 x:0 0 0 2024-04-25T23:01:07.643 INFO:tasks.workunit.client.0.smithi043.stdout:7/534: unlink d3/d9b/c45 0 2024-04-25T23:01:07.645 INFO:tasks.workunit.client.0.smithi043.stdout:9/534: write d8/de/f10 [8718652,50018] 0 2024-04-25T23:01:07.647 INFO:tasks.workunit.client.0.smithi043.stdout:3/607: readlink d7/d26/d27/d34/l49 0 2024-04-25T23:01:07.647 INFO:tasks.workunit.client.0.smithi043.stdout:9/535: write d8/de/d44/d65/faf [272054,34811] 0 2024-04-25T23:01:07.649 INFO:tasks.workunit.client.0.smithi043.stdout:3/608: write d7/d26/d2d/dab/fc5 [1363906,95455] 0 2024-04-25T23:01:07.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/553: dwrite d0/f5 [8388608,4194304] 0 2024-04-25T23:01:07.650 INFO:tasks.workunit.client.0.smithi043.stdout:1/499: dwrite d0/d9/d63/f90 [0,4194304] 0 2024-04-25T23:01:07.652 INFO:tasks.workunit.client.0.smithi043.stdout:5/554: unlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/lae 0 2024-04-25T23:01:07.653 INFO:tasks.workunit.client.0.smithi043.stdout:1/500: write d0/d16/f1b [4505404,122672] 0 2024-04-25T23:01:07.655 INFO:tasks.workunit.client.0.smithi043.stdout:8/404: dread d3/d4/db/f4b [0,4194304] 0 2024-04-25T23:01:07.655 INFO:tasks.workunit.client.0.smithi043.stdout:1/501: creat d0/d86/fb6 x:0 0 0 2024-04-25T23:01:07.657 INFO:tasks.workunit.client.0.smithi043.stdout:9/536: dwrite d8/de/d12/d15/d2f/d84/f66 [0,4194304] 0 2024-04-25T23:01:07.657 INFO:tasks.workunit.client.0.smithi043.stdout:1/502: fdatasync d0/d9/faf 0 2024-04-25T23:01:07.658 INFO:tasks.workunit.client.0.smithi043.stdout:3/609: dwrite d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/faa [0,4194304] 0 2024-04-25T23:01:07.659 INFO:tasks.workunit.client.0.smithi043.stdout:0/497: dread d1b/d23/d39/f4f [0,4194304] 0 2024-04-25T23:01:07.660 INFO:tasks.workunit.client.0.smithi043.stdout:5/555: link d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f65 d0/d2c/d39/d1c/d25/d4e/fbd 0 2024-04-25T23:01:07.661 INFO:tasks.workunit.client.0.smithi043.stdout:3/610: truncate d7/f9 2407324 0 2024-04-25T23:01:07.662 INFO:tasks.workunit.client.0.smithi043.stdout:1/503: rename d0/d2f/d4b/f92 to d0/d86/fb7 0 2024-04-25T23:01:07.663 INFO:tasks.workunit.client.0.smithi043.stdout:3/611: dread - d7/d26/d59/d7c/fa1 zero size 2024-04-25T23:01:07.664 INFO:tasks.workunit.client.0.smithi043.stdout:5/556: write d0/f40 [1693915,3640] 0 2024-04-25T23:01:07.664 INFO:tasks.workunit.client.0.smithi043.stdout:9/537: link d8/de/d12/d16/c8b d8/de/d12/d16/d24/cb5 0 2024-04-25T23:01:07.666 INFO:tasks.workunit.client.0.smithi043.stdout:1/504: creat d0/d2f/d4b/d8f/fb8 x:0 0 0 2024-04-25T23:01:07.666 INFO:tasks.workunit.client.0.smithi043.stdout:5/557: fsync d0/f17 0 2024-04-25T23:01:07.669 INFO:tasks.workunit.client.0.smithi043.stdout:9/538: mknod d8/de/d8c/cb6 0 2024-04-25T23:01:07.669 INFO:tasks.workunit.client.0.smithi043.stdout:4/581: dwrite d3/de/f73 [0,4194304] 0 2024-04-25T23:01:07.669 INFO:tasks.workunit.client.0.smithi043.stdout:8/405: dwrite d3/d4/db/d4e/d5c/f84 [0,4194304] 0 2024-04-25T23:01:07.670 INFO:tasks.workunit.client.0.smithi043.stdout:5/558: write d0/d22/f7b [142225,55102] 0 2024-04-25T23:01:07.670 INFO:tasks.workunit.client.0.smithi043.stdout:1/505: creat d0/d2f/d4b/d8f/fb9 x:0 0 0 2024-04-25T23:01:07.670 INFO:tasks.workunit.client.0.smithi043.stdout:3/612: creat d7/d26/d27/d34/d1a/d28/d9e/dcc/fd1 x:0 0 0 2024-04-25T23:01:07.671 INFO:tasks.workunit.client.0.smithi043.stdout:6/518: dwrite d1/d2a/f76 [0,4194304] 0 2024-04-25T23:01:07.671 INFO:tasks.workunit.client.0.smithi043.stdout:4/582: readlink d3/d19/d34/l6f 0 2024-04-25T23:01:07.671 INFO:tasks.workunit.client.0.smithi043.stdout:2/426: dwrite d2/d7f/f80 [0,4194304] 0 2024-04-25T23:01:07.672 INFO:tasks.workunit.client.0.smithi043.stdout:1/506: creat d0/d9/d63/fba x:0 0 0 2024-04-25T23:01:07.672 INFO:tasks.workunit.client.0.smithi043.stdout:5/559: symlink d0/d6a/lbe 0 2024-04-25T23:01:07.674 INFO:tasks.workunit.client.0.smithi043.stdout:8/406: getdents d3/d4/db/d14 0 2024-04-25T23:01:07.674 INFO:tasks.workunit.client.0.smithi043.stdout:6/519: truncate d1/d5/d3b/d4c/d21/d55/fa6 1038917 0 2024-04-25T23:01:07.675 INFO:tasks.workunit.client.0.smithi043.stdout:5/560: fdatasync d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/fad 0 2024-04-25T23:01:07.675 INFO:tasks.workunit.client.0.smithi043.stdout:6/520: mkdir d1/d2a/db5 0 2024-04-25T23:01:07.677 INFO:tasks.workunit.client.0.smithi043.stdout:4/583: dread d3/d37/d4d/fb0 [0,4194304] 0 2024-04-25T23:01:07.678 INFO:tasks.workunit.client.0.smithi043.stdout:2/427: link d2/d3/d13/d18/l1b d2/d3/d13/l83 0 2024-04-25T23:01:07.678 INFO:tasks.workunit.client.0.smithi043.stdout:6/521: readlink d1/d5/d3b/d4c/d21/d55/l92 0 2024-04-25T23:01:07.678 INFO:tasks.workunit.client.0.smithi043.stdout:5/561: stat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fb3 0 2024-04-25T23:01:07.679 INFO:tasks.workunit.client.0.smithi043.stdout:9/539: dwrite d8/de/f10 [0,4194304] 0 2024-04-25T23:01:07.680 INFO:tasks.workunit.client.0.smithi043.stdout:5/562: write d0/d2c/d39/d1c/d5e/fa7 [82297,60831] 0 2024-04-25T23:01:07.682 INFO:tasks.workunit.client.0.smithi043.stdout:9/540: rmdir d8/de/d44/d47/d6a 39 2024-04-25T23:01:07.682 INFO:tasks.workunit.client.0.smithi043.stdout:8/407: dread d3/d4/db/d4e/d5c/f84 [0,4194304] 0 2024-04-25T23:01:07.682 INFO:tasks.workunit.client.0.smithi043.stdout:3/613: dwrite d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/faa [0,4194304] 0 2024-04-25T23:01:07.682 INFO:tasks.workunit.client.0.smithi043.stdout:2/428: readlink d2/d3/d22/d63/l7e 0 2024-04-25T23:01:07.682 INFO:tasks.workunit.client.0.smithi043.stdout:8/408: dread - d3/d4/d36/f82 zero size 2024-04-25T23:01:07.683 INFO:tasks.workunit.client.0.smithi043.stdout:9/541: creat d8/de/d12/d15/d2f/fb7 x:0 0 0 2024-04-25T23:01:07.684 INFO:tasks.workunit.client.0.smithi043.stdout:8/409: readlink d3/d4/db/l23 0 2024-04-25T23:01:07.684 INFO:tasks.workunit.client.0.smithi043.stdout:5/563: truncate d0/d2c/f9a 513853 0 2024-04-25T23:01:07.684 INFO:tasks.workunit.client.0.smithi043.stdout:2/429: unlink d2/d3/d22/d63/l7e 0 2024-04-25T23:01:07.684 INFO:tasks.workunit.client.0.smithi043.stdout:3/614: creat d7/d26/d27/d34/d1a/d40/d8f/d51/fd2 x:0 0 0 2024-04-25T23:01:07.684 INFO:tasks.workunit.client.0.smithi043.stdout:5/564: readlink d0/d6a/lbe 0 2024-04-25T23:01:07.684 INFO:tasks.workunit.client.0.smithi043.stdout:9/542: write d8/de/d12/d16/d24/f98 [986196,94376] 0 2024-04-25T23:01:07.685 INFO:tasks.workunit.client.0.smithi043.stdout:2/430: creat d2/d3/d22/d23/d43/d5d/f84 x:0 0 0 2024-04-25T23:01:07.685 INFO:tasks.workunit.client.0.smithi043.stdout:8/410: write d3/d4/db/df/d10/d33/f2a [423666,123952] 0 2024-04-25T23:01:07.685 INFO:tasks.workunit.client.0.smithi043.stdout:5/565: read d0/d2c/d39/d1c/d25/d7a/f44 [2815485,79914] 0 2024-04-25T23:01:07.685 INFO:tasks.workunit.client.0.smithi043.stdout:2/431: write d2/d3/d13/d40/f51 [430434,88262] 0 2024-04-25T23:01:07.686 INFO:tasks.workunit.client.0.smithi043.stdout:9/543: fsync d8/de/d44/f45 0 2024-04-25T23:01:07.686 INFO:tasks.workunit.client.0.smithi043.stdout:8/411: mknod d3/d4/db/df/d62/d6e/c85 0 2024-04-25T23:01:07.687 INFO:tasks.workunit.client.0.smithi043.stdout:8/412: fsync d3/d4/f71 0 2024-04-25T23:01:07.687 INFO:tasks.workunit.client.0.smithi043.stdout:9/544: symlink d8/de/d12/d7a/lb8 0 2024-04-25T23:01:07.687 INFO:tasks.workunit.client.0.smithi043.stdout:8/413: fsync d3/d4/db/d4e/f80 0 2024-04-25T23:01:07.688 INFO:tasks.workunit.client.0.smithi043.stdout:9/545: stat d8/de/d44/d47/d6a 0 2024-04-25T23:01:07.693 INFO:tasks.workunit.client.0.smithi043.stdout:8/414: dwrite d3/d4/db/d14/d56/d5d/f63 [0,4194304] 0 2024-04-25T23:01:07.700 INFO:tasks.workunit.client.0.smithi043.stdout:7/535: truncate d3/f19 108834 0 2024-04-25T23:01:07.703 INFO:tasks.workunit.client.0.smithi043.stdout:8/415: dwrite d3/d4/db/d4e/d5c/f84 [4194304,4194304] 0 2024-04-25T23:01:07.704 INFO:tasks.workunit.client.0.smithi043.stdout:0/498: dwrite d1b/f4a [0,4194304] 0 2024-04-25T23:01:07.707 INFO:tasks.workunit.client.0.smithi043.stdout:0/499: creat d1b/d23/d39/d90/f97 x:0 0 0 2024-04-25T23:01:07.707 INFO:tasks.workunit.client.0.smithi043.stdout:8/416: mknod d3/d4/db/c86 0 2024-04-25T23:01:07.707 INFO:tasks.workunit.client.0.smithi043.stdout:7/536: dwrite d3/da/df/d11/f20 [0,4194304] 0 2024-04-25T23:01:07.707 INFO:tasks.workunit.client.0.smithi043.stdout:8/417: dread - d3/d4/d36/f82 zero size 2024-04-25T23:01:07.708 INFO:tasks.workunit.client.0.smithi043.stdout:0/500: creat d1b/d23/d7a/f98 x:0 0 0 2024-04-25T23:01:07.709 INFO:tasks.workunit.client.0.smithi043.stdout:0/501: symlink d1b/d23/d39/d90/l99 0 2024-04-25T23:01:07.709 INFO:tasks.workunit.client.0.smithi043.stdout:0/502: chown d1b/c22 118263135 1 2024-04-25T23:01:07.714 INFO:tasks.workunit.client.0.smithi043.stdout:0/503: dread d1b/d8b/f85 [0,4194304] 0 2024-04-25T23:01:07.714 INFO:tasks.workunit.client.0.smithi043.stdout:6/522: sync 2024-04-25T23:01:07.714 INFO:tasks.workunit.client.0.smithi043.stdout:8/418: sync 2024-04-25T23:01:07.715 INFO:tasks.workunit.client.0.smithi043.stdout:8/419: chown d3/d4/db/d14 1415017396 1 2024-04-25T23:01:07.715 INFO:tasks.workunit.client.0.smithi043.stdout:0/504: symlink d1b/d23/d7a/l9a 0 2024-04-25T23:01:07.715 INFO:tasks.workunit.client.0.smithi043.stdout:8/420: fdatasync d3/d4/db/df/d10/f15 0 2024-04-25T23:01:07.716 INFO:tasks.workunit.client.0.smithi043.stdout:8/421: chown d3/d4/d36/f76 2574 1 2024-04-25T23:01:07.717 INFO:tasks.workunit.client.0.smithi043.stdout:8/422: symlink d3/d4/db/l87 0 2024-04-25T23:01:07.718 INFO:tasks.workunit.client.0.smithi043.stdout:4/584: write d3/fa [1027384,24458] 0 2024-04-25T23:01:07.720 INFO:tasks.workunit.client.0.smithi043.stdout:8/423: dread - d3/d4/db/df/d62/d6e/f74 zero size 2024-04-25T23:01:07.720 INFO:tasks.workunit.client.0.smithi043.stdout:9/546: dread d8/fd [0,4194304] 0 2024-04-25T23:01:07.721 INFO:tasks.workunit.client.0.smithi043.stdout:8/424: symlink d3/d4/db/d4e/l88 0 2024-04-25T23:01:07.721 INFO:tasks.workunit.client.0.smithi043.stdout:4/585: getdents d3/de/d46/d6a/d8f 0 2024-04-25T23:01:07.722 INFO:tasks.workunit.client.0.smithi043.stdout:0/505: dwrite d1b/f45 [0,4194304] 0 2024-04-25T23:01:07.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/432: rename d2/d3/d22/d23 to d2/d66/d85 0 2024-04-25T23:01:07.723 INFO:tasks.workunit.client.0.smithi043.stdout:6/523: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/f6e [0,4194304] 0 2024-04-25T23:01:07.723 INFO:tasks.workunit.client.0.smithi043.stdout:3/615: write d7/d26/d27/d34/d1a/d40/d8f/d51/fc8 [1374742,69548] 0 2024-04-25T23:01:07.723 INFO:tasks.workunit.client.0.smithi043.stdout:5/566: truncate d0/d22/f76 1357325 0 2024-04-25T23:01:07.724 INFO:tasks.workunit.client.0.smithi043.stdout:4/586: write d3/de/f13 [4312845,92827] 0 2024-04-25T23:01:07.724 INFO:tasks.workunit.client.0.smithi043.stdout:8/425: read - d3/d4/d36/f82 zero size 2024-04-25T23:01:07.724 INFO:tasks.workunit.client.0.smithi043.stdout:9/547: creat d8/de/d12/d15/d2f/d84/d31/fb9 x:0 0 0 2024-04-25T23:01:07.725 INFO:tasks.workunit.client.0.smithi043.stdout:6/524: stat d1/d5/d3b/d4c/d21/d55/d6d/d96 0 2024-04-25T23:01:07.725 INFO:tasks.workunit.client.0.smithi043.stdout:4/587: chown d3/de/d27/d45/c85 208 1 2024-04-25T23:01:07.725 INFO:tasks.workunit.client.0.smithi043.stdout:8/426: write d3/d4/db/df/d10/d33/f1a [2031591,105593] 0 2024-04-25T23:01:07.725 INFO:tasks.workunit.client.0.smithi043.stdout:5/567: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e [2319495,94785] 0 2024-04-25T23:01:07.726 INFO:tasks.workunit.client.0.smithi043.stdout:6/525: write d1/d5/d3b/d4c/d1a/f54 [4912660,102217] 0 2024-04-25T23:01:07.729 INFO:tasks.workunit.client.0.smithi043.stdout:5/568: fdatasync d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/f83 0 2024-04-25T23:01:07.729 INFO:tasks.workunit.client.0.smithi043.stdout:9/548: rmdir d8/de/d44/d47/d6a 39 2024-04-25T23:01:07.729 INFO:tasks.workunit.client.0.smithi043.stdout:0/506: creat d1b/d31/d3c/d50/f9b x:0 0 0 2024-04-25T23:01:07.729 INFO:tasks.workunit.client.0.smithi043.stdout:2/433: rename d2/d66/d85/d76/f6a to d2/d66/d85/d43/d67/f86 0 2024-04-25T23:01:07.729 INFO:tasks.workunit.client.0.smithi043.stdout:6/526: fdatasync d1/d5/d3b/d4c/d21/d55/d6d/d96/f71 0 2024-04-25T23:01:07.729 INFO:tasks.workunit.client.0.smithi043.stdout:3/616: creat d7/d26/d27/d34/d1a/d40/d8f/fd3 x:0 0 0 2024-04-25T23:01:07.730 INFO:tasks.workunit.client.0.smithi043.stdout:3/617: chown d7/d26/d27/d34/l77 81136 1 2024-04-25T23:01:07.730 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:07.726+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:07.731 INFO:tasks.workunit.client.0.smithi043.stdout:8/427: rename d3/d4/db/d4e/d5c/d59/d61/d66/f6b to d3/d4/db/d4e/d5c/d59/d61/d66/f89 0 2024-04-25T23:01:07.732 INFO:tasks.workunit.client.0.smithi043.stdout:5/569: unlink d0/fd 0 2024-04-25T23:01:07.732 INFO:tasks.workunit.client.0.smithi043.stdout:0/507: write d1b/d31/f81 [647021,127474] 0 2024-04-25T23:01:07.732 INFO:tasks.workunit.client.0.smithi043.stdout:3/618: creat d7/d26/d27/fd4 x:0 0 0 2024-04-25T23:01:07.733 INFO:tasks.workunit.client.0.smithi043.stdout:8/428: fdatasync d3/d4/db/d4e/d5c/d2e/f72 0 2024-04-25T23:01:07.733 INFO:tasks.workunit.client.0.smithi043.stdout:9/549: mknod d8/de/d44/d47/d6a/cba 0 2024-04-25T23:01:07.733 INFO:tasks.workunit.client.0.smithi043.stdout:0/508: chown d1b/d23/f2a 44624 1 2024-04-25T23:01:07.733 INFO:tasks.workunit.client.0.smithi043.stdout:2/434: creat d2/d66/d85/f87 x:0 0 0 2024-04-25T23:01:07.734 INFO:tasks.workunit.client.0.smithi043.stdout:6/527: rename d1/d5/d3b/d4c/d21/dae to d1/d5/d3b/db6 0 2024-04-25T23:01:07.734 INFO:tasks.workunit.client.0.smithi043.stdout:0/509: creat d1b/d8b/f9c x:0 0 0 2024-04-25T23:01:07.735 INFO:tasks.workunit.client.0.smithi043.stdout:2/435: write d2/d7f/f81 [4216078,78031] 0 2024-04-25T23:01:07.735 INFO:tasks.workunit.client.0.smithi043.stdout:9/550: mknod d8/de/d12/d15/d2f/cbb 0 2024-04-25T23:01:07.735 INFO:tasks.workunit.client.0.smithi043.stdout:8/429: rename d3/c51 to d3/c8a 0 2024-04-25T23:01:07.736 INFO:tasks.workunit.client.0.smithi043.stdout:0/510: symlink d1b/d31/d3c/d72/l9d 0 2024-04-25T23:01:07.737 INFO:tasks.workunit.client.0.smithi043.stdout:2/436: stat d2/d66/d85/d43/d67/f7a 0 2024-04-25T23:01:07.737 INFO:tasks.workunit.client.0.smithi043.stdout:9/551: creat d8/de/d12/d15/d2f/fbc x:0 0 0 2024-04-25T23:01:07.737 INFO:tasks.workunit.client.0.smithi043.stdout:7/537: dwrite d3/d1e/f9e [0,4194304] 0 2024-04-25T23:01:07.739 INFO:tasks.workunit.client.0.smithi043.stdout:8/430: rmdir d3/d4/db/d4e/d5c/d2e 39 2024-04-25T23:01:07.740 INFO:tasks.workunit.client.0.smithi043.stdout:0/511: rename d1b/c6b to d1b/d8b/c9e 0 2024-04-25T23:01:07.740 INFO:tasks.workunit.client.0.smithi043.stdout:7/538: chown d3/d1e/c2c 1 1 2024-04-25T23:01:07.742 INFO:tasks.workunit.client.0.smithi043.stdout:2/437: symlink d2/d66/d85/l88 0 2024-04-25T23:01:07.742 INFO:tasks.workunit.client.0.smithi043.stdout:9/552: creat d8/de/d12/d15/d2f/d84/d31/fbd x:0 0 0 2024-04-25T23:01:07.744 INFO:tasks.workunit.client.0.smithi043.stdout:5/570: dwrite d0/d2c/d39/d1c/f55 [0,4194304] 0 2024-04-25T23:01:07.745 INFO:tasks.workunit.client.0.smithi043.stdout:3/619: dwrite d7/d26/d59/d7c/db2/d87/fa5 [0,4194304] 0 2024-04-25T23:01:07.745 INFO:tasks.workunit.client.0.smithi043.stdout:7/539: fsync d3/da/f62 0 2024-04-25T23:01:07.745 INFO:tasks.workunit.client.0.smithi043.stdout:1/507: dread d0/d2f/d4b/f75 [0,4194304] 0 2024-04-25T23:01:07.745 INFO:tasks.workunit.client.0.smithi043.stdout:2/438: write d2/d3/d22/f26 [5461012,118205] 0 2024-04-25T23:01:07.746 INFO:tasks.workunit.client.0.smithi043.stdout:9/553: mkdir d8/de/d12/d16/d24/dbe 0 2024-04-25T23:01:07.746 INFO:tasks.workunit.client.0.smithi043.stdout:8/431: fdatasync d3/d4/db/d4e/d5c/d59/d61/d66/f6f 0 2024-04-25T23:01:07.750 INFO:tasks.workunit.client.0.smithi043.stdout:4/588: dread d3/fa [0,4194304] 0 2024-04-25T23:01:07.750 INFO:tasks.workunit.client.0.smithi043.stdout:7/540: dread - d3/d9b/f89 zero size 2024-04-25T23:01:07.750 INFO:tasks.workunit.client.0.smithi043.stdout:6/528: dwrite d1/d5/d3b/d4c/d21/d55/d6d/f70 [0,4194304] 0 2024-04-25T23:01:07.750 INFO:tasks.workunit.client.0.smithi043.stdout:2/439: write d2/d3/d13/f6e [217415,90039] 0 2024-04-25T23:01:07.753 INFO:tasks.workunit.client.0.smithi043.stdout:0/512: getdents d1b/d23/d7a 0 2024-04-25T23:01:07.753 INFO:tasks.workunit.client.0.smithi043.stdout:1/508: mknod d0/d3d/d4f/cbb 0 2024-04-25T23:01:07.753 INFO:tasks.workunit.client.0.smithi043.stdout:7/541: write d3/d96/f8a [2169319,12797] 0 2024-04-25T23:01:07.753 INFO:tasks.workunit.client.0.smithi043.stdout:8/432: mkdir d3/d4/db/d4e/d8b 0 2024-04-25T23:01:07.753 INFO:tasks.workunit.client.0.smithi043.stdout:3/620: symlink d7/d26/d2d/dab/ld5 0 2024-04-25T23:01:07.753 INFO:tasks.workunit.client.0.smithi043.stdout:4/589: mkdir d3/d19/dca 0 2024-04-25T23:01:07.754 INFO:tasks.workunit.client.0.smithi043.stdout:2/440: chown d2/d3/d13/l83 407419004 1 2024-04-25T23:01:07.754 INFO:tasks.workunit.client.0.smithi043.stdout:8/433: write d3/d4/db/f2d [353421,104218] 0 2024-04-25T23:01:07.754 INFO:tasks.workunit.client.0.smithi043.stdout:2/441: write d2/d3/f27 [5769791,69220] 0 2024-04-25T23:01:07.754 INFO:tasks.workunit.client.0.smithi043.stdout:3/621: write d7/d26/d27/d34/d1a/d28/fa6 [726584,119834] 0 2024-04-25T23:01:07.754 INFO:tasks.workunit.client.0.smithi043.stdout:1/509: link d0/d3c/l4e d0/d16/lbc 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:5/571: write d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/fad [25409,88097] 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:7/542: mknod d3/da/df/d11/d8d/da4/ca7 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:6/529: getdents d1 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:9/554: truncate d8/de/d12/d16/f36 1155731 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:4/590: creat d3/de/fcb x:0 0 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/442: write d2/d66/d85/f37 [1243990,112596] 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:3/622: mknod d7/d26/d2d/dce/cd6 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:7/543: write d3/d52/f60 [3013293,126565] 0 2024-04-25T23:01:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/443: sync 2024-04-25T23:01:07.757 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:07.757 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:07.758 INFO:tasks.workunit.client.0.smithi043.stdout:0/513: dread f1a [0,4194304] 0 2024-04-25T23:01:07.758 INFO:tasks.workunit.client.0.smithi043.stdout:5/572: readlink d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/l98 0 2024-04-25T23:01:07.758 INFO:tasks.workunit.client.0.smithi043.stdout:3/623: chown d7/d26/d2d/l70 476 1 2024-04-25T23:01:07.758 INFO:tasks.workunit.client.0.smithi043.stdout:7/544: mkdir d3/d9b/da8 0 2024-04-25T23:01:07.758 INFO:tasks.workunit.client.0.smithi043.stdout:0/514: symlink d1b/d42/l9f 0 2024-04-25T23:01:07.758 INFO:tasks.workunit.client.0.smithi043.stdout:9/555: getdents d8/de/d44/d5d/d4f 0 2024-04-25T23:01:07.758 INFO:tasks.workunit.client.0.smithi043.stdout:2/444: getdents d2/d66/d85/d43/d67 0 2024-04-25T23:01:07.759 INFO:tasks.workunit.client.0.smithi043.stdout:9/556: dread - d8/f89 zero size 2024-04-25T23:01:07.759 INFO:tasks.workunit.client.0.smithi043.stdout:5/573: creat d0/d2c/d39/d1c/d25/d7a/d92/fbf x:0 0 0 2024-04-25T23:01:07.759 INFO:tasks.workunit.client.0.smithi043.stdout:3/624: link d7/d26/d59/f8e d7/d26/d88/db8/fd7 0 2024-04-25T23:01:07.760 INFO:tasks.workunit.client.0.smithi043.stdout:9/557: fsync d8/de/f42 0 2024-04-25T23:01:07.760 INFO:tasks.workunit.client.0.smithi043.stdout:7/545: read d3/d1e/f50 [1210538,88779] 0 2024-04-25T23:01:07.761 INFO:tasks.workunit.client.0.smithi043.stdout:2/445: chown d2/d3/d13/d40/c55 174161 1 2024-04-25T23:01:07.761 INFO:tasks.workunit.client.0.smithi043.stdout:0/515: getdents d1b/d8b/d7d 0 2024-04-25T23:01:07.761 INFO:tasks.workunit.client.0.smithi043.stdout:4/591: rmdir d3/de/d46/dc6 0 2024-04-25T23:01:07.761 INFO:tasks.workunit.client.0.smithi043.stdout:5/574: symlink d0/d22/lc0 0 2024-04-25T23:01:07.762 INFO:tasks.workunit.client.0.smithi043.stdout:2/446: chown d2/d3/d13/l83 154 1 2024-04-25T23:01:07.763 INFO:tasks.workunit.client.0.smithi043.stdout:9/558: rename d8/de/d12 to d8/de/d12/d15/d2f/dad/dbf 22 2024-04-25T23:01:07.763 INFO:tasks.workunit.client.0.smithi043.stdout:0/516: write d1b/d23/d39/f4f [5138663,56395] 0 2024-04-25T23:01:07.764 INFO:tasks.workunit.client.0.smithi043.stdout:1/510: dwrite d0/d16/f6d [0,4194304] 0 2024-04-25T23:01:07.764 INFO:tasks.workunit.client.0.smithi043.stdout:7/546: rename d3/d96/f88 to d3/da/d78/fa9 0 2024-04-25T23:01:07.765 INFO:tasks.workunit.client.0.smithi043.stdout:4/592: link d3/d37/d4d/fb0 d3/d21/d84/fcc 0 2024-04-25T23:01:07.768 INFO:tasks.workunit.client.0.smithi043.stdout:0/517: symlink d1b/d23/d39/d90/la0 0 2024-04-25T23:01:07.768 INFO:tasks.workunit.client.0.smithi043.stdout:8/434: dwrite d3/d4/db/d4e/d5c/d2e/f72 [0,4194304] 0 2024-04-25T23:01:07.768 INFO:tasks.workunit.client.0.smithi043.stdout:1/511: unlink d0/d2f/d4b/c55 0 2024-04-25T23:01:07.769 INFO:tasks.workunit.client.0.smithi043.stdout:4/593: write d3/d21/d6b/f7f [429437,27356] 0 2024-04-25T23:01:07.770 INFO:tasks.workunit.client.0.smithi043.stdout:8/435: mknod d3/d4/db/df/d10/c8c 0 2024-04-25T23:01:07.770 INFO:tasks.workunit.client.0.smithi043.stdout:7/547: rename d3/d9b/d63/c86 to d3/da/df/d11/d8d/caa 0 2024-04-25T23:01:07.770 INFO:tasks.workunit.client.0.smithi043.stdout:3/625: dread d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f9a [0,4194304] 0 2024-04-25T23:01:07.771 INFO:tasks.workunit.client.0.smithi043.stdout:6/530: dread d1/d5/f22 [0,4194304] 0 2024-04-25T23:01:07.771 INFO:tasks.workunit.client.0.smithi043.stdout:0/518: creat d1b/d55/d8f/fa1 x:0 0 0 2024-04-25T23:01:07.771 INFO:tasks.workunit.client.0.smithi043.stdout:7/548: chown d3/d1e/l67 1 1 2024-04-25T23:01:07.773 INFO:tasks.workunit.client.0.smithi043.stdout:8/436: mkdir d3/d4/db/df/d10/d8d 0 2024-04-25T23:01:07.773 INFO:tasks.workunit.client.0.smithi043.stdout:4/594: chown d3/d37/d4d/fb0 46179427 1 2024-04-25T23:01:07.773 INFO:tasks.workunit.client.0.smithi043.stdout:0/519: stat d1b/d42/f63 0 2024-04-25T23:01:07.775 INFO:tasks.workunit.client.0.smithi043.stdout:7/549: read d3/d9b/f66 [49527,107497] 0 2024-04-25T23:01:07.775 INFO:tasks.workunit.client.0.smithi043.stdout:3/626: symlink d7/d26/d27/d34/ld8 0 2024-04-25T23:01:07.776 INFO:tasks.workunit.client.0.smithi043.stdout:4/595: write d3/fa [512077,120472] 0 2024-04-25T23:01:07.776 INFO:tasks.workunit.client.0.smithi043.stdout:6/531: symlink d1/d5/d3b/d4c/d21/d55/d6d/lb7 0 2024-04-25T23:01:07.776 INFO:tasks.workunit.client.0.smithi043.stdout:8/437: write d3/d4/db/d4e/d5c/d2e/f72 [3142693,80322] 0 2024-04-25T23:01:07.779 INFO:tasks.workunit.client.0.smithi043.stdout:2/447: dwrite d2/d3/d22/f52 [0,4194304] 0 2024-04-25T23:01:07.779 INFO:tasks.workunit.client.0.smithi043.stdout:4/596: dread - d3/d21/d6b/d87/fb1 zero size 2024-04-25T23:01:07.780 INFO:tasks.workunit.client.0.smithi043.stdout:5/575: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/fb6 [0,4194304] 0 2024-04-25T23:01:07.781 INFO:tasks.workunit.client.0.smithi043.stdout:2/448: chown d2/d66/d85/d43 7 1 2024-04-25T23:01:07.781 INFO:tasks.workunit.client.0.smithi043.stdout:4/597: fsync d3/d37/d4d/f8c 0 2024-04-25T23:01:07.781 INFO:tasks.workunit.client.0.smithi043.stdout:1/512: dwrite d0/d16/f5e [4194304,4194304] 0 2024-04-25T23:01:07.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:07.782 INFO:tasks.workunit.client.0.smithi043.stdout:1/513: chown d0/d9/f25 9556 1 2024-04-25T23:01:07.782 INFO:tasks.workunit.client.0.smithi043.stdout:0/520: dread d1b/d42/f64 [0,4194304] 0 2024-04-25T23:01:07.782 INFO:tasks.workunit.client.0.smithi043.stdout:3/627: unlink d7/d26/d27/d56/f91 0 2024-04-25T23:01:07.783 INFO:tasks.workunit.client.0.smithi043.stdout:4/598: mknod d3/de/d27/d5c/d67/ccd 0 2024-04-25T23:01:07.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/521: mkdir d1b/d8b/da2 0 2024-04-25T23:01:07.784 INFO:tasks.workunit.client.0.smithi043.stdout:5/576: mknod d0/d2c/d39/d1c/d25/d7a/d41/cc1 0 2024-04-25T23:01:07.786 INFO:tasks.workunit.client.0.smithi043.stdout:1/514: creat d0/fbd x:0 0 0 2024-04-25T23:01:07.787 INFO:tasks.workunit.client.0.smithi043.stdout:5/577: write d0/d2c/f9a [1157336,68929] 0 2024-04-25T23:01:07.788 INFO:tasks.workunit.client.0.smithi043.stdout:1/515: stat d0/d16/d5a/d5b/da4/f7e 0 2024-04-25T23:01:07.789 INFO:tasks.workunit.client.0.smithi043.stdout:2/449: dwrite d2/d3/d22/d48/f64 [0,4194304] 0 2024-04-25T23:01:07.789 INFO:tasks.workunit.client.0.smithi043.stdout:3/628: dread - d7/d26/d27/d34/d1a/d40/d8f/fd3 zero size 2024-04-25T23:01:07.789 INFO:tasks.workunit.client.0.smithi043.stdout:8/438: dwrite d3/d4/db/d14/f41 [0,4194304] 0 2024-04-25T23:01:07.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/550: dwrite d3/d96/f8a [0,4194304] 0 2024-04-25T23:01:07.790 INFO:tasks.workunit.client.0.smithi043.stdout:5/578: fdatasync d0/d2c/d39/d1c/d25/d7a/d92/fbf 0 2024-04-25T23:01:07.793 INFO:tasks.workunit.client.0.smithi043.stdout:3/629: write d7/d26/d59/fa2 [916368,82183] 0 2024-04-25T23:01:07.793 INFO:tasks.workunit.client.0.smithi043.stdout:1/516: mknod d0/d2f/d4b/da6/cbe 0 2024-04-25T23:01:07.793 INFO:tasks.workunit.client.0.smithi043.stdout:4/599: link d3/de/d27/d45/c51 d3/cce 0 2024-04-25T23:01:07.793 INFO:tasks.workunit.client.0.smithi043.stdout:8/439: rmdir d3/d4/db/d14/d4c 39 2024-04-25T23:01:07.793 INFO:tasks.workunit.client.0.smithi043.stdout:5/579: write d0/f9d [312784,117396] 0 2024-04-25T23:01:07.793 INFO:tasks.workunit.client.0.smithi043.stdout:1/517: fsync d0/d2f/d4b/f7c 0 2024-04-25T23:01:07.795 INFO:tasks.workunit.client.0.smithi043.stdout:7/551: getdents d3/d52 0 2024-04-25T23:01:07.795 INFO:tasks.workunit.client.0.smithi043.stdout:0/522: dwrite d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:07.795 INFO:tasks.workunit.client.0.smithi043.stdout:3/630: mknod d7/d26/d27/d34/d1a/cd9 0 2024-04-25T23:01:07.796 INFO:tasks.workunit.client.0.smithi043.stdout:5/580: write d0/d2c/d39/d1c/d25/d7a/d2d/f74 [688114,128617] 0 2024-04-25T23:01:07.797 INFO:tasks.workunit.client.0.smithi043.stdout:7/552: chown d3/da/df/d11/l3a 19691 1 2024-04-25T23:01:07.797 INFO:tasks.workunit.client.0.smithi043.stdout:6/532: dwrite d1/d5/d3b/d4c/d21/d38/f45 [0,4194304] 0 2024-04-25T23:01:07.797 INFO:tasks.workunit.client.0.smithi043.stdout:3/631: chown d7/d26/f3d 4518703 1 2024-04-25T23:01:07.797 INFO:tasks.workunit.client.0.smithi043.stdout:8/440: read - d3/d4/db/df/d62/d6e/f74 zero size 2024-04-25T23:01:07.798 INFO:tasks.workunit.client.0.smithi043.stdout:5/581: fdatasync d0/d2c/d39/d1c/d5e/fa7 0 2024-04-25T23:01:07.798 INFO:tasks.workunit.client.0.smithi043.stdout:6/533: read - d1/d5/d3b/d4c/d21/d55/f74 zero size 2024-04-25T23:01:07.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/523: creat d1b/d23/d7a/fa3 x:0 0 0 2024-04-25T23:01:07.801 INFO:tasks.workunit.client.0.smithi043.stdout:4/600: dwrite d3/d21/f64 [0,4194304] 0 2024-04-25T23:01:07.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/524: readlink d1b/d42/l69 0 2024-04-25T23:01:07.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/632: creat d7/d26/d59/d7c/db2/fda x:0 0 0 2024-04-25T23:01:07.803 INFO:tasks.workunit.client.0.smithi043.stdout:5/582: truncate d0/d2c/d39/d1c/d25/fa2 4213597 0 2024-04-25T23:01:07.805 INFO:tasks.workunit.client.0.smithi043.stdout:4/601: creat d3/de/d27/d45/fcf x:0 0 0 2024-04-25T23:01:07.805 INFO:tasks.workunit.client.0.smithi043.stdout:3/633: rename d7/d26/d59/d7c/db2/l6d to d7/d26/d88/db0/ldb 0 2024-04-25T23:01:07.805 INFO:tasks.workunit.client.0.smithi043.stdout:0/525: creat d1b/fa4 x:0 0 0 2024-04-25T23:01:07.805 INFO:tasks.workunit.client.0.smithi043.stdout:5/583: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2 0 2024-04-25T23:01:07.806 INFO:tasks.workunit.client.0.smithi043.stdout:4/602: creat d3/de/d46/d6a/fd0 x:0 0 0 2024-04-25T23:01:07.806 INFO:tasks.workunit.client.0.smithi043.stdout:3/634: creat d7/d26/fdc x:0 0 0 2024-04-25T23:01:07.808 INFO:tasks.workunit.client.0.smithi043.stdout:7/553: dwrite d3/da/f44 [0,4194304] 0 2024-04-25T23:01:07.809 INFO:tasks.workunit.client.0.smithi043.stdout:4/603: mknod d3/de/cd1 0 2024-04-25T23:01:07.809 INFO:tasks.workunit.client.0.smithi043.stdout:6/534: truncate d1/d5/f1d 3569681 0 2024-04-25T23:01:07.809 INFO:tasks.workunit.client.0.smithi043.stdout:3/635: unlink d7/d26/d27/d34/d1a/d40/d8f/d51/fc8 0 2024-04-25T23:01:07.809 INFO:tasks.workunit.client.0.smithi043.stdout:0/526: read d1b/d23/d39/f44 [2097664,120910] 0 2024-04-25T23:01:07.809 INFO:tasks.workunit.client.0.smithi043.stdout:5/584: link d0/d2c/d39/d1c/d25/d7a/f6f d0/d22/d95/fc3 0 2024-04-25T23:01:07.810 INFO:tasks.workunit.client.0.smithi043.stdout:4/604: write d3/d19/f5a [4499612,46846] 0 2024-04-25T23:01:07.810 INFO:tasks.workunit.client.0.smithi043.stdout:3/636: truncate d7/d26/d59/f71 564679 0 2024-04-25T23:01:07.811 INFO:tasks.workunit.client.0.smithi043.stdout:0/527: mknod d1b/d7f/ca5 0 2024-04-25T23:01:07.811 INFO:tasks.workunit.client.0.smithi043.stdout:0/528: chown d1b 2668 1 2024-04-25T23:01:07.812 INFO:tasks.workunit.client.0.smithi043.stdout:4/605: creat d3/de/d46/d6a/fd2 x:0 0 0 2024-04-25T23:01:07.813 INFO:tasks.workunit.client.0.smithi043.stdout:3/637: fsync d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f9a 0 2024-04-25T23:01:07.813 INFO:tasks.workunit.client.0.smithi043.stdout:0/529: mkdir d1b/d23/d7b/da6 0 2024-04-25T23:01:07.817 INFO:tasks.workunit.client.0.smithi043.stdout:9/559: dread d8/de/d12/d15/f17 [0,4194304] 0 2024-04-25T23:01:07.818 INFO:tasks.workunit.client.0.smithi043.stdout:3/638: sync 2024-04-25T23:01:07.818 INFO:tasks.workunit.client.0.smithi043.stdout:3/639: chown d7/d26/d97 806103614 1 2024-04-25T23:01:07.819 INFO:tasks.workunit.client.0.smithi043.stdout:3/640: mknod d7/d26/d27/d34/d1a/d40/cdd 0 2024-04-25T23:01:07.820 INFO:tasks.workunit.client.0.smithi043.stdout:4/606: dwrite d3/d37/d4d/fc5 [0,4194304] 0 2024-04-25T23:01:07.821 INFO:tasks.workunit.client.0.smithi043.stdout:4/607: chown d3/d21/f3d 305 1 2024-04-25T23:01:07.822 INFO:tasks.workunit.client.0.smithi043.stdout:4/608: readlink d3/d19/l86 0 2024-04-25T23:01:07.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/530: truncate d1b/d23/d39/f4b 1286930 0 2024-04-25T23:01:07.824 INFO:tasks.workunit.client.0.smithi043.stdout:0/531: chown d1b/d42/l69 0 1 2024-04-25T23:01:07.825 INFO:tasks.workunit.client.0.smithi043.stdout:9/560: dwrite d8/de/f10 [0,4194304] 0 2024-04-25T23:01:07.826 INFO:tasks.workunit.client.0.smithi043.stdout:3/641: dwrite d7/d26/d27/d34/f35 [0,4194304] 0 2024-04-25T23:01:07.828 INFO:tasks.workunit.client.0.smithi043.stdout:8/441: dread d3/d4/db/d14/d4c/d77/f27 [0,4194304] 0 2024-04-25T23:01:07.829 INFO:tasks.workunit.client.0.smithi043.stdout:7/554: dread d3/da/df/d79/f82 [0,4194304] 0 2024-04-25T23:01:07.829 INFO:tasks.workunit.client.0.smithi043.stdout:0/532: mknod d1b/d55/ca7 0 2024-04-25T23:01:07.829 INFO:tasks.workunit.client.0.smithi043.stdout:7/555: chown d3 417937 1 2024-04-25T23:01:07.829 INFO:tasks.workunit.client.0.smithi043.stdout:3/642: creat d7/d26/d27/fde x:0 0 0 2024-04-25T23:01:07.830 INFO:tasks.workunit.client.0.smithi043.stdout:8/442: fdatasync d3/d4/db/d4e/d5c/d2e/f46 0 2024-04-25T23:01:07.831 INFO:tasks.workunit.client.0.smithi043.stdout:9/561: link d8/de/d12/d16/d24/f62 d8/de/d44/fc0 0 2024-04-25T23:01:07.831 INFO:tasks.workunit.client.0.smithi043.stdout:7/556: write d3/d1e/d1f/d6b/d72/f77 [2385796,46606] 0 2024-04-25T23:01:07.831 INFO:tasks.workunit.client.0.smithi043.stdout:3/643: write d7/d26/d27/d34/d1a/f50 [4342629,95292] 0 2024-04-25T23:01:07.831 INFO:tasks.workunit.client.0.smithi043.stdout:0/533: creat d1b/d8b/da2/fa8 x:0 0 0 2024-04-25T23:01:07.832 INFO:tasks.workunit.client.0.smithi043.stdout:7/557: fsync d3/f68 0 2024-04-25T23:01:07.832 INFO:tasks.workunit.client.0.smithi043.stdout:8/443: mknod d3/d4/db/d14/c8e 0 2024-04-25T23:01:07.832 INFO:tasks.workunit.client.0.smithi043.stdout:3/644: stat d7/d26/d27/d34/ld8 0 2024-04-25T23:01:07.833 INFO:tasks.workunit.client.0.smithi043.stdout:7/558: unlink d3/f5 0 2024-04-25T23:01:07.833 INFO:tasks.workunit.client.0.smithi043.stdout:8/444: symlink d3/d4/d7c/l8f 0 2024-04-25T23:01:07.833 INFO:tasks.workunit.client.0.smithi043.stdout:1/518: dread d0/d9/f25 [0,4194304] 0 2024-04-25T23:01:07.834 INFO:tasks.workunit.client.0.smithi043.stdout:1/519: sync 2024-04-25T23:01:07.834 INFO:tasks.workunit.client.0.smithi043.stdout:7/559: creat d3/da/df/d11/d8d/d9f/fab x:0 0 0 2024-04-25T23:01:07.834 INFO:tasks.workunit.client.0.smithi043.stdout:8/445: mknod d3/d4/db/df/d10/d8d/c90 0 2024-04-25T23:01:07.835 INFO:tasks.workunit.client.0.smithi043.stdout:5/585: read d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fb3 [1783255,54796] 0 2024-04-25T23:01:07.835 INFO:tasks.workunit.client.0.smithi043.stdout:7/560: fsync d3/d1e/d1f/d6b/d72/f97 0 2024-04-25T23:01:07.836 INFO:tasks.workunit.client.0.smithi043.stdout:3/645: link d7/d26/d59/d7c/db2/d52/fc9 d7/d26/d59/d7c/fdf 0 2024-04-25T23:01:07.836 INFO:tasks.workunit.client.0.smithi043.stdout:8/446: chown d3/d4/db/df/d10/c8c 61840500 1 2024-04-25T23:01:07.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/561: chown d3/d1e/d1f 1 1 2024-04-25T23:01:07.836 INFO:tasks.workunit.client.0.smithi043.stdout:5/586: write d0/f35 [993320,94671] 0 2024-04-25T23:01:07.836 INFO:tasks.workunit.client.0.smithi043.stdout:1/520: getdents d0/d2f/d4b/da6 0 2024-04-25T23:01:07.837 INFO:tasks.workunit.client.0.smithi043.stdout:7/562: fsync d3/da/d78/fa9 0 2024-04-25T23:01:07.837 INFO:tasks.workunit.client.0.smithi043.stdout:1/521: mkdir d0/d16/d5a/d5b/da4/dbf 0 2024-04-25T23:01:07.838 INFO:tasks.workunit.client.0.smithi043.stdout:7/563: write d3/da/df/f3f [2260913,25521] 0 2024-04-25T23:01:07.838 INFO:tasks.workunit.client.0.smithi043.stdout:7/564: sync 2024-04-25T23:01:07.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/534: dwrite d1b/d31/d3c/d50/f9b [0,4194304] 0 2024-04-25T23:01:07.840 INFO:tasks.workunit.client.0.smithi043.stdout:1/522: write d0/d2f/d4b/d8f/fb1 [881248,1329] 0 2024-04-25T23:01:07.841 INFO:tasks.workunit.client.0.smithi043.stdout:1/523: chown d0/d16/d5a/d5b/da4/f81 24 1 2024-04-25T23:01:07.842 INFO:tasks.workunit.client.0.smithi043.stdout:5/587: mkdir d0/d2c/d39/dc4 0 2024-04-25T23:01:07.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/565: symlink d3/d1e/d1f/d6b/lac 0 2024-04-25T23:01:07.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/566: sync 2024-04-25T23:01:07.843 INFO:tasks.workunit.client.0.smithi043.stdout:3/646: dwrite d7/d26/d27/d34/d1a/d28/f29 [0,4194304] 0 2024-04-25T23:01:07.843 INFO:tasks.workunit.client.0.smithi043.stdout:1/524: mkdir d0/d9/dc0 0 2024-04-25T23:01:07.843 INFO:tasks.workunit.client.0.smithi043.stdout:1/525: fdatasync d0/d3c/f62 0 2024-04-25T23:01:07.845 INFO:tasks.workunit.client.0.smithi043.stdout:7/567: write d3/da/d64/fa3 [420889,72943] 0 2024-04-25T23:01:07.845 INFO:tasks.workunit.client.0.smithi043.stdout:7/568: dread - d3/da/d78/fa9 zero size 2024-04-25T23:01:07.847 INFO:tasks.workunit.client.0.smithi043.stdout:9/562: truncate d8/de/d44/d5d/d4f/f73 1725467 0 2024-04-25T23:01:07.848 INFO:tasks.workunit.client.0.smithi043.stdout:3/647: mknod d7/d26/d27/d34/ce0 0 2024-04-25T23:01:07.849 INFO:tasks.workunit.client.0.smithi043.stdout:9/563: write d8/de/d44/d47/d6a/f9e [303830,77950] 0 2024-04-25T23:01:07.849 INFO:tasks.workunit.client.0.smithi043.stdout:5/588: getdents d0/d2c 0 2024-04-25T23:01:07.849 INFO:tasks.workunit.client.0.smithi043.stdout:7/569: creat d3/fad x:0 0 0 2024-04-25T23:01:07.851 INFO:tasks.workunit.client.0.smithi043.stdout:1/526: dwrite d0/d16/f4a [0,4194304] 0 2024-04-25T23:01:07.852 INFO:tasks.workunit.client.0.smithi043.stdout:0/535: truncate d1b/d23/f3d 1891921 0 2024-04-25T23:01:07.853 INFO:tasks.workunit.client.0.smithi043.stdout:9/564: creat d8/fc1 x:0 0 0 2024-04-25T23:01:07.854 INFO:tasks.workunit.client.0.smithi043.stdout:7/570: mknod d3/da/df/d11/d8d/d9f/cae 0 2024-04-25T23:01:07.854 INFO:tasks.workunit.client.0.smithi043.stdout:6/535: dread d1/d5/d3b/d4c/d1a/f54 [0,4194304] 0 2024-04-25T23:01:07.854 INFO:tasks.workunit.client.0.smithi043.stdout:3/648: rename d7/d26/d27/d56 to d7/d26/d27/d34/d1a/d40/d8f/d51/de1 0 2024-04-25T23:01:07.854 INFO:tasks.workunit.client.0.smithi043.stdout:1/527: write d0/d86/fa0 [45117,6694] 0 2024-04-25T23:01:07.855 INFO:tasks.workunit.client.0.smithi043.stdout:0/536: mknod d1b/d8b/d7d/ca9 0 2024-04-25T23:01:07.855 INFO:tasks.workunit.client.0.smithi043.stdout:9/565: chown d8/de/d12/d16/d24/f98 171210660 1 2024-04-25T23:01:07.855 INFO:tasks.workunit.client.0.smithi043.stdout:0/537: sync 2024-04-25T23:01:07.855 INFO:tasks.workunit.client.0.smithi043.stdout:0/538: readlink d1b/l32 0 2024-04-25T23:01:07.856 INFO:tasks.workunit.client.0.smithi043.stdout:9/566: rmdir d8/de/d44/d47 39 2024-04-25T23:01:07.856 INFO:tasks.workunit.client.0.smithi043.stdout:1/528: write d0/d9/f25 [3491556,126054] 0 2024-04-25T23:01:07.856 INFO:tasks.workunit.client.0.smithi043.stdout:6/536: unlink d1/d5/d3b/d4c/d21/d55/d68/l18 0 2024-04-25T23:01:07.857 INFO:tasks.workunit.client.0.smithi043.stdout:5/589: truncate d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 308854 0 2024-04-25T23:01:07.857 INFO:tasks.workunit.client.0.smithi043.stdout:3/649: creat d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe2 x:0 0 0 2024-04-25T23:01:07.857 INFO:tasks.workunit.client.0.smithi043.stdout:7/571: rename d3/da/df/d11/l90 to d3/da/df/d11/d26/laf 0 2024-04-25T23:01:07.858 INFO:tasks.workunit.client.0.smithi043.stdout:6/537: chown d1/d5/d3b/d4c/d21/d55/d68/d7f 2 1 2024-04-25T23:01:07.858 INFO:tasks.workunit.client.0.smithi043.stdout:3/650: creat d7/d26/d88/db0/fe3 x:0 0 0 2024-04-25T23:01:07.858 INFO:tasks.workunit.client.0.smithi043.stdout:7/572: symlink d3/d9b/da8/lb0 0 2024-04-25T23:01:07.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/590: chown d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62 4 1 2024-04-25T23:01:07.858 INFO:tasks.workunit.client.0.smithi043.stdout:9/567: symlink d8/de/d44/d47/d6a/lc2 0 2024-04-25T23:01:07.859 INFO:tasks.workunit.client.0.smithi043.stdout:0/539: rename d1b/d42/f5b to d1b/faa 0 2024-04-25T23:01:07.859 INFO:tasks.workunit.client.0.smithi043.stdout:7/573: write d3/d9b/d63/d98/f9a [693165,90043] 0 2024-04-25T23:01:07.860 INFO:tasks.workunit.client.0.smithi043.stdout:8/447: dread d3/d4/db/d14/f19 [0,4194304] 0 2024-04-25T23:01:07.860 INFO:tasks.workunit.client.0.smithi043.stdout:8/448: sync 2024-04-25T23:01:07.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/591: creat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fc5 x:0 0 0 2024-04-25T23:01:07.860 INFO:tasks.workunit.client.0.smithi043.stdout:9/568: mkdir d8/de/d12/d15/d2f/da6/dc3 0 2024-04-25T23:01:07.860 INFO:tasks.workunit.client.0.smithi043.stdout:1/529: rename d0/d16/c52 to d0/d2f/cc1 0 2024-04-25T23:01:07.861 INFO:tasks.workunit.client.0.smithi043.stdout:3/651: creat d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe4 x:0 0 0 2024-04-25T23:01:07.861 INFO:tasks.workunit.client.0.smithi043.stdout:7/574: write d3/d9b/f4a [240410,61428] 0 2024-04-25T23:01:07.861 INFO:tasks.workunit.client.0.smithi043.stdout:1/530: readlink d0/d9/lb3 0 2024-04-25T23:01:07.861 INFO:tasks.workunit.client.0.smithi043.stdout:9/569: chown d8/de/f3e 36 1 2024-04-25T23:01:07.862 INFO:tasks.workunit.client.0.smithi043.stdout:7/575: chown d3/da/df/c76 5 1 2024-04-25T23:01:07.862 INFO:tasks.workunit.client.0.smithi043.stdout:3/652: creat d7/d26/d2d/dab/fe5 x:0 0 0 2024-04-25T23:01:07.862 INFO:tasks.workunit.client.0.smithi043.stdout:5/592: symlink d0/d2c/d39/d1c/d25/d7a/lc6 0 2024-04-25T23:01:07.862 INFO:tasks.workunit.client.0.smithi043.stdout:8/449: getdents d3/d4/d36 0 2024-04-25T23:01:07.862 INFO:tasks.workunit.client.0.smithi043.stdout:3/653: stat d7/d26/f95 0 2024-04-25T23:01:07.863 INFO:tasks.workunit.client.0.smithi043.stdout:9/570: creat d8/de/d12/d15/d68/fc4 x:0 0 0 2024-04-25T23:01:07.863 INFO:tasks.workunit.client.0.smithi043.stdout:1/531: creat d0/d16/d5a/d5b/da4/dbf/fc2 x:0 0 0 2024-04-25T23:01:07.863 INFO:tasks.workunit.client.0.smithi043.stdout:8/450: mkdir d3/d4/db/d4e/d8b/d91 0 2024-04-25T23:01:07.863 INFO:tasks.workunit.client.0.smithi043.stdout:1/532: symlink d0/lc3 0 2024-04-25T23:01:07.864 INFO:tasks.workunit.client.0.smithi043.stdout:9/571: creat d8/de/d12/d16/fc5 x:0 0 0 2024-04-25T23:01:07.865 INFO:tasks.workunit.client.0.smithi043.stdout:3/654: symlink d7/d26/d27/d34/d1a/d40/d8f/le6 0 2024-04-25T23:01:07.865 INFO:tasks.workunit.client.0.smithi043.stdout:8/451: write d3/d4/f25 [3309700,10170] 0 2024-04-25T23:01:07.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/533: creat d0/d86/daa/fc4 x:0 0 0 2024-04-25T23:01:07.866 INFO:tasks.workunit.client.0.smithi043.stdout:0/540: getdents d1b 0 2024-04-25T23:01:07.867 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:07.864+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:07.868 INFO:tasks.workunit.client.0.smithi043.stdout:2/450: dread d2/d66/d85/d43/d67/f86 [0,4194304] 0 2024-04-25T23:01:07.869 INFO:tasks.workunit.client.0.smithi043.stdout:7/576: rmdir d3/da/df/d11/d8d/d9f 39 2024-04-25T23:01:07.869 INFO:tasks.workunit.client.0.smithi043.stdout:8/452: rename d3/d4/db/df to d3/d4/d7c/d92 0 2024-04-25T23:01:07.870 INFO:tasks.workunit.client.0.smithi043.stdout:4/609: dread d3/d21/f30 [0,4194304] 0 2024-04-25T23:01:07.870 INFO:tasks.workunit.client.0.smithi043.stdout:3/655: rename d7/d26/d59/fa2 to d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/fe7 0 2024-04-25T23:01:07.870 INFO:tasks.workunit.client.0.smithi043.stdout:5/593: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/faa [0,4194304] 0 2024-04-25T23:01:07.871 INFO:tasks.workunit.client.0.smithi043.stdout:4/610: fdatasync d3/f41 0 2024-04-25T23:01:07.873 INFO:tasks.workunit.client.0.smithi043.stdout:3/656: creat d7/d26/d59/d7c/db2/d87/fe8 x:0 0 0 2024-04-25T23:01:07.873 INFO:tasks.workunit.client.0.smithi043.stdout:7/577: rename d3/d1e/c5a to d3/da/df/cb1 0 2024-04-25T23:01:07.874 INFO:tasks.workunit.client.0.smithi043.stdout:4/611: mkdir d3/d21/d6b/d87/d9a/dd3 0 2024-04-25T23:01:07.874 INFO:tasks.workunit.client.0.smithi043.stdout:5/594: write d0/d2c/d39/f34 [4157671,103462] 0 2024-04-25T23:01:07.876 INFO:tasks.workunit.client.0.smithi043.stdout:4/612: read - d3/d21/d6b/d87/fb1 zero size 2024-04-25T23:01:07.876 INFO:tasks.workunit.client.0.smithi043.stdout:7/578: rename d3/f68 to d3/d52/fb2 0 2024-04-25T23:01:07.876 INFO:tasks.workunit.client.0.smithi043.stdout:5/595: fdatasync d0/d2c/f6b 0 2024-04-25T23:01:07.877 INFO:tasks.workunit.client.0.smithi043.stdout:3/657: creat d7/d26/d27/d34/d1a/fe9 x:0 0 0 2024-04-25T23:01:07.877 INFO:tasks.workunit.client.0.smithi043.stdout:0/541: dwrite d1b/d23/f2a [0,4194304] 0 2024-04-25T23:01:07.879 INFO:tasks.workunit.client.0.smithi043.stdout:2/451: dwrite d2/d3/d13/f6e [0,4194304] 0 2024-04-25T23:01:07.879 INFO:tasks.workunit.client.0.smithi043.stdout:8/453: dread d3/d4/db/d14/d56/d5d/f63 [0,4194304] 0 2024-04-25T23:01:07.879 INFO:tasks.workunit.client.0.smithi043.stdout:3/658: rmdir d7/d26/d27/d34/d1a 39 2024-04-25T23:01:07.880 INFO:tasks.workunit.client.0.smithi043.stdout:2/452: stat d2/d3/d13/d18/c25 0 2024-04-25T23:01:07.881 INFO:tasks.workunit.client.0.smithi043.stdout:2/453: creat d2/d66/d85/d43/d5d/f89 x:0 0 0 2024-04-25T23:01:07.882 INFO:tasks.workunit.client.0.smithi043.stdout:8/454: link d3/d4/db/d14/d4c/d77/l3d d3/d4/db/d14/d4c/l93 0 2024-04-25T23:01:07.884 INFO:tasks.workunit.client.0.smithi043.stdout:8/455: dread - d3/d4/db/d4e/f80 zero size 2024-04-25T23:01:07.884 INFO:tasks.workunit.client.0.smithi043.stdout:2/454: creat d2/d66/d85/d43/f8a x:0 0 0 2024-04-25T23:01:07.886 INFO:tasks.workunit.client.0.smithi043.stdout:1/534: dread d0/d2f/d4b/d8f/fb1 [0,4194304] 0 2024-04-25T23:01:07.887 INFO:tasks.workunit.client.0.smithi043.stdout:2/455: rmdir d2/d66/d85/d43/d67 39 2024-04-25T23:01:07.887 INFO:tasks.workunit.client.0.smithi043.stdout:8/456: mknod d3/d4/d7c/d92/d10/c94 0 2024-04-25T23:01:07.888 INFO:tasks.workunit.client.0.smithi043.stdout:7/579: read d3/d1e/d1f/f7c [7769,29593] 0 2024-04-25T23:01:07.888 INFO:tasks.workunit.client.0.smithi043.stdout:5/596: dwrite d0/d2c/d39/d1c/d25/d7a/fb5 [0,4194304] 0 2024-04-25T23:01:07.889 INFO:tasks.workunit.client.0.smithi043.stdout:2/456: stat d2/d3/f34 0 2024-04-25T23:01:07.889 INFO:tasks.workunit.client.0.smithi043.stdout:1/535: write d0/d3d/d4f/f64 [200657,4369] 0 2024-04-25T23:01:07.890 INFO:tasks.workunit.client.0.smithi043.stdout:4/613: dwrite d3/de/d46/d6a/d8f/f5e [4194304,4194304] 0 2024-04-25T23:01:07.891 INFO:tasks.workunit.client.0.smithi043.stdout:3/659: dwrite d7/d26/d27/d34/fb6 [0,4194304] 0 2024-04-25T23:01:07.892 INFO:tasks.workunit.client.0.smithi043.stdout:0/542: dwrite d1b/d8b/f9c [0,4194304] 0 2024-04-25T23:01:07.893 INFO:tasks.workunit.client.0.smithi043.stdout:2/457: rmdir d2/d66/d85/d76 39 2024-04-25T23:01:07.894 INFO:tasks.workunit.client.0.smithi043.stdout:6/538: dread d1/d5/d3b/d62/f69 [0,4194304] 0 2024-04-25T23:01:07.895 INFO:tasks.workunit.client.0.smithi043.stdout:7/580: mknod d3/cb3 0 2024-04-25T23:01:07.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/614: creat d3/de/d46/d6a/fd4 x:0 0 0 2024-04-25T23:01:07.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/539: creat d1/d5/d3b/db6/fb8 x:0 0 0 2024-04-25T23:01:07.896 INFO:tasks.workunit.client.0.smithi043.stdout:5/597: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/fc7 x:0 0 0 2024-04-25T23:01:07.896 INFO:tasks.workunit.client.0.smithi043.stdout:0/543: mkdir d1b/d23/dab 0 2024-04-25T23:01:07.896 INFO:tasks.workunit.client.0.smithi043.stdout:3/660: rename d7/d26/d27/d34/ce0 to d7/d26/d59/d7c/db2/d52/cea 0 2024-04-25T23:01:07.896 INFO:tasks.workunit.client.0.smithi043.stdout:0/544: read - d1b/d42/f88 zero size 2024-04-25T23:01:07.897 INFO:tasks.workunit.client.0.smithi043.stdout:4/615: write d3/de/d27/d45/fa0 [143137,1985] 0 2024-04-25T23:01:07.897 INFO:tasks.workunit.client.0.smithi043.stdout:2/458: symlink d2/d66/d85/d43/d5d/l8b 0 2024-04-25T23:01:07.897 INFO:tasks.workunit.client.0.smithi043.stdout:7/581: read d3/d96/f8a [601437,121246] 0 2024-04-25T23:01:07.898 INFO:tasks.workunit.client.0.smithi043.stdout:1/536: mknod d0/d16/d5a/d5b/cc5 0 2024-04-25T23:01:07.899 INFO:tasks.workunit.client.0.smithi043.stdout:7/582: creat d3/d9b/fb4 x:0 0 0 2024-04-25T23:01:07.899 INFO:tasks.workunit.client.0.smithi043.stdout:1/537: mknod d0/d16/cc6 0 2024-04-25T23:01:07.899 INFO:tasks.workunit.client.0.smithi043.stdout:6/540: rename d1/d5/d3b/c43 to d1/d5/d3b/d4c/cb9 0 2024-04-25T23:01:07.899 INFO:tasks.workunit.client.0.smithi043.stdout:2/459: write d2/d66/d85/d43/d67/f86 [4656840,538] 0 2024-04-25T23:01:07.900 INFO:tasks.workunit.client.0.smithi043.stdout:7/583: readlink d3/da/df/d11/l40 0 2024-04-25T23:01:07.900 INFO:tasks.workunit.client.0.smithi043.stdout:1/538: link d0/d9/lb3 d0/d3c/lc7 0 2024-04-25T23:01:07.901 INFO:tasks.workunit.client.0.smithi043.stdout:6/541: creat d1/d5/d3b/d4c/d21/d55/fba x:0 0 0 2024-04-25T23:01:07.902 INFO:tasks.workunit.client.0.smithi043.stdout:6/542: write d1/d5/d3b/d4c/d21/d46/f51 [350375,76962] 0 2024-04-25T23:01:07.903 INFO:tasks.workunit.client.0.smithi043.stdout:6/543: chown d1/d5/d3b/d4c/d21/d55/d68/cb0 500914 1 2024-04-25T23:01:07.904 INFO:tasks.workunit.client.0.smithi043.stdout:7/584: read d3/d1e/f39 [161219,101422] 0 2024-04-25T23:01:07.907 INFO:tasks.workunit.client.0.smithi043.stdout:6/544: creat d1/d5/d3b/d4c/d21/d55/d6d/d91/fbb x:0 0 0 2024-04-25T23:01:07.907 INFO:tasks.workunit.client.0.smithi043.stdout:9/572: dread d8/de/d44/f45 [0,4194304] 0 2024-04-25T23:01:07.908 INFO:tasks.workunit.client.0.smithi043.stdout:8/457: dwrite d3/d4/db/d14/d4c/d68/f7a [0,4194304] 0 2024-04-25T23:01:07.908 INFO:tasks.workunit.client.0.smithi043.stdout:4/616: dwrite d3/d37/d7a/f9c [0,4194304] 0 2024-04-25T23:01:07.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/460: dwrite d2/d3/d22/f35 [0,4194304] 0 2024-04-25T23:01:07.909 INFO:tasks.workunit.client.0.smithi043.stdout:9/573: chown d8/de/d12/d15/d2f/d84/d31/fb9 0 1 2024-04-25T23:01:07.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/461: fsync d2/d3/f34 0 2024-04-25T23:01:07.909 INFO:tasks.workunit.client.0.smithi043.stdout:6/545: mkdir d1/d5/d3b/d4c/d21/d55/d6d/dbc 0 2024-04-25T23:01:07.910 INFO:tasks.workunit.client.0.smithi043.stdout:6/546: chown d1/d5/c8d 243 1 2024-04-25T23:01:07.910 INFO:tasks.workunit.client.0.smithi043.stdout:4/617: symlink d3/de/d27/d5c/ld5 0 2024-04-25T23:01:07.912 INFO:tasks.workunit.client.0.smithi043.stdout:9/574: rename d8/de/d12/d15 to d8/de/d12/d16/d24/dbe/dc6 0 2024-04-25T23:01:07.912 INFO:tasks.workunit.client.0.smithi043.stdout:2/462: creat d2/d66/d85/d43/f8c x:0 0 0 2024-04-25T23:01:07.913 INFO:tasks.workunit.client.0.smithi043.stdout:4/618: symlink d3/de/ld6 0 2024-04-25T23:01:07.913 INFO:tasks.workunit.client.0.smithi043.stdout:8/458: link d3/d4/d7c/d92/d62/d6e/c85 d3/d4/d7c/d92/d10/c95 0 2024-04-25T23:01:07.913 INFO:tasks.workunit.client.0.smithi043.stdout:6/547: rmdir d1/d5/d3b/d4c/d21/d55/d6d/dbc 0 2024-04-25T23:01:07.914 INFO:tasks.workunit.client.0.smithi043.stdout:2/463: rename d2/d3/d13/d18 to d2/d66/d85/d43/d67/d8d 0 2024-04-25T23:01:07.914 INFO:tasks.workunit.client.0.smithi043.stdout:4/619: mknod d3/de/d46/d95/cd7 0 2024-04-25T23:01:07.915 INFO:tasks.workunit.client.0.smithi043.stdout:6/548: chown d1/d5/d3b/d4c/d1a/f27 30279 1 2024-04-25T23:01:07.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/620: write d3/d21/d6b/fc0 [178320,30662] 0 2024-04-25T23:01:07.916 INFO:tasks.workunit.client.0.smithi043.stdout:9/575: rename d8/de/d12/d16/d24/dbe/dc6/d68/f8f to d8/de/d44/d5d/fc7 0 2024-04-25T23:01:07.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/621: chown d3/de/l89 9998235 1 2024-04-25T23:01:07.916 INFO:tasks.workunit.client.0.smithi043.stdout:3/661: dread d7/d26/d27/d34/d1a/d28/f4c [0,4194304] 0 2024-04-25T23:01:07.916 INFO:tasks.workunit.client.0.smithi043.stdout:6/549: mknod d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/cbd 0 2024-04-25T23:01:07.917 INFO:tasks.workunit.client.0.smithi043.stdout:4/622: creat d3/d21/fd8 x:0 0 0 2024-04-25T23:01:07.920 INFO:tasks.workunit.client.0.smithi043.stdout:5/598: dwrite d0/d2c/f4c [0,4194304] 0 2024-04-25T23:01:07.921 INFO:tasks.workunit.client.0.smithi043.stdout:3/662: dread d7/d26/d59/f7a [0,4194304] 0 2024-04-25T23:01:07.922 INFO:tasks.workunit.client.0.smithi043.stdout:7/585: sync 2024-04-25T23:01:07.922 INFO:tasks.workunit.client.0.smithi043.stdout:1/539: sync 2024-04-25T23:01:07.923 INFO:tasks.workunit.client.0.smithi043.stdout:7/586: fdatasync d3/da/d78/fa9 0 2024-04-25T23:01:07.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/623: dwrite d3/d21/f2e [0,4194304] 0 2024-04-25T23:01:07.925 INFO:tasks.workunit.client.0.smithi043.stdout:6/550: dwrite d1/d5/d3b/d4c/d21/d55/d6d/fa1 [0,4194304] 0 2024-04-25T23:01:07.927 INFO:tasks.workunit.client.0.smithi043.stdout:9/576: read d8/de/d12/d16/f1f [1309850,29099] 0 2024-04-25T23:01:07.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-04-25T23:01:07.928 INFO:tasks.workunit.client.0.smithi043.stdout:0/545: write d1b/d31/d3c/f7c [1012055,75764] 0 2024-04-25T23:01:07.929 INFO:tasks.workunit.client.0.smithi043.stdout:5/599: symlink d0/d2c/d39/dc4/lc8 0 2024-04-25T23:01:07.929 INFO:tasks.workunit.client.0.smithi043.stdout:1/540: rename d0/d16/lbc to d0/d9/dc0/lc8 0 2024-04-25T23:01:07.929 INFO:tasks.workunit.client.0.smithi043.stdout:6/551: symlink d1/d5/lbe 0 2024-04-25T23:01:07.929 INFO:tasks.workunit.client.0.smithi043.stdout:9/577: rmdir d8/de/d12/d7a 39 2024-04-25T23:01:07.929 INFO:tasks.workunit.client.0.smithi043.stdout:1/541: chown d0/d3c/f79 12997857 1 2024-04-25T23:01:07.930 INFO:tasks.workunit.client.0.smithi043.stdout:0/546: chown d1b/d31/f8a 2 1 2024-04-25T23:01:07.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/624: symlink d3/de/d27/d45/dc7/dc8/ld9 0 2024-04-25T23:01:07.930 INFO:tasks.workunit.client.0.smithi043.stdout:5/600: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/dc9 0 2024-04-25T23:01:07.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/625: fsync d3/d21/f64 0 2024-04-25T23:01:07.931 INFO:tasks.workunit.client.0.smithi043.stdout:1/542: symlink d0/d2f/d4b/da6/lc9 0 2024-04-25T23:01:07.932 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:07.928+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:07.932 INFO:tasks.workunit.client.0.smithi043.stdout:3/663: getdents d7/d26/d27/d34/d1a/d40/d8f 0 2024-04-25T23:01:07.932 INFO:tasks.workunit.client.0.smithi043.stdout:9/578: link d8/f59 d8/de/d44/d65/fc8 0 2024-04-25T23:01:07.932 INFO:tasks.workunit.client.0.smithi043.stdout:6/552: write d1/d5/d3b/d4c/f28 [3377233,36408] 0 2024-04-25T23:01:07.933 INFO:tasks.workunit.client.0.smithi043.stdout:5/601: rename d0/d2c/f4c to d0/d2c/d39/dc4/fca 0 2024-04-25T23:01:07.933 INFO:tasks.workunit.client.0.smithi043.stdout:0/547: link d1b/d23/d7a/c84 d1b/d8b/cac 0 2024-04-25T23:01:07.933 INFO:tasks.workunit.client.0.smithi043.stdout:1/543: readlink d0/d16/l4c 0 2024-04-25T23:01:07.933 INFO:tasks.workunit.client.0.smithi043.stdout:6/553: chown d1/d5/d3b/d4c/d21/d55/c82 7882247 1 2024-04-25T23:01:07.933 INFO:tasks.workunit.client.0.smithi043.stdout:1/544: chown d0/d2f/d4b/f75 262170776 1 2024-04-25T23:01:07.934 INFO:tasks.workunit.client.0.smithi043.stdout:6/554: write d1/d5/d3b/d4c/d21/d38/f59 [200343,41686] 0 2024-04-25T23:01:07.935 INFO:tasks.workunit.client.0.smithi043.stdout:9/579: unlink d8/de/d12/d16/d24/dbe/dc6/d2f/d84/la7 0 2024-04-25T23:01:07.936 INFO:tasks.workunit.client.0.smithi043.stdout:9/580: dread - d8/f89 zero size 2024-04-25T23:01:07.936 INFO:tasks.workunit.client.0.smithi043.stdout:6/555: rename d1/d5/d3b/d4c/d21/d46 to d1/d5/d3b/d4c/d21/d55/d68/d30/dbf 0 2024-04-25T23:01:07.937 INFO:tasks.workunit.client.0.smithi043.stdout:9/581: mkdir d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9 0 2024-04-25T23:01:07.939 INFO:tasks.workunit.client.0.smithi043.stdout:6/556: rename d1/d5/d3b/d4c/d21/d55/d6d/f70 to d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fc0 0 2024-04-25T23:01:07.940 INFO:tasks.workunit.client.0.smithi043.stdout:3/664: dwrite d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe2 [0,4194304] 0 2024-04-25T23:01:07.941 INFO:tasks.workunit.client.0.smithi043.stdout:4/626: sync 2024-04-25T23:01:07.942 INFO:tasks.workunit.client.0.smithi043.stdout:1/545: dwrite d0/d9/fae [0,4194304] 0 2024-04-25T23:01:07.942 INFO:tasks.workunit.client.0.smithi043.stdout:4/627: write d3/d21/d6b/d87/fb4 [408042,62165] 0 2024-04-25T23:01:07.944 INFO:tasks.workunit.client.0.smithi043.stdout:3/665: symlink d7/d26/d27/d34/d1a/d28/d9e/leb 0 2024-04-25T23:01:07.945 INFO:tasks.workunit.client.0.smithi043.stdout:8/459: truncate d3/d4/db/d14/d3e/f43 2392532 0 2024-04-25T23:01:07.945 INFO:tasks.workunit.client.0.smithi043.stdout:2/464: truncate d2/d3/d22/f39 167793 0 2024-04-25T23:01:07.946 INFO:tasks.workunit.client.0.smithi043.stdout:1/546: creat d0/d2f/d4b/da6/fca x:0 0 0 2024-04-25T23:01:07.946 INFO:tasks.workunit.client.0.smithi043.stdout:3/666: creat d7/d26/d59/d7c/db2/d87/fec x:0 0 0 2024-04-25T23:01:07.947 INFO:tasks.workunit.client.0.smithi043.stdout:4/628: rename d3/d19/dca to d3/de/d46/d6a/d8f/d8e/db5/dda 0 2024-04-25T23:01:07.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/667: dread - d7/d26/d2d/dab/fe5 zero size 2024-04-25T23:01:07.948 INFO:tasks.workunit.client.0.smithi043.stdout:6/557: dwrite d1/d5/f3f [0,4194304] 0 2024-04-25T23:01:07.949 INFO:tasks.workunit.client.0.smithi043.stdout:1/547: read d0/d9/d63/f90 [1577669,12952] 0 2024-04-25T23:01:07.950 INFO:tasks.workunit.client.0.smithi043.stdout:6/558: chown d1/d5/d3b/d4c/f58 12281935 1 2024-04-25T23:01:07.950 INFO:tasks.workunit.client.0.smithi043.stdout:1/548: chown d0/d2f/l7d 6 1 2024-04-25T23:01:07.950 INFO:tasks.workunit.client.0.smithi043.stdout:0/548: truncate d1b/d31/d3c/f7c 221601 0 2024-04-25T23:01:07.953 INFO:tasks.workunit.client.0.smithi043.stdout:6/559: write d1/d2a/f4e [2873518,62995] 0 2024-04-25T23:01:07.954 INFO:tasks.workunit.client.0.smithi043.stdout:0/549: getdents d1b/d31/d3c 0 2024-04-25T23:01:07.954 INFO:tasks.workunit.client.0.smithi043.stdout:1/549: rename d0/d2f/l40 to d0/d86/daa/lcb 0 2024-04-25T23:01:07.954 INFO:tasks.workunit.client.0.smithi043.stdout:2/465: dwrite d2/d7f/f80 [0,4194304] 0 2024-04-25T23:01:07.955 INFO:tasks.workunit.client.0.smithi043.stdout:1/550: fdatasync d0/f72 0 2024-04-25T23:01:07.958 INFO:tasks.workunit.client.0.smithi043.stdout:4/629: dwrite d3/d21/d6b/f81 [0,4194304] 0 2024-04-25T23:01:07.958 INFO:tasks.workunit.client.0.smithi043.stdout:8/460: dwrite d3/d4/d7c/d92/d10/d33/f67 [0,4194304] 0 2024-04-25T23:01:07.958 INFO:tasks.workunit.client.0.smithi043.stdout:4/630: stat d3/l62 0 2024-04-25T23:01:07.959 INFO:tasks.workunit.client.0.smithi043.stdout:3/668: dwrite d7/d26/d27/d34/d1a/d28/f4c [0,4194304] 0 2024-04-25T23:01:07.960 INFO:tasks.workunit.client.0.smithi043.stdout:6/560: creat d1/d5/d3b/d62/fc1 x:0 0 0 2024-04-25T23:01:07.963 INFO:tasks.workunit.client.0.smithi043.stdout:0/550: dwrite d1b/d23/d39/f4f [0,4194304] 0 2024-04-25T23:01:07.963 INFO:tasks.workunit.client.0.smithi043.stdout:3/669: mknod d7/d26/d59/d7c/db2/d87/ced 0 2024-04-25T23:01:07.963 INFO:tasks.workunit.client.0.smithi043.stdout:5/602: dread d0/d2c/d39/d1c/d25/d7a/d41/fa1 [0,4194304] 0 2024-04-25T23:01:07.964 INFO:tasks.workunit.client.0.smithi043.stdout:6/561: truncate d1/d5/d3b/d4c/d21/d55/fb2 915694 0 2024-04-25T23:01:07.965 INFO:tasks.workunit.client.0.smithi043.stdout:4/631: mknod d3/cdb 0 2024-04-25T23:01:07.965 INFO:tasks.workunit.client.0.smithi043.stdout:5/603: fdatasync d0/d2c/d39/d1c/d25/d7a/d2d/fb2 0 2024-04-25T23:01:07.966 INFO:tasks.workunit.client.0.smithi043.stdout:1/551: link d0/d3c/f79 d0/d16/d5a/d5b/fcc 0 2024-04-25T23:01:07.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/670: creat d7/d26/d27/d34/d1a/d40/d8f/d51/de1/fee x:0 0 0 2024-04-25T23:01:07.967 INFO:tasks.workunit.client.0.smithi043.stdout:2/466: getdents d2/d3/d22 0 2024-04-25T23:01:07.967 INFO:tasks.workunit.client.0.smithi043.stdout:5/604: symlink d0/d22/lcb 0 2024-04-25T23:01:07.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/671: fsync d7/d26/d27/d34/d1a/d40/d8f/fd3 0 2024-04-25T23:01:07.969 INFO:tasks.workunit.client.0.smithi043.stdout:9/582: dwrite d8/de/d44/f60 [0,4194304] 0 2024-04-25T23:01:07.969 INFO:tasks.workunit.client.0.smithi043.stdout:8/461: dread d3/d4/db/d14/d4c/d68/f7a [0,4194304] 0 2024-04-25T23:01:07.969 INFO:tasks.workunit.client.0.smithi043.stdout:4/632: symlink d3/de/d46/ldc 0 2024-04-25T23:01:07.969 INFO:tasks.workunit.client.0.smithi043.stdout:6/562: mkdir d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/dc2 0 2024-04-25T23:01:07.971 INFO:tasks.workunit.client.0.smithi043.stdout:2/467: creat d2/d66/d85/d43/f8e x:0 0 0 2024-04-25T23:01:07.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/583: mknod d8/de/d12/d16/d24/dbe/dc6/d68/cca 0 2024-04-25T23:01:07.972 INFO:tasks.workunit.client.0.smithi043.stdout:4/633: creat d3/d37/d7a/fdd x:0 0 0 2024-04-25T23:01:07.972 INFO:tasks.workunit.client.0.smithi043.stdout:3/672: link d7/d26/d27/d34/l3b d7/dac/lef 0 2024-04-25T23:01:07.972 INFO:tasks.workunit.client.0.smithi043.stdout:3/673: write d7/d26/fca [186775,7094] 0 2024-04-25T23:01:07.974 INFO:tasks.workunit.client.0.smithi043.stdout:2/468: creat d2/d3/d22/d77/f8f x:0 0 0 2024-04-25T23:01:07.975 INFO:tasks.workunit.client.0.smithi043.stdout:4/634: dread - d3/de/d27/d45/fcf zero size 2024-04-25T23:01:07.975 INFO:tasks.workunit.client.0.smithi043.stdout:1/552: dread d0/d16/f5e [4194304,4194304] 0 2024-04-25T23:01:07.976 INFO:tasks.workunit.client.0.smithi043.stdout:3/674: creat d7/d26/d27/d34/d1a/d28/ff0 x:0 0 0 2024-04-25T23:01:07.977 INFO:tasks.workunit.client.0.smithi043.stdout:3/675: mkdir d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/df1 0 2024-04-25T23:01:07.979 INFO:tasks.workunit.client.0.smithi043.stdout:5/605: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d8b/f50 [0,4194304] 0 2024-04-25T23:01:07.981 INFO:tasks.workunit.client.0.smithi043.stdout:3/676: truncate d7/d26/d27/d34/d1a/d40/d8f/f86 1186288 0 2024-04-25T23:01:07.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/469: dwrite d2/d66/d85/d43/f8e [0,4194304] 0 2024-04-25T23:01:07.984 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:07.984 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:07.985 INFO:tasks.workunit.client.0.smithi043.stdout:6/563: truncate d1/d5/f67 4180355 0 2024-04-25T23:01:07.986 INFO:tasks.workunit.client.0.smithi043.stdout:1/553: write d0/d16/d5a/d5b/da4/f93 [4969966,41546] 0 2024-04-25T23:01:07.987 INFO:tasks.workunit.client.0.smithi043.stdout:2/470: symlink d2/d66/l90 0 2024-04-25T23:01:07.987 INFO:tasks.workunit.client.0.smithi043.stdout:3/677: creat d7/d26/ff2 x:0 0 0 2024-04-25T23:01:07.989 INFO:tasks.workunit.client.0.smithi043.stdout:9/584: read d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f66 [1482378,6639] 0 2024-04-25T23:01:07.989 INFO:tasks.workunit.client.0.smithi043.stdout:5/606: dread d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/fb6 [0,4194304] 0 2024-04-25T23:01:07.991 INFO:tasks.workunit.client.0.smithi043.stdout:2/471: unlink d2/d3/d22/d77/f8f 0 2024-04-25T23:01:07.991 INFO:tasks.workunit.client.0.smithi043.stdout:7/587: dread d3/da/d64/f8b [0,4194304] 0 2024-04-25T23:01:07.993 INFO:tasks.workunit.client.0.smithi043.stdout:8/462: dwrite d3/d4/db/d4e/d5c/d59/d61/d66/f6f [0,4194304] 0 2024-04-25T23:01:07.993 INFO:tasks.workunit.client.0.smithi043.stdout:1/554: getdents d0/d2f/d4b 0 2024-04-25T23:01:07.993 INFO:tasks.workunit.client.0.smithi043.stdout:0/551: dwrite d1b/d31/f6c [0,4194304] 0 2024-04-25T23:01:07.993 INFO:tasks.workunit.client.0.smithi043.stdout:9/585: symlink d8/de/d44/d5d/lcb 0 2024-04-25T23:01:07.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/586: chown d8/de/d12/d16/f25 86449436 1 2024-04-25T23:01:07.995 INFO:tasks.workunit.client.0.smithi043.stdout:2/472: unlink d2/d3/d13/d40/c4e 0 2024-04-25T23:01:07.995 INFO:tasks.workunit.client.0.smithi043.stdout:3/678: write d7/d26/d27/d34/f45 [1012913,118351] 0 2024-04-25T23:01:07.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/555: rename d0/d9/cad to d0/d2f/d4b/ccd 0 2024-04-25T23:01:07.996 INFO:tasks.workunit.client.0.smithi043.stdout:0/552: mkdir d1b/d23/d7a/dad 0 2024-04-25T23:01:07.997 INFO:tasks.workunit.client.0.smithi043.stdout:2/473: unlink d2/d66/d85/f87 0 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:9/587: readlink d8/de/d44/d65/l64 0 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/553: creat d1b/d31/d3c/fae x:0 0 0 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:9/588: write d8/fc1 [363521,86600] 0 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:2/474: chown d2/d3/d13/d40/l69 115 1 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:9/589: unlink d8/de/d44/c81 0 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:2/475: write d2/d3/d13/f32 [2584200,39157] 0 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:2/476: rmdir d2/d66/d85/d43 39 2024-04-25T23:01:08.002 INFO:tasks.workunit.client.0.smithi043.stdout:3/679: dread d7/d26/d27/d34/d1a/d28/f29 [0,4194304] 0 2024-04-25T23:01:08.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/590: truncate d8/de/d12/d16/d24/f2a 2088973 0 2024-04-25T23:01:08.004 INFO:tasks.workunit.client.0.smithi043.stdout:1/556: dwrite d0/d2f/f48 [0,4194304] 0 2024-04-25T23:01:08.004 INFO:tasks.workunit.client.0.smithi043.stdout:3/680: write d7/d26/d27/d34/d1a/d40/fc1 [4095541,67903] 0 2024-04-25T23:01:08.004 INFO:tasks.workunit.client.0.smithi043.stdout:3/681: chown d7/f20 1374287665 1 2024-04-25T23:01:08.007 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:08.008 INFO:tasks.workunit.client.0.smithi043.stdout:7/588: truncate d3/da/df/d11/d26/f83 1815963 0 2024-04-25T23:01:08.008 INFO:tasks.workunit.client.0.smithi043.stdout:9/591: readlink d8/de/d12/d16/d24/dbe/dc6/d2f/da6/lb3 0 2024-04-25T23:01:08.008 INFO:tasks.workunit.client.0.smithi043.stdout:1/557: unlink d0/d2f/d4b/d8f/fb9 0 2024-04-25T23:01:08.008 INFO:tasks.workunit.client.0.smithi043.stdout:6/564: dread d1/d5/d3b/d4c/d1a/f5a [0,4194304] 0 2024-04-25T23:01:08.009 INFO:tasks.workunit.client.0.smithi043.stdout:3/682: link d7/d26/d27/d34/d1a/d40/d8f/d51/de1/f6c d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/ff3 0 2024-04-25T23:01:08.009 INFO:tasks.workunit.client.0.smithi043.stdout:6/565: write d1/d5/f3f [2926050,38579] 0 2024-04-25T23:01:08.011 INFO:tasks.workunit.client.0.smithi043.stdout:3/683: dread - d7/d26/fdc zero size 2024-04-25T23:01:08.011 INFO:tasks.workunit.client.0.smithi043.stdout:3/684: sync 2024-04-25T23:01:08.011 INFO:tasks.workunit.client.0.smithi043.stdout:1/558: getdents d0/d86/daa 0 2024-04-25T23:01:08.012 INFO:tasks.workunit.client.0.smithi043.stdout:2/477: dwrite d2/d66/d85/d43/d67/f7a [0,4194304] 0 2024-04-25T23:01:08.013 INFO:tasks.workunit.client.0.smithi043.stdout:4/635: dread d3/de/d46/d6a/d8f/f5e [0,4194304] 0 2024-04-25T23:01:08.014 INFO:tasks.workunit.client.0.smithi043.stdout:2/478: chown d2/d4b 5 1 2024-04-25T23:01:08.014 INFO:tasks.workunit.client.0.smithi043.stdout:1/559: write d0/d16/f65 [1171817,93016] 0 2024-04-25T23:01:08.014 INFO:tasks.workunit.client.0.smithi043.stdout:6/566: readlink d1/d5/d3b/d4c/d21/d55/d68/d30/l40 0 2024-04-25T23:01:08.016 INFO:tasks.workunit.client.0.smithi043.stdout:7/589: dread d3/da/df/d11/f15 [4194304,4194304] 0 2024-04-25T23:01:08.016 INFO:tasks.workunit.client.0.smithi043.stdout:3/685: creat d7/d26/d59/d7c/db2/d52/ff4 x:0 0 0 2024-04-25T23:01:08.017 INFO:tasks.workunit.client.0.smithi043.stdout:4/636: mkdir d3/d19/d34/d76/dde 0 2024-04-25T23:01:08.017 INFO:tasks.workunit.client.0.smithi043.stdout:1/560: mkdir d0/dce 0 2024-04-25T23:01:08.017 INFO:tasks.workunit.client.0.smithi043.stdout:2/479: creat d2/d66/d85/d76/f91 x:0 0 0 2024-04-25T23:01:08.018 INFO:tasks.workunit.client.0.smithi043.stdout:6/567: mkdir d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/dc3 0 2024-04-25T23:01:08.018 INFO:tasks.workunit.client.0.smithi043.stdout:3/686: symlink d7/d26/d27/lf5 0 2024-04-25T23:01:08.019 INFO:tasks.workunit.client.0.smithi043.stdout:0/554: dwrite d1b/d31/d3c/f52 [0,4194304] 0 2024-04-25T23:01:08.019 INFO:tasks.workunit.client.0.smithi043.stdout:5/607: dread d0/d2c/d39/d1c/d5e/f77 [0,4194304] 0 2024-04-25T23:01:08.019 INFO:tasks.workunit.client.0.smithi043.stdout:5/608: sync 2024-04-25T23:01:08.021 INFO:tasks.workunit.client.0.smithi043.stdout:4/637: mknod d3/de/d46/d6a/d8f/cdf 0 2024-04-25T23:01:08.021 INFO:tasks.workunit.client.0.smithi043.stdout:2/480: truncate d2/d66/d85/d76/f91 655866 0 2024-04-25T23:01:08.022 INFO:tasks.workunit.client.0.smithi043.stdout:1/561: mknod d0/d2f/d4b/ccf 0 2024-04-25T23:01:08.022 INFO:tasks.workunit.client.0.smithi043.stdout:6/568: mkdir d1/d2a/db5/dc4 0 2024-04-25T23:01:08.023 INFO:tasks.workunit.client.0.smithi043.stdout:3/687: fdatasync d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/fe7 0 2024-04-25T23:01:08.023 INFO:tasks.workunit.client.0.smithi043.stdout:0/555: symlink d1b/d23/d91/laf 0 2024-04-25T23:01:08.023 INFO:tasks.workunit.client.0.smithi043.stdout:9/592: dwrite d8/de/d12/d16/d24/dbe/dc6/d68/fb1 [0,4194304] 0 2024-04-25T23:01:08.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/638: creat d3/d21/d6b/d87/d8a/fe0 x:0 0 0 2024-04-25T23:01:08.025 INFO:tasks.workunit.client.0.smithi043.stdout:3/688: chown d7/d26/d27/d34/f35 7461 1 2024-04-25T23:01:08.026 INFO:tasks.workunit.client.0.smithi043.stdout:1/562: rmdir d0/d2f/d4b/da6 39 2024-04-25T23:01:08.026 INFO:tasks.workunit.client.0.smithi043.stdout:4/639: mkdir d3/d21/d6b/d87/d8a/de1 0 2024-04-25T23:01:08.026 INFO:tasks.workunit.client.0.smithi043.stdout:6/569: mkdir d1/d5/d3b/d4c/d21/d55/d68/dc5 0 2024-04-25T23:01:08.027 INFO:tasks.workunit.client.0.smithi043.stdout:0/556: write f1a [1156867,8326] 0 2024-04-25T23:01:08.028 INFO:tasks.workunit.client.0.smithi043.stdout:1/563: chown d0/dce 35 1 2024-04-25T23:01:08.028 INFO:tasks.workunit.client.0.smithi043.stdout:3/689: readlink d7/d26/d27/lf5 0 2024-04-25T23:01:08.028 INFO:tasks.workunit.client.0.smithi043.stdout:9/593: link d8/de/d12/d16/d24/f28 d8/de/d44/fcc 0 2024-04-25T23:01:08.029 INFO:tasks.workunit.client.0.smithi043.stdout:0/557: mkdir d1b/db0 0 2024-04-25T23:01:08.029 INFO:tasks.workunit.client.0.smithi043.stdout:4/640: write d3/d19/f1e [1684570,119059] 0 2024-04-25T23:01:08.030 INFO:tasks.workunit.client.0.smithi043.stdout:5/609: dwrite d0/d2c/d39/d63/f93 [0,4194304] 0 2024-04-25T23:01:08.030 INFO:tasks.workunit.client.0.smithi043.stdout:1/564: symlink d0/d9/ld0 0 2024-04-25T23:01:08.032 INFO:tasks.workunit.client.0.smithi043.stdout:6/570: fsync d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/faa 0 2024-04-25T23:01:08.032 INFO:tasks.workunit.client.0.smithi043.stdout:9/594: stat d8/de/d44/d5d/da1/fa3 0 2024-04-25T23:01:08.033 INFO:tasks.workunit.client.0.smithi043.stdout:7/590: dwrite d3/d1e/d1f/f24 [4194304,4194304] 0 2024-04-25T23:01:08.033 INFO:tasks.workunit.client.0.smithi043.stdout:4/641: mkdir d3/de/d27/d5c/de2 0 2024-04-25T23:01:08.034 INFO:tasks.workunit.client.0.smithi043.stdout:6/571: chown d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/dc3 65818 1 2024-04-25T23:01:08.035 INFO:tasks.workunit.client.0.smithi043.stdout:2/481: dwrite d2/d66/d85/d76/f3f [0,4194304] 0 2024-04-25T23:01:08.036 INFO:tasks.workunit.client.0.smithi043.stdout:4/642: write d3/de/d27/d45/fcf [84472,15567] 0 2024-04-25T23:01:08.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/572: fdatasync d1/d5/f95 0 2024-04-25T23:01:08.037 INFO:tasks.workunit.client.0.smithi043.stdout:2/482: read - d2/d66/d85/d43/d5d/f7d zero size 2024-04-25T23:01:08.038 INFO:tasks.workunit.client.0.smithi043.stdout:1/565: write d0/d16/f6d [1957450,77469] 0 2024-04-25T23:01:08.040 INFO:tasks.workunit.client.0.smithi043.stdout:1/566: sync 2024-04-25T23:01:08.040 INFO:tasks.workunit.client.0.smithi043.stdout:8/463: dread d3/d4/d7c/d92/d10/f65 [0,4194304] 0 2024-04-25T23:01:08.040 INFO:tasks.workunit.client.0.smithi043.stdout:3/690: dwrite d7/d26/d27/d34/f35 [0,4194304] 0 2024-04-25T23:01:08.040 INFO:tasks.workunit.client.0.smithi043.stdout:8/464: sync 2024-04-25T23:01:08.040 INFO:tasks.workunit.client.0.smithi043.stdout:9/595: dread d8/de/d44/d47/f8a [0,4194304] 0 2024-04-25T23:01:08.043 INFO:tasks.workunit.client.0.smithi043.stdout:0/558: write f3 [2158908,6209] 0 2024-04-25T23:01:08.044 INFO:tasks.workunit.client.0.smithi043.stdout:1/567: mkdir d0/d16/dd1 0 2024-04-25T23:01:08.044 INFO:tasks.workunit.client.0.smithi043.stdout:8/465: unlink d3/d4/db/d14/d4c/l73 0 2024-04-25T23:01:08.044 INFO:tasks.workunit.client.0.smithi043.stdout:4/643: rename d3/de/d27/d45/fc1 to d3/d37/d4d/fe3 0 2024-04-25T23:01:08.045 INFO:tasks.workunit.client.0.smithi043.stdout:6/573: fsync d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fc0 0 2024-04-25T23:01:08.046 INFO:tasks.workunit.client.0.smithi043.stdout:5/610: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fab [0,4194304] 0 2024-04-25T23:01:08.046 INFO:tasks.workunit.client.0.smithi043.stdout:0/559: chown d1b/d42/f54 2856 1 2024-04-25T23:01:08.046 INFO:tasks.workunit.client.0.smithi043.stdout:1/568: write d0/d3d/f95 [257700,87853] 0 2024-04-25T23:01:08.048 INFO:tasks.workunit.client.0.smithi043.stdout:9/596: rename d8/de/d12/d16/d24/f62 to d8/de/d44/d5d/da1/fcd 0 2024-04-25T23:01:08.049 INFO:tasks.workunit.client.0.smithi043.stdout:2/483: dwrite d2/d66/d85/f72 [0,4194304] 0 2024-04-25T23:01:08.049 INFO:tasks.workunit.client.0.smithi043.stdout:4/644: link d3/d19/f22 d3/de/d27/d5c/d67/fe4 0 2024-04-25T23:01:08.049 INFO:tasks.workunit.client.0.smithi043.stdout:5/611: creat d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/fcc x:0 0 0 2024-04-25T23:01:08.049 INFO:tasks.workunit.client.0.smithi043.stdout:8/466: rename d3/d4/db/d14/d56/c79 to d3/d4/db/d14/d4c/d68/c96 0 2024-04-25T23:01:08.050 INFO:tasks.workunit.client.0.smithi043.stdout:5/612: sync 2024-04-25T23:01:08.050 INFO:tasks.workunit.client.0.smithi043.stdout:7/591: dwrite d3/f19 [0,4194304] 0 2024-04-25T23:01:08.050 INFO:tasks.workunit.client.0.smithi043.stdout:0/560: mkdir d1b/d31/db1 0 2024-04-25T23:01:08.051 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:08.048+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:08.051 INFO:tasks.workunit.client.0.smithi043.stdout:4/645: stat d3/d37/l31 0 2024-04-25T23:01:08.051 INFO:tasks.workunit.client.0.smithi043.stdout:5/613: fdatasync d0/d2c/d39/d1c/f55 0 2024-04-25T23:01:08.053 INFO:tasks.workunit.client.0.smithi043.stdout:7/592: unlink d3/l28 0 2024-04-25T23:01:08.054 INFO:tasks.workunit.client.0.smithi043.stdout:7/593: chown d3/f7b 0 1 2024-04-25T23:01:08.055 INFO:tasks.workunit.client.0.smithi043.stdout:8/467: mkdir d3/d4/db/d4e/d5c/d59/d61/d97 0 2024-04-25T23:01:08.055 INFO:tasks.workunit.client.0.smithi043.stdout:2/484: write d2/d66/d85/f36 [548535,122408] 0 2024-04-25T23:01:08.056 INFO:tasks.workunit.client.0.smithi043.stdout:6/574: read d1/d5/d3b/d4c/d21/d38/d60/fa5 [82083,108467] 0 2024-04-25T23:01:08.057 INFO:tasks.workunit.client.0.smithi043.stdout:7/594: fsync d3/da/df/d11/f20 0 2024-04-25T23:01:08.059 INFO:tasks.workunit.client.0.smithi043.stdout:0/561: creat d1b/fb2 x:0 0 0 2024-04-25T23:01:08.060 INFO:tasks.workunit.client.0.smithi043.stdout:8/468: read d3/d4/db/d14/d56/d5d/f63 [2018516,64785] 0 2024-04-25T23:01:08.060 INFO:tasks.workunit.client.0.smithi043.stdout:3/691: dread d7/d26/d27/d34/d1a/d40/d8f/f86 [0,4194304] 0 2024-04-25T23:01:08.060 INFO:tasks.workunit.client.0.smithi043.stdout:2/485: mknod d2/d66/d85/d43/c92 0 2024-04-25T23:01:08.062 INFO:tasks.workunit.client.0.smithi043.stdout:9/597: dwrite d8/de/d12/d16/d24/dbe/dc6/d68/f88 [0,4194304] 0 2024-04-25T23:01:08.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/614: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/fc7 [0,4194304] 0 2024-04-25T23:01:08.063 INFO:tasks.workunit.client.0.smithi043.stdout:2/486: chown d2/d3/f34 1 1 2024-04-25T23:01:08.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/646: dwrite d3/de/d46/d95/fbe [0,4194304] 0 2024-04-25T23:01:08.063 INFO:tasks.workunit.client.0.smithi043.stdout:6/575: truncate d1/d5/d3b/d4c/d21/d55/d6d/d91/fbb 705738 0 2024-04-25T23:01:08.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/647: write d3/d37/f54 [7456150,57700] 0 2024-04-25T23:01:08.064 INFO:tasks.workunit.client.0.smithi043.stdout:9/598: readlink d8/de/d12/d16/d24/dbe/dc6/d2f/l51 0 2024-04-25T23:01:08.066 INFO:tasks.workunit.client.0.smithi043.stdout:6/576: write d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fb1 [19057,19879] 0 2024-04-25T23:01:08.067 INFO:tasks.workunit.client.0.smithi043.stdout:5/615: dread d0/d2c/d39/d1c/d25/d7a/d2d/d8b/f50 [0,4194304] 0 2024-04-25T23:01:08.068 INFO:tasks.workunit.client.0.smithi043.stdout:0/562: unlink d1b/d31/d3c/l8c 0 2024-04-25T23:01:08.068 INFO:tasks.workunit.client.0.smithi043.stdout:7/595: creat d3/d1e/d1f/d54/fb5 x:0 0 0 2024-04-25T23:01:08.068 INFO:tasks.workunit.client.0.smithi043.stdout:8/469: mkdir d3/d4/d98 0 2024-04-25T23:01:08.068 INFO:tasks.workunit.client.0.smithi043.stdout:3/692: creat d7/d26/d27/ff6 x:0 0 0 2024-04-25T23:01:08.068 INFO:tasks.workunit.client.0.smithi043.stdout:1/569: truncate d0/d3d/f30 154606 0 2024-04-25T23:01:08.072 INFO:tasks.workunit.client.0.smithi043.stdout:8/470: chown d3/l78 417 1 2024-04-25T23:01:08.072 INFO:tasks.workunit.client.0.smithi043.stdout:4/648: symlink d3/de/d27/le5 0 2024-04-25T23:01:08.072 INFO:tasks.workunit.client.0.smithi043.stdout:3/693: dread - d7/d26/fdc zero size 2024-04-25T23:01:08.072 INFO:tasks.workunit.client.0.smithi043.stdout:2/487: link d2/d3/d22/l3d d2/d3/d22/d77/l93 0 2024-04-25T23:01:08.072 INFO:tasks.workunit.client.0.smithi043.stdout:5/616: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fb3 [721653,51196] 0 2024-04-25T23:01:08.072 INFO:tasks.workunit.client.0.smithi043.stdout:9/599: creat d8/de/fce x:0 0 0 2024-04-25T23:01:08.073 INFO:tasks.workunit.client.0.smithi043.stdout:7/596: fdatasync d3/da/df/d79/f9d 0 2024-04-25T23:01:08.073 INFO:tasks.workunit.client.0.smithi043.stdout:9/600: fsync d8/de/d44/fcc 0 2024-04-25T23:01:08.073 INFO:tasks.workunit.client.0.smithi043.stdout:0/563: rename d1b/d42 to d1b/d23/d39/db3 0 2024-04-25T23:01:08.074 INFO:tasks.workunit.client.0.smithi043.stdout:8/471: mknod d3/d4/db/d4e/d5c/d59/d61/d66/c99 0 2024-04-25T23:01:08.074 INFO:tasks.workunit.client.0.smithi043.stdout:2/488: link d2/c7 d2/d3/d22/d77/c94 0 2024-04-25T23:01:08.074 INFO:tasks.workunit.client.0.smithi043.stdout:3/694: link d7/d26/d59/d7c/db2/f98 d7/d26/d88/ff7 0 2024-04-25T23:01:08.076 INFO:tasks.workunit.client.0.smithi043.stdout:0/564: mkdir d1b/d23/d39/db3/db4 0 2024-04-25T23:01:08.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/617: creat d0/d6a/fcd x:0 0 0 2024-04-25T23:01:08.078 INFO:tasks.workunit.client.0.smithi043.stdout:8/472: write d3/d4/d7c/d92/f83 [58252,124944] 0 2024-04-25T23:01:08.078 INFO:tasks.workunit.client.0.smithi043.stdout:8/473: sync 2024-04-25T23:01:08.079 INFO:tasks.workunit.client.0.smithi043.stdout:2/489: creat d2/d66/d85/d43/f95 x:0 0 0 2024-04-25T23:01:08.079 INFO:tasks.workunit.client.0.smithi043.stdout:3/695: mknod d7/d26/d88/db8/cf8 0 2024-04-25T23:01:08.079 INFO:tasks.workunit.client.0.smithi043.stdout:5/618: write d0/d2c/f9a [2124244,18509] 0 2024-04-25T23:01:08.081 INFO:tasks.workunit.client.0.smithi043.stdout:2/490: creat d2/d3/d13/d4f/f96 x:0 0 0 2024-04-25T23:01:08.082 INFO:tasks.workunit.client.0.smithi043.stdout:1/570: dwrite d0/d9/f9e [4194304,4194304] 0 2024-04-25T23:01:08.083 INFO:tasks.workunit.client.0.smithi043.stdout:2/491: stat d2/d3/d13/f1e 0 2024-04-25T23:01:08.083 INFO:tasks.workunit.client.0.smithi043.stdout:4/649: dwrite d3/d37/d4d/fc5 [0,4194304] 0 2024-04-25T23:01:08.084 INFO:tasks.workunit.client.0.smithi043.stdout:9/601: dwrite d8/de/f10 [4194304,4194304] 0 2024-04-25T23:01:08.084 INFO:tasks.workunit.client.0.smithi043.stdout:3/696: creat d7/d26/d88/db0/ff9 x:0 0 0 2024-04-25T23:01:08.084 INFO:tasks.workunit.client.0.smithi043.stdout:1/571: fsync d0/d86/fa3 0 2024-04-25T23:01:08.086 INFO:tasks.workunit.client.0.smithi043.stdout:9/602: write d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/f5b [261231,99661] 0 2024-04-25T23:01:08.087 INFO:tasks.workunit.client.0.smithi043.stdout:5/619: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/f50 [2735777,117358] 0 2024-04-25T23:01:08.089 INFO:tasks.workunit.client.0.smithi043.stdout:3/697: creat d7/d26/d27/d34/d1a/d40/d8f/d51/de1/ffa x:0 0 0 2024-04-25T23:01:08.090 INFO:tasks.workunit.client.0.smithi043.stdout:3/698: fdatasync d7/d26/d88/db0/fe3 0 2024-04-25T23:01:08.091 INFO:tasks.workunit.client.0.smithi043.stdout:2/492: rename d2/d3/d22 to d2/d66/d85/d76/d97 0 2024-04-25T23:01:08.092 INFO:tasks.workunit.client.0.smithi043.stdout:2/493: stat d2/d66/d85/d43/d5d 0 2024-04-25T23:01:08.092 INFO:tasks.workunit.client.0.smithi043.stdout:1/572: mknod d0/d2f/d4b/cd2 0 2024-04-25T23:01:08.092 INFO:tasks.workunit.client.0.smithi043.stdout:4/650: dwrite d3/d19/f82 [0,4194304] 0 2024-04-25T23:01:08.092 INFO:tasks.workunit.client.0.smithi043.stdout:5/620: symlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/lce 0 2024-04-25T23:01:08.093 INFO:tasks.workunit.client.0.smithi043.stdout:3/699: fdatasync d7/d26/d27/d34/d1a/d40/d8f/d51/de1/ffa 0 2024-04-25T23:01:08.094 INFO:tasks.workunit.client.0.smithi043.stdout:0/565: dread d1b/d31/d3c/f43 [0,4194304] 0 2024-04-25T23:01:08.094 INFO:tasks.workunit.client.0.smithi043.stdout:9/603: getdents d8/de/d12/d16/d24/dbe 0 2024-04-25T23:01:08.094 INFO:tasks.workunit.client.0.smithi043.stdout:1/573: symlink d0/d86/daa/ld3 0 2024-04-25T23:01:08.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/494: write d2/d66/d85/d76/d97/f26 [1077148,95382] 0 2024-04-25T23:01:08.094 INFO:tasks.workunit.client.0.smithi043.stdout:5/621: mknod d0/d22/ccf 0 2024-04-25T23:01:08.094 INFO:tasks.workunit.client.0.smithi043.stdout:4/651: creat d3/de/d27/d5c/d67/fe6 x:0 0 0 2024-04-25T23:01:08.095 INFO:tasks.workunit.client.0.smithi043.stdout:2/495: write d2/f75 [3134202,90911] 0 2024-04-25T23:01:08.095 INFO:tasks.workunit.client.0.smithi043.stdout:3/700: symlink d7/d26/d59/d7c/db2/lfb 0 2024-04-25T23:01:08.095 INFO:tasks.workunit.client.0.smithi043.stdout:4/652: fdatasync d3/f24 0 2024-04-25T23:01:08.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/496: creat d2/f98 x:0 0 0 2024-04-25T23:01:08.097 INFO:tasks.workunit.client.0.smithi043.stdout:9/604: fsync d8/de/d12/d16/d24/dbe/dc6/d2f/fa5 0 2024-04-25T23:01:08.097 INFO:tasks.workunit.client.0.smithi043.stdout:4/653: mkdir d3/d37/d7a/de7 0 2024-04-25T23:01:08.097 INFO:tasks.workunit.client.0.smithi043.stdout:3/701: write d7/d26/d27/f80 [592626,124393] 0 2024-04-25T23:01:08.097 INFO:tasks.workunit.client.0.smithi043.stdout:2/497: rmdir d2/d66/d85/d43 39 2024-04-25T23:01:08.097 INFO:tasks.workunit.client.0.smithi043.stdout:1/574: getdents d0/d9/d63 0 2024-04-25T23:01:08.097 INFO:tasks.workunit.client.0.smithi043.stdout:5/622: mknod d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/cd0 0 2024-04-25T23:01:08.098 INFO:tasks.workunit.client.0.smithi043.stdout:0/566: creat d1b/d31/fb5 x:0 0 0 2024-04-25T23:01:08.098 INFO:tasks.workunit.client.0.smithi043.stdout:3/702: mknod d7/d26/d88/db8/cfc 0 2024-04-25T23:01:08.098 INFO:tasks.workunit.client.0.smithi043.stdout:2/498: symlink d2/d3/l99 0 2024-04-25T23:01:08.100 INFO:tasks.workunit.client.0.smithi043.stdout:4/654: symlink d3/de/d46/d6a/d8f/d8e/le8 0 2024-04-25T23:01:08.100 INFO:tasks.workunit.client.0.smithi043.stdout:2/499: write d2/d3/d13/d40/f6b [1290881,62271] 0 2024-04-25T23:01:08.101 INFO:tasks.workunit.client.0.smithi043.stdout:9/605: truncate d8/de/d44/fcc 6460669 0 2024-04-25T23:01:08.102 INFO:tasks.workunit.client.0.smithi043.stdout:2/500: mkdir d2/d66/d85/d76/d97/d77/d9a 0 2024-04-25T23:01:08.102 INFO:tasks.workunit.client.0.smithi043.stdout:7/597: dread d3/d1e/f9e [0,4194304] 0 2024-04-25T23:01:08.103 INFO:tasks.workunit.client.0.smithi043.stdout:9/606: write d8/de/f42 [174681,37739] 0 2024-04-25T23:01:08.105 INFO:tasks.workunit.client.0.smithi043.stdout:4/655: truncate d3/d37/d4d/fb0 1476973 0 2024-04-25T23:01:08.105 INFO:tasks.workunit.client.0.smithi043.stdout:2/501: read - d2/d66/d85/d43/f8c zero size 2024-04-25T23:01:08.106 INFO:tasks.workunit.client.0.smithi043.stdout:7/598: rename d3/da/d64/la6 to d3/da/d78/lb6 0 2024-04-25T23:01:08.107 INFO:tasks.workunit.client.0.smithi043.stdout:0/567: dwrite fb [0,4194304] 0 2024-04-25T23:01:08.107 INFO:tasks.workunit.client.0.smithi043.stdout:4/656: symlink d3/de/d27/d45/dc7/dc8/le9 0 2024-04-25T23:01:08.107 INFO:tasks.workunit.client.0.smithi043.stdout:3/703: dwrite d7/d26/fdc [0,4194304] 0 2024-04-25T23:01:08.107 INFO:tasks.workunit.client.0.smithi043.stdout:9/607: truncate d8/de/d44/d65/fae 571633 0 2024-04-25T23:01:08.108 INFO:tasks.workunit.client.0.smithi043.stdout:4/657: fdatasync d3/d21/f2e 0 2024-04-25T23:01:08.113 INFO:tasks.workunit.client.0.smithi043.stdout:4/658: rmdir d3/d37/d4d 39 2024-04-25T23:01:08.114 INFO:tasks.workunit.client.0.smithi043.stdout:1/575: dread d0/d9/f20 [0,4194304] 0 2024-04-25T23:01:08.116 INFO:tasks.workunit.client.0.smithi043.stdout:5/623: dwrite d0/d2c/d39/d1c/d25/d4e/f58 [0,4194304] 0 2024-04-25T23:01:08.117 INFO:tasks.workunit.client.0.smithi043.stdout:3/704: dwrite d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/faa [4194304,4194304] 0 2024-04-25T23:01:08.117 INFO:tasks.workunit.client.0.smithi043.stdout:5/624: readlink d0/d6a/lbe 0 2024-04-25T23:01:08.117 INFO:tasks.workunit.client.0.smithi043.stdout:7/599: rename d3/da/df/d11/d26/f43 to d3/da/df/fb7 0 2024-04-25T23:01:08.118 INFO:tasks.workunit.client.0.smithi043.stdout:2/502: truncate d2/d3/d13/f6e 3960953 0 2024-04-25T23:01:08.119 INFO:tasks.workunit.client.0.smithi043.stdout:1/576: symlink d0/d16/dd1/ld4 0 2024-04-25T23:01:08.121 INFO:tasks.workunit.client.0.smithi043.stdout:5/625: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1 0 2024-04-25T23:01:08.121 INFO:tasks.workunit.client.0.smithi043.stdout:1/577: rename d0/d16/f22 to d0/d86/fd5 0 2024-04-25T23:01:08.122 INFO:tasks.workunit.client.0.smithi043.stdout:0/568: dwrite d1b/f40 [0,4194304] 0 2024-04-25T23:01:08.122 INFO:tasks.workunit.client.0.smithi043.stdout:1/578: sync 2024-04-25T23:01:08.123 INFO:tasks.workunit.client.0.smithi043.stdout:2/503: rename d2/d66/d85/d43/c92 to d2/d66/c9b 0 2024-04-25T23:01:08.123 INFO:tasks.workunit.client.0.smithi043.stdout:1/579: read - d0/d2f/d4b/d8f/fb8 zero size 2024-04-25T23:01:08.124 INFO:tasks.workunit.client.0.smithi043.stdout:9/608: dwrite d8/de/f78 [4194304,4194304] 0 2024-04-25T23:01:08.125 INFO:tasks.workunit.client.0.smithi043.stdout:3/705: truncate d7/d26/d27/d34/d1a/d40/f64 4727377 0 2024-04-25T23:01:08.126 INFO:tasks.workunit.client.0.smithi043.stdout:4/659: dwrite d3/de/d46/d6a/fd0 [0,4194304] 0 2024-04-25T23:01:08.127 INFO:tasks.workunit.client.0.smithi043.stdout:0/569: symlink d1b/d31/d3c/d72/lb6 0 2024-04-25T23:01:08.129 INFO:tasks.workunit.client.0.smithi043.stdout:3/706: chown d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/ca4 324 1 2024-04-25T23:01:08.130 INFO:tasks.workunit.client.0.smithi043.stdout:7/600: dwrite d3/da/df/f48 [4194304,4194304] 0 2024-04-25T23:01:08.130 INFO:tasks.workunit.client.0.smithi043.stdout:1/580: rmdir d0/d9/d63 39 2024-04-25T23:01:08.130 INFO:tasks.workunit.client.0.smithi043.stdout:2/504: creat d2/d66/d85/d43/d67/f9c x:0 0 0 2024-04-25T23:01:08.130 INFO:tasks.workunit.client.0.smithi043.stdout:0/570: chown d1b/fa4 1 1 2024-04-25T23:01:08.130 INFO:tasks.workunit.client.0.smithi043.stdout:4/660: rename d3/de/d27/d45/dc7 to d3/d19/d34/dea 0 2024-04-25T23:01:08.131 INFO:tasks.workunit.client.0.smithi043.stdout:5/626: dread d0/d2c/d39/d63/f93 [0,4194304] 0 2024-04-25T23:01:08.132 INFO:tasks.workunit.client.0.smithi043.stdout:3/707: symlink d7/d26/d88/db8/lfd 0 2024-04-25T23:01:08.132 INFO:tasks.workunit.client.0.smithi043.stdout:1/581: unlink d0/d16/l4c 0 2024-04-25T23:01:08.133 INFO:tasks.workunit.client.0.smithi043.stdout:1/582: chown d0/d16/f2d 128979 1 2024-04-25T23:01:08.133 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:08.128+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:08.133 INFO:tasks.workunit.client.0.smithi043.stdout:2/505: creat d2/d4b/f9d x:0 0 0 2024-04-25T23:01:08.134 INFO:tasks.workunit.client.0.smithi043.stdout:1/583: chown d0/d2f/d4b/d8f/f99 950605 1 2024-04-25T23:01:08.134 INFO:tasks.workunit.client.0.smithi043.stdout:6/577: dread d1/d5/d3b/f7a [0,4194304] 0 2024-04-25T23:01:08.136 INFO:tasks.workunit.client.0.smithi043.stdout:1/584: fdatasync d0/d2f/d4b/f83 0 2024-04-25T23:01:08.136 INFO:tasks.workunit.client.0.smithi043.stdout:2/506: stat d2/d66/d85/d43/d67/f7a 0 2024-04-25T23:01:08.138 INFO:tasks.workunit.client.0.smithi043.stdout:9/609: dwrite d8/de/d44/f60 [4194304,4194304] 0 2024-04-25T23:01:08.138 INFO:tasks.workunit.client.0.smithi043.stdout:4/661: creat d3/d21/d84/feb x:0 0 0 2024-04-25T23:01:08.138 INFO:tasks.workunit.client.0.smithi043.stdout:7/601: creat d3/d1e/fb8 x:0 0 0 2024-04-25T23:01:08.139 INFO:tasks.workunit.client.0.smithi043.stdout:1/585: rmdir d0/d9/dc0 39 2024-04-25T23:01:08.139 INFO:tasks.workunit.client.0.smithi043.stdout:5/627: rename d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62/c89 to d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/cd2 0 2024-04-25T23:01:08.139 INFO:tasks.workunit.client.0.smithi043.stdout:3/708: dread d7/f18 [0,4194304] 0 2024-04-25T23:01:08.141 INFO:tasks.workunit.client.0.smithi043.stdout:6/578: creat d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fc6 x:0 0 0 2024-04-25T23:01:08.141 INFO:tasks.workunit.client.0.smithi043.stdout:0/571: dwrite d1b/f4a [0,4194304] 0 2024-04-25T23:01:08.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/507: write d2/d66/d85/d43/d5d/f89 [755651,78200] 0 2024-04-25T23:01:08.141 INFO:tasks.workunit.client.0.smithi043.stdout:7/602: chown d3/da/df/d11/f2f 87227188 1 2024-04-25T23:01:08.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/579: write d1/d5/d3b/d4c/d21/d55/d68/f42 [4052074,108319] 0 2024-04-25T23:01:08.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/586: rename d0/d3d/d4f/cbb to d0/d3d/cd6 0 2024-04-25T23:01:08.142 INFO:tasks.workunit.client.0.smithi043.stdout:8/474: dread d3/d4/db/d14/d56/f70 [0,4194304] 0 2024-04-25T23:01:08.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/610: readlink d8/de/d12/d7a/lb8 0 2024-04-25T23:01:08.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/603: fsync d3/d1e/d1f/d6b/d72/f77 0 2024-04-25T23:01:08.144 INFO:tasks.workunit.client.0.smithi043.stdout:1/587: mkdir d0/d3d/dd7 0 2024-04-25T23:01:08.144 INFO:tasks.workunit.client.0.smithi043.stdout:6/580: dread - d1/d5/d3b/db6/fb8 zero size 2024-04-25T23:01:08.145 INFO:tasks.workunit.client.0.smithi043.stdout:4/662: link d3/d19/cbf d3/d19/d34/d76/cec 0 2024-04-25T23:01:08.146 INFO:tasks.workunit.client.0.smithi043.stdout:1/588: unlink d0/d9/f20 0 2024-04-25T23:01:08.146 INFO:tasks.workunit.client.0.smithi043.stdout:7/604: unlink d3/d1e/d1f/d6b/d72/f9c 0 2024-04-25T23:01:08.147 INFO:tasks.workunit.client.0.smithi043.stdout:9/611: symlink d8/de/d12/d7a/lcf 0 2024-04-25T23:01:08.147 INFO:tasks.workunit.client.0.smithi043.stdout:4/663: truncate d3/de/d27/d45/fa0 300439 0 2024-04-25T23:01:08.147 INFO:tasks.workunit.client.0.smithi043.stdout:8/475: write d3/d4/db/d4e/d5c/f1e [812925,107013] 0 2024-04-25T23:01:08.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/589: creat d0/d2f/d4b/d8f/fd8 x:0 0 0 2024-04-25T23:01:08.147 INFO:tasks.workunit.client.0.smithi043.stdout:2/508: fsync d2/d66/d85/d43/d67/f9c 0 2024-04-25T23:01:08.147 INFO:tasks.workunit.client.0.smithi043.stdout:4/664: chown d3/f24 29133 1 2024-04-25T23:01:08.148 INFO:tasks.workunit.client.0.smithi043.stdout:7/605: unlink d3/da/df/l3d 0 2024-04-25T23:01:08.148 INFO:tasks.workunit.client.0.smithi043.stdout:5/628: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/f8a [0,4194304] 0 2024-04-25T23:01:08.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/581: truncate d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fc0 4949449 0 2024-04-25T23:01:08.150 INFO:tasks.workunit.client.0.smithi043.stdout:9/612: symlink d8/de/d12/d16/d24/dbe/dc6/d2f/dad/ld0 0 2024-04-25T23:01:08.150 INFO:tasks.workunit.client.0.smithi043.stdout:8/476: unlink d3/d4/db/d14/d4c/l93 0 2024-04-25T23:01:08.150 INFO:tasks.workunit.client.0.smithi043.stdout:4/665: creat d3/d21/d6b/d87/d8a/fed x:0 0 0 2024-04-25T23:01:08.151 INFO:tasks.workunit.client.0.smithi043.stdout:2/509: creat d2/d66/d85/d76/d97/f9e x:0 0 0 2024-04-25T23:01:08.151 INFO:tasks.workunit.client.0.smithi043.stdout:6/582: mknod d1/d5/d3b/d4c/d21/d38/cc7 0 2024-04-25T23:01:08.151 INFO:tasks.workunit.client.0.smithi043.stdout:1/590: chown d0/d9/dc0/lc8 16715 1 2024-04-25T23:01:08.151 INFO:tasks.workunit.client.0.smithi043.stdout:5/629: write d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 [1012473,108570] 0 2024-04-25T23:01:08.152 INFO:tasks.workunit.client.0.smithi043.stdout:5/630: chown d0/d2c/d39/d1c/d5e/f77 56015 1 2024-04-25T23:01:08.154 INFO:tasks.workunit.client.0.smithi043.stdout:4/666: mknod d3/d21/d6b/d87/d8a/cee 0 2024-04-25T23:01:08.154 INFO:tasks.workunit.client.0.smithi043.stdout:8/477: creat d3/d4/d7c/d92/d10/d33/f9a x:0 0 0 2024-04-25T23:01:08.154 INFO:tasks.workunit.client.0.smithi043.stdout:2/510: getdents d2 0 2024-04-25T23:01:08.155 INFO:tasks.workunit.client.0.smithi043.stdout:4/667: symlink d3/de/d27/d5c/db9/lef 0 2024-04-25T23:01:08.155 INFO:tasks.workunit.client.0.smithi043.stdout:2/511: write d2/d66/d85/f37 [1181775,100095] 0 2024-04-25T23:01:08.155 INFO:tasks.workunit.client.0.smithi043.stdout:5/631: creat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/daf/fd3 x:0 0 0 2024-04-25T23:01:08.156 INFO:tasks.workunit.client.0.smithi043.stdout:4/668: chown d3/de/f49 2115 1 2024-04-25T23:01:08.156 INFO:tasks.workunit.client.0.smithi043.stdout:8/478: read - d3/d4/db/d14/d56/d5d/f81 zero size 2024-04-25T23:01:08.156 INFO:tasks.workunit.client.0.smithi043.stdout:6/583: dread d1/d5/d3b/f7a [0,4194304] 0 2024-04-25T23:01:08.157 INFO:tasks.workunit.client.0.smithi043.stdout:5/632: stat d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1 0 2024-04-25T23:01:08.157 INFO:tasks.workunit.client.0.smithi043.stdout:2/512: mknod d2/d66/d85/d76/d97/c9f 0 2024-04-25T23:01:08.157 INFO:tasks.workunit.client.0.smithi043.stdout:8/479: creat d3/d4/db/d14/d4c/d68/f9b x:0 0 0 2024-04-25T23:01:08.158 INFO:tasks.workunit.client.0.smithi043.stdout:6/584: read - d1/d5/d3b/d4c/d21/d55/d68/f9e zero size 2024-04-25T23:01:08.158 INFO:tasks.workunit.client.0.smithi043.stdout:2/513: stat d2/d66/d85/d76/d97/fe 0 2024-04-25T23:01:08.158 INFO:tasks.workunit.client.0.smithi043.stdout:4/669: rename d3/d21/d6b/d87/d9a/dd3 to d3/de/d46/d6a/d8f/d8e/db5/dda/df0 0 2024-04-25T23:01:08.158 INFO:tasks.workunit.client.0.smithi043.stdout:5/633: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/daf/fd3 [773729,47956] 0 2024-04-25T23:01:08.158 INFO:tasks.workunit.client.0.smithi043.stdout:4/670: stat d3/f57 0 2024-04-25T23:01:08.159 INFO:tasks.workunit.client.0.smithi043.stdout:8/480: unlink d3/d4/db/d14/f41 0 2024-04-25T23:01:08.159 INFO:tasks.workunit.client.0.smithi043.stdout:2/514: mkdir d2/d3/d13/d4f/da0 0 2024-04-25T23:01:08.159 INFO:tasks.workunit.client.0.smithi043.stdout:4/671: stat d3/d37/d7a/fdd 0 2024-04-25T23:01:08.159 INFO:tasks.workunit.client.0.smithi043.stdout:6/585: getdents d1/d2a/db5/dc4 0 2024-04-25T23:01:08.160 INFO:tasks.workunit.client.0.smithi043.stdout:5/634: fsync d0/d2c/d39/d1c/d5e/f87 0 2024-04-25T23:01:08.160 INFO:tasks.workunit.client.0.smithi043.stdout:8/481: chown d3/d4/db/l21 981 1 2024-04-25T23:01:08.160 INFO:tasks.workunit.client.0.smithi043.stdout:2/515: mknod d2/d3/d13/ca1 0 2024-04-25T23:01:08.161 INFO:tasks.workunit.client.0.smithi043.stdout:4/672: dread - d3/d37/d4d/f92 zero size 2024-04-25T23:01:08.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/613: read d8/de/d44/d5d/d4f/f73 [759219,53504] 0 2024-04-25T23:01:08.161 INFO:tasks.workunit.client.0.smithi043.stdout:8/482: write d3/d4/d36/f82 [140077,118852] 0 2024-04-25T23:01:08.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/673: chown d3/d21/d6b/d87/c9d 535281287 1 2024-04-25T23:01:08.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/483: unlink d3/d4/db/f4b 0 2024-04-25T23:01:08.162 INFO:tasks.workunit.client.0.smithi043.stdout:2/516: mkdir d2/d66/d85/d76/d97/d77/da2 0 2024-04-25T23:01:08.164 INFO:tasks.workunit.client.0.smithi043.stdout:4/674: link d3/d19/l5d d3/d19/d34/dea/dc8/lf1 0 2024-04-25T23:01:08.168 INFO:tasks.workunit.client.0.smithi043.stdout:6/586: dwrite d1/d5/f65 [0,4194304] 0 2024-04-25T23:01:08.169 INFO:tasks.workunit.client.0.smithi043.stdout:5/635: dwrite d0/d2c/d39/dc4/fca [0,4194304] 0 2024-04-25T23:01:08.169 INFO:tasks.workunit.client.0.smithi043.stdout:5/636: chown d0/c4f 39911049 1 2024-04-25T23:01:08.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/614: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fb4 [0,4194304] 0 2024-04-25T23:01:08.170 INFO:tasks.workunit.client.0.smithi043.stdout:5/637: readlink d0/d2c/d39/d1c/d25/d7a/d2d/l4b 0 2024-04-25T23:01:08.171 INFO:tasks.workunit.client.0.smithi043.stdout:9/615: chown d8/de/d8c/cb6 100842536 1 2024-04-25T23:01:08.172 INFO:tasks.workunit.client.0.smithi043.stdout:9/616: fdatasync d8/fd 0 2024-04-25T23:01:08.172 INFO:tasks.workunit.client.0.smithi043.stdout:5/638: symlink d0/d2c/d39/d1c/ld4 0 2024-04-25T23:01:08.173 INFO:tasks.workunit.client.0.smithi043.stdout:5/639: fsync d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/fcc 0 2024-04-25T23:01:08.173 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:08.174 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:08.174 INFO:tasks.workunit.client.0.smithi043.stdout:3/709: dread d7/d26/d2d/f67 [0,4194304] 0 2024-04-25T23:01:08.174 INFO:tasks.workunit.client.0.smithi043.stdout:9/617: rename d8/de/d44/d5d/d4f/l74 to d8/de/d12/d16/d24/dbe/dc6/d2f/da6/ld1 0 2024-04-25T23:01:08.174 INFO:tasks.workunit.client.0.smithi043.stdout:3/710: write d7/d26/fca [391203,81054] 0 2024-04-25T23:01:08.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/711: mknod d7/cfe 0 2024-04-25T23:01:08.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/712: creat d7/d26/d2d/fff x:0 0 0 2024-04-25T23:01:08.177 INFO:tasks.workunit.client.0.smithi043.stdout:3/713: truncate d7/d26/d59/fbe 330949 0 2024-04-25T23:01:08.177 INFO:tasks.workunit.client.0.smithi043.stdout:5/640: write d0/f7c [946142,7335] 0 2024-04-25T23:01:08.178 INFO:tasks.workunit.client.0.smithi043.stdout:3/714: symlink d7/d26/d59/d7c/db2/d87/l100 0 2024-04-25T23:01:08.178 INFO:tasks.workunit.client.0.smithi043.stdout:5/641: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/fcc [221680,79959] 0 2024-04-25T23:01:08.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/715: mkdir d7/d26/d88/db8/d101 0 2024-04-25T23:01:08.180 INFO:tasks.workunit.client.0.smithi043.stdout:5/642: truncate d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/fcc 1077708 0 2024-04-25T23:01:08.181 INFO:tasks.workunit.client.0.smithi043.stdout:5/643: fsync d0/f9d 0 2024-04-25T23:01:08.181 INFO:tasks.workunit.client.0.smithi043.stdout:6/587: dread d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/f51 [0,4194304] 0 2024-04-25T23:01:08.181 INFO:tasks.workunit.client.0.smithi043.stdout:6/588: rmdir d1/d5 39 2024-04-25T23:01:08.182 INFO:tasks.workunit.client.0.smithi043.stdout:5/644: stat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fab 0 2024-04-25T23:01:08.182 INFO:tasks.workunit.client.0.smithi043.stdout:6/589: mkdir d1/dc8 0 2024-04-25T23:01:08.183 INFO:tasks.workunit.client.0.smithi043.stdout:5/645: fsync d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/fad 0 2024-04-25T23:01:08.186 INFO:tasks.workunit.client.0.smithi043.stdout:0/572: dwrite d1b/d23/f3e [0,4194304] 0 2024-04-25T23:01:08.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/573: truncate d1b/d55/f73 987186 0 2024-04-25T23:01:08.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/574: write d1b/d23/d39/db3/f88 [493203,22493] 0 2024-04-25T23:01:08.188 INFO:tasks.workunit.client.0.smithi043.stdout:0/575: dread - d1b/d23/d39/d90/f97 zero size 2024-04-25T23:01:08.196 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:08.200 INFO:tasks.workunit.client.0.smithi043.stdout:9/618: write d8/de/d12/d16/d24/f2a [788654,65788] 0 2024-04-25T23:01:08.201 INFO:tasks.workunit.client.0.smithi043.stdout:8/484: dwrite d3/d4/d7c/d92/d62/d6e/f74 [0,4194304] 0 2024-04-25T23:01:08.201 INFO:tasks.workunit.client.0.smithi043.stdout:2/517: dwrite d2/d66/d85/d43/d5d/f54 [0,4194304] 0 2024-04-25T23:01:08.204 INFO:tasks.workunit.client.0.smithi043.stdout:1/591: dread d0/f2 [0,4194304] 0 2024-04-25T23:01:08.204 INFO:tasks.workunit.client.0.smithi043.stdout:8/485: dread d3/d4/d36/f82 [0,4194304] 0 2024-04-25T23:01:08.205 INFO:tasks.workunit.client.0.smithi043.stdout:8/486: readlink d3/d4/db/l23 0 2024-04-25T23:01:08.205 INFO:tasks.workunit.client.0.smithi043.stdout:3/716: truncate d7/d26/d27/d34/f17 1894797 0 2024-04-25T23:01:08.206 INFO:tasks.workunit.client.0.smithi043.stdout:0/576: truncate d1b/d23/f3e 379631 0 2024-04-25T23:01:08.207 INFO:tasks.workunit.client.0.smithi043.stdout:1/592: write d0/d9/f21 [2633872,28116] 0 2024-04-25T23:01:08.208 INFO:tasks.workunit.client.0.smithi043.stdout:7/606: dread d3/d1e/f69 [0,4194304] 0 2024-04-25T23:01:08.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/577: mkdir d1b/d23/d7b/da6/db7 0 2024-04-25T23:01:08.210 INFO:tasks.workunit.client.0.smithi043.stdout:7/607: creat d3/da/df/d11/d8d/da4/fb9 x:0 0 0 2024-04-25T23:01:08.210 INFO:tasks.workunit.client.0.smithi043.stdout:6/590: fdatasync d1/d5/d3b/d62/fc1 0 2024-04-25T23:01:08.212 INFO:tasks.workunit.client.0.smithi043.stdout:8/487: write d3/d4/db/f2d [100466,127548] 0 2024-04-25T23:01:08.212 INFO:tasks.workunit.client.0.smithi043.stdout:1/593: creat d0/d2f/d4b/da6/fd9 x:0 0 0 2024-04-25T23:01:08.214 INFO:tasks.workunit.client.0.smithi043.stdout:6/591: write d1/d5/d3b/d4c/f25 [2842742,49675] 0 2024-04-25T23:01:08.217 INFO:tasks.workunit.client.0.smithi043.stdout:0/578: dwrite fb [0,4194304] 0 2024-04-25T23:01:08.217 INFO:tasks.workunit.client.0.smithi043.stdout:3/717: dwrite d7/d26/f78 [0,4194304] 0 2024-04-25T23:01:08.217 INFO:tasks.workunit.client.0.smithi043.stdout:6/592: truncate d1/d5/d3b/d4c/d21/fab 325670 0 2024-04-25T23:01:08.218 INFO:tasks.workunit.client.0.smithi043.stdout:0/579: fdatasync d1b/d23/d39/db3/f88 0 2024-04-25T23:01:08.218 INFO:tasks.workunit.client.0.smithi043.stdout:6/593: chown d1/d5/d3b/d4c/d1a 16 1 2024-04-25T23:01:08.218 INFO:tasks.workunit.client.0.smithi043.stdout:7/608: dwrite d3/da/f36 [0,4194304] 0 2024-04-25T23:01:08.218 INFO:tasks.workunit.client.0.smithi043.stdout:6/594: dread - d1/d5/d3b/db6/fb8 zero size 2024-04-25T23:01:08.221 INFO:tasks.workunit.client.0.smithi043.stdout:5/646: dread d0/d2c/d39/d1c/d25/d7a/d41/f86 [0,4194304] 0 2024-04-25T23:01:08.222 INFO:tasks.workunit.client.0.smithi043.stdout:3/718: creat d7/d26/d27/d34/d1a/d28/d9e/dcc/f102 x:0 0 0 2024-04-25T23:01:08.222 INFO:tasks.workunit.client.0.smithi043.stdout:0/580: creat d1b/d23/d7b/da6/fb8 x:0 0 0 2024-04-25T23:01:08.223 INFO:tasks.workunit.client.0.smithi043.stdout:7/609: mkdir d3/da/df/d11/d8d/dba 0 2024-04-25T23:01:08.223 INFO:tasks.workunit.client.0.smithi043.stdout:5/647: creat d0/d22/db8/fd5 x:0 0 0 2024-04-25T23:01:08.223 INFO:tasks.workunit.client.0.smithi043.stdout:6/595: mkdir d1/d2a/db5/dc4/dc9 0 2024-04-25T23:01:08.223 INFO:tasks.workunit.client.0.smithi043.stdout:0/581: rename d1b/d23/d39/db3/db4 to d1b/d23/d7b/da6/db7/db9 0 2024-04-25T23:01:08.224 INFO:tasks.workunit.client.0.smithi043.stdout:0/582: write d1b/d23/f2a [2823352,27554] 0 2024-04-25T23:01:08.225 INFO:tasks.workunit.client.0.smithi043.stdout:3/719: link d7/d26/d27/d34/d1a/cc0 d7/d26/d27/d34/c103 0 2024-04-25T23:01:08.226 INFO:tasks.workunit.client.0.smithi043.stdout:7/610: link d3/d1e/d1f/l5b d3/da/d64/lbb 0 2024-04-25T23:01:08.226 INFO:tasks.workunit.client.0.smithi043.stdout:0/583: mknod d1b/d8b/da2/cba 0 2024-04-25T23:01:08.227 INFO:tasks.workunit.client.0.smithi043.stdout:7/611: symlink d3/d9b/d63/lbc 0 2024-04-25T23:01:08.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/612: rename d3/d1e/c2c to d3/d52/cbd 0 2024-04-25T23:01:08.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/613: dread - d3/d1e/d1f/d54/fb5 zero size 2024-04-25T23:01:08.229 INFO:tasks.workunit.client.0.smithi043.stdout:7/614: creat d3/da/d78/fbe x:0 0 0 2024-04-25T23:01:08.229 INFO:tasks.workunit.client.0.smithi043.stdout:7/615: truncate d3/d9b/f66 145360 0 2024-04-25T23:01:08.229 INFO:tasks.workunit.client.0.smithi043.stdout:0/584: read d1b/d23/d39/f4b [1236065,92791] 0 2024-04-25T23:01:08.230 INFO:tasks.workunit.client.0.smithi043.stdout:0/585: fdatasync d1b/d31/f33 0 2024-04-25T23:01:08.230 INFO:tasks.workunit.client.0.smithi043.stdout:7/616: rename d3/l1c to d3/d9b/d63/lbf 0 2024-04-25T23:01:08.230 INFO:tasks.workunit.client.0.smithi043.stdout:0/586: fdatasync d1b/d23/f70 0 2024-04-25T23:01:08.231 INFO:tasks.workunit.client.0.smithi043.stdout:7/617: mknod d3/da/df/d79/d99/cc0 0 2024-04-25T23:01:08.233 INFO:tasks.workunit.client.0.smithi043.stdout:7/618: write d3/da/df/d11/d8d/d9f/fa2 [2189060,46804] 0 2024-04-25T23:01:08.234 INFO:tasks.workunit.client.0.smithi043.stdout:9/619: dread d8/de/d12/d16/d24/f28 [0,4194304] 0 2024-04-25T23:01:08.235 INFO:tasks.workunit.client.0.smithi043.stdout:9/620: mkdir d8/de/d44/d5d/dd2 0 2024-04-25T23:01:08.236 INFO:tasks.workunit.client.0.smithi043.stdout:0/587: dwrite d1b/d31/f33 [0,4194304] 0 2024-04-25T23:01:08.237 INFO:tasks.workunit.client.0.smithi043.stdout:0/588: chown d1b/d23/c30 675 1 2024-04-25T23:01:08.239 INFO:tasks.workunit.client.0.smithi043.stdout:8/488: sync 2024-04-25T23:01:08.239 INFO:tasks.workunit.client.0.smithi043.stdout:5/648: sync 2024-04-25T23:01:08.239 INFO:tasks.workunit.client.0.smithi043.stdout:0/589: getdents d1b/d23/d39/db3 0 2024-04-25T23:01:08.239 INFO:tasks.workunit.client.0.smithi043.stdout:8/489: chown d3/d4/db/d4e/c7e 3 1 2024-04-25T23:01:08.239 INFO:tasks.workunit.client.0.smithi043.stdout:0/590: rename d1b/d8b to d1b/d8b/d7d/dbb 22 2024-04-25T23:01:08.240 INFO:tasks.workunit.client.0.smithi043.stdout:8/490: mkdir d3/d4/db/d14/d56/d5d/d9c 0 2024-04-25T23:01:08.242 INFO:tasks.workunit.client.0.smithi043.stdout:7/619: truncate d3/da/df/f48 1879707 0 2024-04-25T23:01:08.242 INFO:tasks.workunit.client.0.smithi043.stdout:9/621: truncate d8/de/f10 11977710 0 2024-04-25T23:01:08.242 INFO:tasks.workunit.client.0.smithi043.stdout:0/591: rename d1b/d31/d3c/d50/c87 to d1b/d23/d7a/dad/cbc 0 2024-04-25T23:01:08.243 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:08.242+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:08.244 INFO:tasks.workunit.client.0.smithi043.stdout:9/622: rename d8/f5a to d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/fd3 0 2024-04-25T23:01:08.245 INFO:tasks.workunit.client.0.smithi043.stdout:0/592: mkdir d1b/d23/dab/dbd 0 2024-04-25T23:01:08.246 INFO:tasks.workunit.client.0.smithi043.stdout:4/675: dread d3/d21/d6b/d87/f8b [0,4194304] 0 2024-04-25T23:01:08.246 INFO:tasks.workunit.client.0.smithi043.stdout:0/593: chown d1b/d23/d7a/fa3 34 1 2024-04-25T23:01:08.247 INFO:tasks.workunit.client.0.smithi043.stdout:4/676: stat d3/de/d27 0 2024-04-25T23:01:08.247 INFO:tasks.workunit.client.0.smithi043.stdout:9/623: mknod d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/cd4 0 2024-04-25T23:01:08.248 INFO:tasks.workunit.client.0.smithi043.stdout:0/594: rename d1b/d55/ca7 to d1b/d7f/cbe 0 2024-04-25T23:01:08.248 INFO:tasks.workunit.client.0.smithi043.stdout:8/491: dwrite d3/d4/db/f4a [0,4194304] 0 2024-04-25T23:01:08.248 INFO:tasks.workunit.client.0.smithi043.stdout:9/624: read - d8/de/fce zero size 2024-04-25T23:01:08.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/595: stat d1b/d8b/cac 0 2024-04-25T23:01:08.253 INFO:tasks.workunit.client.0.smithi043.stdout:8/492: rename d3/d4/db/d14/c57 to d3/d4/db/d14/d56/d5d/c9d 0 2024-04-25T23:01:08.253 INFO:tasks.workunit.client.0.smithi043.stdout:7/620: sync 2024-04-25T23:01:08.254 INFO:tasks.workunit.client.0.smithi043.stdout:8/493: chown d3/d4/d98 7 1 2024-04-25T23:01:08.254 INFO:tasks.workunit.client.0.smithi043.stdout:0/596: dread d1b/d31/d3c/d72/f78 [0,4194304] 0 2024-04-25T23:01:08.255 INFO:tasks.workunit.client.0.smithi043.stdout:7/621: mkdir d3/dc1 0 2024-04-25T23:01:08.256 INFO:tasks.workunit.client.0.smithi043.stdout:7/622: write d3/d1e/f4d [7824653,60140] 0 2024-04-25T23:01:08.257 INFO:tasks.workunit.client.0.smithi043.stdout:8/494: truncate d3/d4/d7c/d92/d10/d33/f67 4269005 0 2024-04-25T23:01:08.258 INFO:tasks.workunit.client.0.smithi043.stdout:4/677: dwrite d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:08.258 INFO:tasks.workunit.client.0.smithi043.stdout:0/597: getdents d1b/d23/d39/db3 0 2024-04-25T23:01:08.258 INFO:tasks.workunit.client.0.smithi043.stdout:1/594: dread d0/d16/d5a/d5b/da4/f93 [0,4194304] 0 2024-04-25T23:01:08.259 INFO:tasks.workunit.client.0.smithi043.stdout:8/495: creat d3/d4/d7c/f9e x:0 0 0 2024-04-25T23:01:08.259 INFO:tasks.workunit.client.0.smithi043.stdout:7/623: rename d3/da/df/d11/d8d/la1 to d3/lc2 0 2024-04-25T23:01:08.260 INFO:tasks.workunit.client.0.smithi043.stdout:1/595: write d0/d9/fae [4675197,65980] 0 2024-04-25T23:01:08.261 INFO:tasks.workunit.client.0.smithi043.stdout:0/598: creat d1b/d23/d7a/dad/fbf x:0 0 0 2024-04-25T23:01:08.261 INFO:tasks.workunit.client.0.smithi043.stdout:7/624: stat d3/d1e/d1f/d6b/lac 0 2024-04-25T23:01:08.261 INFO:tasks.workunit.client.0.smithi043.stdout:2/518: dread d2/d66/d85/d43/d5d/f4d [0,4194304] 0 2024-04-25T23:01:08.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/596: dread - d0/f3a zero size 2024-04-25T23:01:08.262 INFO:tasks.workunit.client.0.smithi043.stdout:9/625: dwrite d8/de/d12/d16/f1f [0,4194304] 0 2024-04-25T23:01:08.262 INFO:tasks.workunit.client.0.smithi043.stdout:7/625: dread - d3/d1e/d1f/d54/fb5 zero size 2024-04-25T23:01:08.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/597: truncate d0/d3d/f95 952270 0 2024-04-25T23:01:08.262 INFO:tasks.workunit.client.0.smithi043.stdout:0/599: fdatasync d1b/d31/d3c/f7c 0 2024-04-25T23:01:08.263 INFO:tasks.workunit.client.0.smithi043.stdout:0/600: readlink d1b/d23/d39/db3/l9f 0 2024-04-25T23:01:08.264 INFO:tasks.workunit.client.0.smithi043.stdout:2/519: readlink d2/d3/d13/l83 0 2024-04-25T23:01:08.267 INFO:tasks.workunit.client.0.smithi043.stdout:4/678: dwrite d3/d21/d84/fc4 [0,4194304] 0 2024-04-25T23:01:08.268 INFO:tasks.workunit.client.0.smithi043.stdout:4/679: chown d3/de/c10 8 1 2024-04-25T23:01:08.268 INFO:tasks.workunit.client.0.smithi043.stdout:6/596: dread d1/f6a [0,4194304] 0 2024-04-25T23:01:08.269 INFO:tasks.workunit.client.0.smithi043.stdout:2/520: mkdir d2/d3/d13/d4f/da3 0 2024-04-25T23:01:08.269 INFO:tasks.workunit.client.0.smithi043.stdout:9/626: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fd5 x:0 0 0 2024-04-25T23:01:08.269 INFO:tasks.workunit.client.0.smithi043.stdout:0/601: mkdir d1b/d8b/dc0 0 2024-04-25T23:01:08.270 INFO:tasks.workunit.client.0.smithi043.stdout:9/627: sync 2024-04-25T23:01:08.270 INFO:tasks.workunit.client.0.smithi043.stdout:7/626: link d3/da/df/f8c d3/dc1/fc3 0 2024-04-25T23:01:08.270 INFO:tasks.workunit.client.0.smithi043.stdout:1/598: write d0/d9/d63/fba [403051,111647] 0 2024-04-25T23:01:08.270 INFO:tasks.workunit.client.0.smithi043.stdout:0/602: fsync d1b/d23/d7a/f98 0 2024-04-25T23:01:08.270 INFO:tasks.workunit.client.0.smithi043.stdout:4/680: symlink d3/d21/d6b/d87/d8a/de1/lf2 0 2024-04-25T23:01:08.271 INFO:tasks.workunit.client.0.smithi043.stdout:3/720: dread d7/d26/d2d/fa3 [0,4194304] 0 2024-04-25T23:01:08.271 INFO:tasks.workunit.client.0.smithi043.stdout:2/521: readlink d2/d66/d85/d43/d5d/l8b 0 2024-04-25T23:01:08.272 INFO:tasks.workunit.client.0.smithi043.stdout:7/627: mknod d3/cc4 0 2024-04-25T23:01:08.272 INFO:tasks.workunit.client.0.smithi043.stdout:8/496: truncate d3/d4/d7c/d92/d10/d33/f1a 2955521 0 2024-04-25T23:01:08.272 INFO:tasks.workunit.client.0.smithi043.stdout:1/599: link d0/f3a d0/d3c/fda 0 2024-04-25T23:01:08.273 INFO:tasks.workunit.client.0.smithi043.stdout:2/522: creat d2/d66/d85/d76/d97/d77/da2/fa4 x:0 0 0 2024-04-25T23:01:08.273 INFO:tasks.workunit.client.0.smithi043.stdout:2/523: sync 2024-04-25T23:01:08.273 INFO:tasks.workunit.client.0.smithi043.stdout:7/628: fsync d3/da/df/d11/d26/f74 0 2024-04-25T23:01:08.273 INFO:tasks.workunit.client.0.smithi043.stdout:8/497: write d3/d4/d7c/d92/d10/f3b [2815727,106873] 0 2024-04-25T23:01:08.274 INFO:tasks.workunit.client.0.smithi043.stdout:6/597: mknod d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/dc2/cca 0 2024-04-25T23:01:08.274 INFO:tasks.workunit.client.0.smithi043.stdout:3/721: creat d7/d26/d27/d34/f104 x:0 0 0 2024-04-25T23:01:08.274 INFO:tasks.workunit.client.0.smithi043.stdout:4/681: link d3/d21/d6b/d87/d8a/cee d3/d19/cf3 0 2024-04-25T23:01:08.275 INFO:tasks.workunit.client.0.smithi043.stdout:9/628: link d8/de/d12/d16/d24/dbe/dc6/d2f/da6/lb3 d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/ld6 0 2024-04-25T23:01:08.275 INFO:tasks.workunit.client.0.smithi043.stdout:6/598: mkdir d1/d2a/db5/dcb 0 2024-04-25T23:01:08.275 INFO:tasks.workunit.client.0.smithi043.stdout:4/682: chown d3/d21/f30 16296 1 2024-04-25T23:01:08.276 INFO:tasks.workunit.client.0.smithi043.stdout:2/524: link d2/l2a d2/d3/d13/d40/la5 0 2024-04-25T23:01:08.276 INFO:tasks.workunit.client.0.smithi043.stdout:3/722: creat d7/d26/d88/db0/f105 x:0 0 0 2024-04-25T23:01:08.276 INFO:tasks.workunit.client.0.smithi043.stdout:7/629: rename d3/da/df/d79 to d3/d1e/d1f/dc5 0 2024-04-25T23:01:08.277 INFO:tasks.workunit.client.0.smithi043.stdout:7/630: stat d3/fad 0 2024-04-25T23:01:08.277 INFO:tasks.workunit.client.0.smithi043.stdout:6/599: chown d1/d5/d3b/d4c/d21/d55/la4 117 1 2024-04-25T23:01:08.277 INFO:tasks.workunit.client.0.smithi043.stdout:8/498: rename d3/d4/d7c/d92/d10 to d3/d4/db/d4e/d8b/d9f 0 2024-04-25T23:01:08.279 INFO:tasks.workunit.client.0.smithi043.stdout:9/629: write d8/de/d44/d5d/da1/fcd [1662953,122697] 0 2024-04-25T23:01:08.280 INFO:tasks.workunit.client.0.smithi043.stdout:5/649: dread d0/d2c/d39/d1c/f55 [0,4194304] 0 2024-04-25T23:01:08.281 INFO:tasks.workunit.client.0.smithi043.stdout:8/499: creat d3/d4/db/d4e/d5c/d59/d61/fa0 x:0 0 0 2024-04-25T23:01:08.281 INFO:tasks.workunit.client.0.smithi043.stdout:3/723: link d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/fe7 d7/d26/d27/d34/f106 0 2024-04-25T23:01:08.285 INFO:tasks.workunit.client.0.smithi043.stdout:0/603: dwrite d1b/d23/d39/f4b [0,4194304] 0 2024-04-25T23:01:08.286 INFO:tasks.workunit.client.0.smithi043.stdout:8/500: chown d3/d4/db/d4e/d8b/d9f/c2f 46163327 1 2024-04-25T23:01:08.287 INFO:tasks.workunit.client.0.smithi043.stdout:7/631: dwrite d3/fad [0,4194304] 0 2024-04-25T23:01:08.287 INFO:tasks.workunit.client.0.smithi043.stdout:1/600: dwrite d0/d2f/d4b/f7c [0,4194304] 0 2024-04-25T23:01:08.288 INFO:tasks.workunit.client.0.smithi043.stdout:5/650: creat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62/fd6 x:0 0 0 2024-04-25T23:01:08.289 INFO:tasks.workunit.client.0.smithi043.stdout:6/600: dwrite d1/f78 [0,4194304] 0 2024-04-25T23:01:08.289 INFO:tasks.workunit.client.0.smithi043.stdout:7/632: stat d3/da/df/d11 0 2024-04-25T23:01:08.289 INFO:tasks.workunit.client.0.smithi043.stdout:8/501: fsync d3/d4/d7c/d92/d62/d6e/f74 0 2024-04-25T23:01:08.289 INFO:tasks.workunit.client.0.smithi043.stdout:0/604: chown d1b/d31/d3c/f52 228047278 1 2024-04-25T23:01:08.290 INFO:tasks.workunit.client.0.smithi043.stdout:0/605: stat d1b/d31/d3c/d72/f78 0 2024-04-25T23:01:08.291 INFO:tasks.workunit.client.0.smithi043.stdout:9/630: dwrite d8/de/d12/d16/f40 [0,4194304] 0 2024-04-25T23:01:08.292 INFO:tasks.workunit.client.0.smithi043.stdout:0/606: write d1b/d31/d3c/d50/f9b [4178553,54414] 0 2024-04-25T23:01:08.293 INFO:tasks.workunit.client.0.smithi043.stdout:9/631: dread - d8/de/d12/d16/d24/dbe/dc6/f9b zero size 2024-04-25T23:01:08.294 INFO:tasks.workunit.client.0.smithi043.stdout:8/502: mknod d3/d4/db/d4e/d5c/d2e/ca1 0 2024-04-25T23:01:08.296 INFO:tasks.workunit.client.0.smithi043.stdout:5/651: creat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fd7 x:0 0 0 2024-04-25T23:01:08.296 INFO:tasks.workunit.client.0.smithi043.stdout:6/601: link d1/d5/d3b/d4c/f6b d1/d5/d3b/d4c/d21/d55/d6d/fcc 0 2024-04-25T23:01:08.296 INFO:tasks.workunit.client.0.smithi043.stdout:8/503: symlink d3/d4/db/d4e/d5c/la2 0 2024-04-25T23:01:08.297 INFO:tasks.workunit.client.0.smithi043.stdout:1/601: dwrite d0/d2f/d4b/f7c [0,4194304] 0 2024-04-25T23:01:08.297 INFO:tasks.workunit.client.0.smithi043.stdout:9/632: creat d8/de/d44/d47/fd7 x:0 0 0 2024-04-25T23:01:08.298 INFO:tasks.workunit.client.0.smithi043.stdout:7/633: dwrite d3/da/f44 [0,4194304] 0 2024-04-25T23:01:08.298 INFO:tasks.workunit.client.0.smithi043.stdout:7/634: sync 2024-04-25T23:01:08.298 INFO:tasks.workunit.client.0.smithi043.stdout:8/504: mknod d3/d4/ca3 0 2024-04-25T23:01:08.299 INFO:tasks.workunit.client.0.smithi043.stdout:5/652: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/fd8 x:0 0 0 2024-04-25T23:01:08.300 INFO:tasks.workunit.client.0.smithi043.stdout:6/602: mkdir d1/d5/d3b/d4c/d1a/dcd 0 2024-04-25T23:01:08.300 INFO:tasks.workunit.client.0.smithi043.stdout:9/633: unlink d8/de/d12/d16/d24/f33 0 2024-04-25T23:01:08.300 INFO:tasks.workunit.client.0.smithi043.stdout:1/602: creat d0/d9/fdb x:0 0 0 2024-04-25T23:01:08.301 INFO:tasks.workunit.client.0.smithi043.stdout:6/603: fsync d1/d5/d3b/d4c/d21/f97 0 2024-04-25T23:01:08.301 INFO:tasks.workunit.client.0.smithi043.stdout:5/653: write d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/faa [5209464,48453] 0 2024-04-25T23:01:08.302 INFO:tasks.workunit.client.0.smithi043.stdout:7/635: truncate d3/da/d78/fbe 388498 0 2024-04-25T23:01:08.304 INFO:tasks.workunit.client.0.smithi043.stdout:5/654: fsync d0/d2c/d39/d63/f93 0 2024-04-25T23:01:08.304 INFO:tasks.workunit.client.0.smithi043.stdout:1/603: mkdir d0/d9/ddc 0 2024-04-25T23:01:08.304 INFO:tasks.workunit.client.0.smithi043.stdout:7/636: write d3/d9b/d63/d98/f9a [3003202,23238] 0 2024-04-25T23:01:08.306 INFO:tasks.workunit.client.0.smithi043.stdout:1/604: symlink d0/d16/d5a/d5b/da4/ldd 0 2024-04-25T23:01:08.306 INFO:tasks.workunit.client.0.smithi043.stdout:5/655: fdatasync d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 0 2024-04-25T23:01:08.307 INFO:tasks.workunit.client.0.smithi043.stdout:7/637: getdents d3/da/df/d11 0 2024-04-25T23:01:08.307 INFO:tasks.workunit.client.0.smithi043.stdout:8/505: dwrite d3/d4/db/d4e/d5c/f84 [0,4194304] 0 2024-04-25T23:01:08.308 INFO:tasks.workunit.client.0.smithi043.stdout:1/605: chown d0/d3d/d4f 45877312 1 2024-04-25T23:01:08.309 INFO:tasks.workunit.client.0.smithi043.stdout:1/606: fsync d0/d16/d5a/f6e 0 2024-04-25T23:01:08.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/604: dwrite d1/d5/d3b/d62/fc1 [0,4194304] 0 2024-04-25T23:01:08.309 INFO:tasks.workunit.client.0.smithi043.stdout:7/638: symlink d3/da/d78/lc6 0 2024-04-25T23:01:08.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/656: unlink d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/cd0 0 2024-04-25T23:01:08.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/605: mknod d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/cce 0 2024-04-25T23:01:08.311 INFO:tasks.workunit.client.0.smithi043.stdout:1/607: symlink d0/d2f/d4b/lde 0 2024-04-25T23:01:08.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/639: link d3/l91 d3/d1e/d1f/d6b/d72/lc7 0 2024-04-25T23:01:08.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/606: write d1/d5/d3b/d4c/d21/d55/d68/d30/f35 [1601166,31322] 0 2024-04-25T23:01:08.312 INFO:tasks.workunit.client.0.smithi043.stdout:5/657: getdents d0/d2c/d39/d1c/d25/d7a/d2d/d5f 0 2024-04-25T23:01:08.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/608: mknod d0/dce/cdf 0 2024-04-25T23:01:08.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/640: symlink d3/da/df/d11/d8d/lc8 0 2024-04-25T23:01:08.314 INFO:tasks.workunit.client.0.smithi043.stdout:5/658: rmdir d0/d2c/d39/dc4 39 2024-04-25T23:01:08.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/607: creat d1/d5/d3b/d4c/d21/d38/d99/fcf x:0 0 0 2024-04-25T23:01:08.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/609: symlink d0/d16/d5a/d5b/le0 0 2024-04-25T23:01:08.315 INFO:tasks.workunit.client.0.smithi043.stdout:5/659: symlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/ld9 0 2024-04-25T23:01:08.315 INFO:tasks.workunit.client.0.smithi043.stdout:1/610: creat d0/d2f/d4b/d8f/fe1 x:0 0 0 2024-04-25T23:01:08.316 INFO:tasks.workunit.client.0.smithi043.stdout:0/607: read d1b/d31/d3c/d50/f9b [223337,50671] 0 2024-04-25T23:01:08.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/634: write d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/f3f [575405,22326] 0 2024-04-25T23:01:08.316 INFO:tasks.workunit.client.0.smithi043.stdout:0/608: sync 2024-04-25T23:01:08.316 INFO:tasks.workunit.client.0.smithi043.stdout:8/506: write d3/d4/db/d14/f2c [510631,48596] 0 2024-04-25T23:01:08.317 INFO:tasks.workunit.client.0.smithi043.stdout:6/608: link d1/d5/d3b/d4c/f93 d1/d2a/db5/dcb/fd0 0 2024-04-25T23:01:08.317 INFO:tasks.workunit.client.0.smithi043.stdout:9/635: dread - d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fb9 zero size 2024-04-25T23:01:08.318 INFO:tasks.workunit.client.0.smithi043.stdout:6/609: mknod d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/cd1 0 2024-04-25T23:01:08.319 INFO:tasks.workunit.client.0.smithi043.stdout:7/641: read d3/d1e/f50 [1157420,50492] 0 2024-04-25T23:01:08.319 INFO:tasks.workunit.client.0.smithi043.stdout:6/610: readlink d1/d5/d3b/d4c/d21/d55/d68/d30/l40 0 2024-04-25T23:01:08.320 INFO:tasks.workunit.client.0.smithi043.stdout:9/636: write d8/de/d44/d47/f8a [163172,108673] 0 2024-04-25T23:01:08.321 INFO:tasks.workunit.client.0.smithi043.stdout:7/642: mkdir d3/d9b/d63/dc9 0 2024-04-25T23:01:08.321 INFO:tasks.workunit.client.0.smithi043.stdout:9/637: write d8/de/d12/fa2 [547713,112167] 0 2024-04-25T23:01:08.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/643: truncate d3/d9b/f80 121807 0 2024-04-25T23:01:08.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/644: readlink d3/d1e/l4f 0 2024-04-25T23:01:08.324 INFO:tasks.workunit.client.0.smithi043.stdout:9/638: link d8/de/d44/d47/fd7 d8/de/d44/d47/d6a/fd8 0 2024-04-25T23:01:08.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/611: chown d1/l84 2613 1 2024-04-25T23:01:08.324 INFO:tasks.workunit.client.0.smithi043.stdout:7/645: unlink d3/da/df/d11/d26/l2d 0 2024-04-25T23:01:08.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/611: truncate d0/d16/f4a 2389400 0 2024-04-25T23:01:08.325 INFO:tasks.workunit.client.0.smithi043.stdout:5/660: dwrite d0/f9d [0,4194304] 0 2024-04-25T23:01:08.325 INFO:tasks.workunit.client.0.smithi043.stdout:0/609: truncate d1b/d8b/f9c 3653446 0 2024-04-25T23:01:08.326 INFO:tasks.workunit.client.0.smithi043.stdout:0/610: write d1b/d31/f6c [4080620,63940] 0 2024-04-25T23:01:08.326 INFO:tasks.workunit.client.0.smithi043.stdout:5/661: chown d0/d2c/d39/d1c/d25/d7a/d41/d47/c4d 2 1 2024-04-25T23:01:08.327 INFO:tasks.workunit.client.0.smithi043.stdout:0/611: dread - d1b/fa4 zero size 2024-04-25T23:01:08.327 INFO:tasks.workunit.client.0.smithi043.stdout:7/646: mknod d3/d9b/cca 0 2024-04-25T23:01:08.327 INFO:tasks.workunit.client.0.smithi043.stdout:5/662: stat d0/d2c/d39/d1c/d25/d7a/d2d/f74 0 2024-04-25T23:01:08.328 INFO:tasks.workunit.client.0.smithi043.stdout:0/612: write d1b/d23/d7a/f98 [64118,7143] 0 2024-04-25T23:01:08.328 INFO:tasks.workunit.client.0.smithi043.stdout:7/647: readlink d3/da/df/d11/l14 0 2024-04-25T23:01:08.328 INFO:tasks.workunit.client.0.smithi043.stdout:9/639: symlink d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/ld9 0 2024-04-25T23:01:08.329 INFO:tasks.workunit.client.0.smithi043.stdout:0/613: symlink d1b/d8b/d7d/lc1 0 2024-04-25T23:01:08.330 INFO:tasks.workunit.client.0.smithi043.stdout:6/612: getdents d1/d2a/db5 0 2024-04-25T23:01:08.332 INFO:tasks.workunit.client.0.smithi043.stdout:7/648: creat d3/da/df/fcb x:0 0 0 2024-04-25T23:01:08.332 INFO:tasks.workunit.client.0.smithi043.stdout:0/614: rmdir d1b/d23/d7a/dad 39 2024-04-25T23:01:08.332 INFO:tasks.workunit.client.0.smithi043.stdout:2/525: dread d2/d3/d13/f32 [0,4194304] 0 2024-04-25T23:01:08.333 INFO:tasks.workunit.client.0.smithi043.stdout:0/615: creat d1b/d23/dab/fc2 x:0 0 0 2024-04-25T23:01:08.333 INFO:tasks.workunit.client.0.smithi043.stdout:9/640: mknod d8/de/d12/d16/d24/dbe/dc6/d2f/dad/cda 0 2024-04-25T23:01:08.333 INFO:tasks.workunit.client.0.smithi043.stdout:6/613: rmdir d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/dc2 39 2024-04-25T23:01:08.334 INFO:tasks.workunit.client.0.smithi043.stdout:1/612: dwrite d0/d9/f80 [0,4194304] 0 2024-04-25T23:01:08.334 INFO:tasks.workunit.client.0.smithi043.stdout:0/616: fsync d1b/f40 0 2024-04-25T23:01:08.334 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:08.330+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:08.335 INFO:tasks.workunit.client.0.smithi043.stdout:7/649: link d3/da/d64/lbb d3/d52/lcc 0 2024-04-25T23:01:08.335 INFO:tasks.workunit.client.0.smithi043.stdout:6/614: creat d1/dc8/fd2 x:0 0 0 2024-04-25T23:01:08.335 INFO:tasks.workunit.client.0.smithi043.stdout:9/641: creat d8/de/d44/d5d/fdb x:0 0 0 2024-04-25T23:01:08.335 INFO:tasks.workunit.client.0.smithi043.stdout:0/617: stat d1b/d23/d39/db3 0 2024-04-25T23:01:08.337 INFO:tasks.workunit.client.0.smithi043.stdout:0/618: dread - d1b/d8b/da2/fa8 zero size 2024-04-25T23:01:08.337 INFO:tasks.workunit.client.0.smithi043.stdout:1/613: rename d0/d9/c5d to d0/d16/d5a/d5b/da4/dbf/ce2 0 2024-04-25T23:01:08.338 INFO:tasks.workunit.client.0.smithi043.stdout:1/614: fsync d0/d9/faf 0 2024-04-25T23:01:08.338 INFO:tasks.workunit.client.0.smithi043.stdout:5/663: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/f83 [4194304,4194304] 0 2024-04-25T23:01:08.339 INFO:tasks.workunit.client.0.smithi043.stdout:7/650: creat d3/da/fcd x:0 0 0 2024-04-25T23:01:08.341 INFO:tasks.workunit.client.0.smithi043.stdout:0/619: truncate d1b/d31/d3c/f6a 821996 0 2024-04-25T23:01:08.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/615: rename d1/lb4 to d1/d5/d3b/d4c/ld3 0 2024-04-25T23:01:08.341 INFO:tasks.workunit.client.0.smithi043.stdout:2/526: dwrite d2/d66/d85/d43/d67/d8d/f19 [0,4194304] 0 2024-04-25T23:01:08.341 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:01:08.342 INFO:tasks.workunit.client.0.smithi043.stdout:9/642: dread d8/de/d12/d16/d24/dbe/dc6/d2f/f43 [0,4194304] 0 2024-04-25T23:01:08.342 INFO:tasks.workunit.client.0.smithi043.stdout:2/527: write d2/d3/d13/d40/f51 [1325616,104743] 0 2024-04-25T23:01:08.344 INFO:tasks.workunit.client.0.smithi043.stdout:5/664: creat d0/d2c/d39/d1c/d25/d7a/fda x:0 0 0 2024-04-25T23:01:08.344 INFO:tasks.workunit.client.0.smithi043.stdout:7/651: creat d3/da/fce x:0 0 0 2024-04-25T23:01:08.345 INFO:tasks.workunit.client.0.smithi043.stdout:3/724: dread d7/d26/d27/d34/d1a/f50 [0,4194304] 0 2024-04-25T23:01:08.346 INFO:tasks.workunit.client.0.smithi043.stdout:9/643: mknod d8/de/d8c/cdc 0 2024-04-25T23:01:08.346 INFO:tasks.workunit.client.0.smithi043.stdout:3/725: write d7/f2a [5107192,77229] 0 2024-04-25T23:01:08.346 INFO:tasks.workunit.client.0.smithi043.stdout:4/683: dread d3/de/f49 [0,4194304] 0 2024-04-25T23:01:08.347 INFO:tasks.workunit.client.0.smithi043.stdout:7/652: mkdir d3/dc1/dcf 0 2024-04-25T23:01:08.347 INFO:tasks.workunit.client.0.smithi043.stdout:0/620: dread d1b/f4a [0,4194304] 0 2024-04-25T23:01:08.347 INFO:tasks.workunit.client.0.smithi043.stdout:5/665: mknod d0/d2c/d39/d1c/d25/d7a/cdb 0 2024-04-25T23:01:08.347 INFO:tasks.workunit.client.0.smithi043.stdout:9/644: unlink d8/c6f 0 2024-04-25T23:01:08.347 INFO:tasks.workunit.client.0.smithi043.stdout:2/528: creat d2/d3/d13/fa6 x:0 0 0 2024-04-25T23:01:08.347 INFO:tasks.workunit.client.0.smithi043.stdout:0/621: readlink d1b/l21 0 2024-04-25T23:01:08.348 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:08.348 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:08.349 INFO:tasks.workunit.client.0.smithi043.stdout:0/622: mkdir d1b/d8b/d7d/dc3 0 2024-04-25T23:01:08.349 INFO:tasks.workunit.client.0.smithi043.stdout:6/616: link d1/d5/d3b/d4c/d21/d38/d60/l86 d1/d5/d3b/d4c/d21/d38/d99/ld4 0 2024-04-25T23:01:08.349 INFO:tasks.workunit.client.0.smithi043.stdout:5/666: creat d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/fdc x:0 0 0 2024-04-25T23:01:08.350 INFO:tasks.workunit.client.0.smithi043.stdout:0/623: truncate d1b/d8b/f85 233555 0 2024-04-25T23:01:08.350 INFO:tasks.workunit.client.0.smithi043.stdout:6/617: mkdir d1/d2a/dd5 0 2024-04-25T23:01:08.351 INFO:tasks.workunit.client.0.smithi043.stdout:2/529: link d2/d66/d85/d76/d97/c68 d2/d66/d85/d76/d97/ca7 0 2024-04-25T23:01:08.351 INFO:tasks.workunit.client.0.smithi043.stdout:9/645: dread d8/de/d12/d16/d24/f28 [4194304,4194304] 0 2024-04-25T23:01:08.352 INFO:tasks.workunit.client.0.smithi043.stdout:2/530: rename d2/f75 to d2/fa8 0 2024-04-25T23:01:08.354 INFO:tasks.workunit.client.0.smithi043.stdout:9/646: rename d8/de/l22 to d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/ldd 0 2024-04-25T23:01:08.355 INFO:tasks.workunit.client.0.smithi043.stdout:4/684: dwrite d3/d21/f25 [0,4194304] 0 2024-04-25T23:01:08.355 INFO:tasks.workunit.client.0.smithi043.stdout:3/726: dread d7/d26/d2d/f36 [0,4194304] 0 2024-04-25T23:01:08.356 INFO:tasks.workunit.client.0.smithi043.stdout:7/653: truncate d3/d1e/d1f/f51 1374816 0 2024-04-25T23:01:08.357 INFO:tasks.workunit.client.0.smithi043.stdout:3/727: symlink d7/d26/d27/l107 0 2024-04-25T23:01:08.358 INFO:tasks.workunit.client.0.smithi043.stdout:3/728: creat d7/d26/d27/d34/d1a/d40/d8f/dd0/f108 x:0 0 0 2024-04-25T23:01:08.359 INFO:tasks.workunit.client.0.smithi043.stdout:3/729: write d7/d26/d88/db0/ff9 [501715,107278] 0 2024-04-25T23:01:08.360 INFO:tasks.workunit.client.0.smithi043.stdout:6/618: dread d1/d5/d3b/d4c/d21/d55/d68/d30/f3d [0,4194304] 0 2024-04-25T23:01:08.360 INFO:tasks.workunit.client.0.smithi043.stdout:3/730: mknod d7/d26/c109 0 2024-04-25T23:01:08.365 INFO:tasks.workunit.client.0.smithi043.stdout:7/654: truncate d3/da/df/d11/f15 728598 0 2024-04-25T23:01:08.368 INFO:tasks.workunit.client.0.smithi043.stdout:6/619: dwrite d1/d5/d3b/db6/fb8 [0,4194304] 0 2024-04-25T23:01:08.369 INFO:tasks.workunit.client.0.smithi043.stdout:3/731: dwrite d7/d26/d59/d7c/fa1 [0,4194304] 0 2024-04-25T23:01:08.374 INFO:tasks.workunit.client.0.smithi043.stdout:8/507: dread d3/d4/db/d4e/d8b/d9f/f3b [0,4194304] 0 2024-04-25T23:01:08.375 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:08.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/615: dread d0/d9/f9e [4194304,4194304] 0 2024-04-25T23:01:08.379 INFO:tasks.workunit.client.0.smithi043.stdout:1/616: write d0/d9/d63/f90 [1106613,86239] 0 2024-04-25T23:01:08.380 INFO:tasks.workunit.client.0.smithi043.stdout:1/617: write d0/d3d/f95 [1563141,52865] 0 2024-04-25T23:01:08.380 INFO:tasks.workunit.client.0.smithi043.stdout:1/618: dread - d0/d2f/f61 zero size 2024-04-25T23:01:08.381 INFO:tasks.workunit.client.0.smithi043.stdout:8/508: dwrite d3/d4/d7c/f9e [0,4194304] 0 2024-04-25T23:01:08.383 INFO:tasks.workunit.client.0.smithi043.stdout:8/509: chown d3/d4/db/d4e/c7e 52547445 1 2024-04-25T23:01:08.383 INFO:tasks.workunit.client.0.smithi043.stdout:5/667: dread d0/d2c/d39/d1c/d25/d7a/f44 [0,4194304] 0 2024-04-25T23:01:08.384 INFO:tasks.workunit.client.0.smithi043.stdout:6/620: dread d1/d5/d3b/d4c/d21/f97 [0,4194304] 0 2024-04-25T23:01:08.387 INFO:tasks.workunit.client.0.smithi043.stdout:1/619: dwrite d0/d16/d5a/d5b/f70 [0,4194304] 0 2024-04-25T23:01:08.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/510: creat d3/d4/d7c/d92/fa4 x:0 0 0 2024-04-25T23:01:08.391 INFO:tasks.workunit.client.0.smithi043.stdout:7/655: dread d3/d1e/d1f/f51 [0,4194304] 0 2024-04-25T23:01:08.391 INFO:tasks.workunit.client.0.smithi043.stdout:6/621: link d1/d5/f95 d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/fd6 0 2024-04-25T23:01:08.392 INFO:tasks.workunit.client.0.smithi043.stdout:5/668: getdents d0/d2c/d39/dc4 0 2024-04-25T23:01:08.393 INFO:tasks.workunit.client.0.smithi043.stdout:0/624: dread d1b/d31/d3c/f52 [0,4194304] 0 2024-04-25T23:01:08.393 INFO:tasks.workunit.client.0.smithi043.stdout:7/656: link d3/da/fcd d3/da/d64/fd0 0 2024-04-25T23:01:08.394 INFO:tasks.workunit.client.0.smithi043.stdout:7/657: stat d3/da/d78/fbe 0 2024-04-25T23:01:08.394 INFO:tasks.workunit.client.0.smithi043.stdout:0/625: chown d1b/d55/f73 2 1 2024-04-25T23:01:08.395 INFO:tasks.workunit.client.0.smithi043.stdout:0/626: truncate d1b/d31/fb5 139507 0 2024-04-25T23:01:08.396 INFO:tasks.workunit.client.0.smithi043.stdout:6/622: dread d1/d5/d3b/d4c/d21/d55/fa6 [0,4194304] 0 2024-04-25T23:01:08.396 INFO:tasks.workunit.client.0.smithi043.stdout:5/669: truncate d0/d22/f76 1153482 0 2024-04-25T23:01:08.396 INFO:tasks.workunit.client.0.smithi043.stdout:0/627: getdents d1b/db0 0 2024-04-25T23:01:08.396 INFO:tasks.workunit.client.0.smithi043.stdout:6/623: chown d1/d5/d3b/d4c/d21/d55/d6d/d91 2 1 2024-04-25T23:01:08.397 INFO:tasks.workunit.client.0.smithi043.stdout:5/670: fdatasync d0/d2c/d39/d1c/f2b 0 2024-04-25T23:01:08.397 INFO:tasks.workunit.client.0.smithi043.stdout:0/628: write d1b/f56 [1185949,19766] 0 2024-04-25T23:01:08.397 INFO:tasks.workunit.client.0.smithi043.stdout:5/671: write d0/f9d [3204364,103817] 0 2024-04-25T23:01:08.398 INFO:tasks.workunit.client.0.smithi043.stdout:6/624: symlink d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/ld7 0 2024-04-25T23:01:08.398 INFO:tasks.workunit.client.0.smithi043.stdout:0/629: link d1b/f4a d1b/d8b/fc4 0 2024-04-25T23:01:08.399 INFO:tasks.workunit.client.0.smithi043.stdout:5/672: chown d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 4 1 2024-04-25T23:01:08.399 INFO:tasks.workunit.client.0.smithi043.stdout:7/658: write d3/d1e/f69 [3403210,62079] 0 2024-04-25T23:01:08.400 INFO:tasks.workunit.client.0.smithi043.stdout:6/625: creat d1/d2a/db5/dc4/dc9/fd8 x:0 0 0 2024-04-25T23:01:08.401 INFO:tasks.workunit.client.0.smithi043.stdout:7/659: fsync d3/da/df/d11/d26/f83 0 2024-04-25T23:01:08.401 INFO:tasks.workunit.client.0.smithi043.stdout:6/626: fsync d1/d5/d3b/d4c/d21/d38/f87 0 2024-04-25T23:01:08.403 INFO:tasks.workunit.client.0.smithi043.stdout:5/673: link d0/d2c/d39/d1c/d25/d7a/d41/d47/f8e d0/d2c/d39/d1c/d25/d7a/d2d/fdd 0 2024-04-25T23:01:08.403 INFO:tasks.workunit.client.0.smithi043.stdout:7/660: creat d3/d9b/d63/d98/fd1 x:0 0 0 2024-04-25T23:01:08.403 INFO:tasks.workunit.client.0.smithi043.stdout:7/661: stat d3/f19 0 2024-04-25T23:01:08.404 INFO:tasks.workunit.client.0.smithi043.stdout:7/662: fdatasync d3/da/df/d11/f93 0 2024-04-25T23:01:08.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/732: dread d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/faa [0,4194304] 0 2024-04-25T23:01:08.405 INFO:tasks.workunit.client.0.smithi043.stdout:7/663: creat d3/d1e/fd2 x:0 0 0 2024-04-25T23:01:08.406 INFO:tasks.workunit.client.0.smithi043.stdout:7/664: write d3/d9b/f92 [1456819,78184] 0 2024-04-25T23:01:08.407 INFO:tasks.workunit.client.0.smithi043.stdout:3/733: mknod d7/d26/d27/d34/d1a/d40/d8f/d51/c10a 0 2024-04-25T23:01:08.408 INFO:tasks.workunit.client.0.smithi043.stdout:7/665: mkdir d3/da/df/d11/d8d/dd3 0 2024-04-25T23:01:08.409 INFO:tasks.workunit.client.0.smithi043.stdout:3/734: mkdir d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/d10b 0 2024-04-25T23:01:08.409 INFO:tasks.workunit.client.0.smithi043.stdout:5/674: dwrite d0/d22/f6d [4194304,4194304] 0 2024-04-25T23:01:08.414 INFO:tasks.workunit.client.0.smithi043.stdout:3/735: rename d7/d26/d27/d34/d1a/d28/f3c to d7/d26/d27/d34/d1a/d40/d8f/d51/f10c 0 2024-04-25T23:01:08.415 INFO:tasks.workunit.client.0.smithi043.stdout:5/675: rmdir d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1 39 2024-04-25T23:01:08.415 INFO:tasks.workunit.client.0.smithi043.stdout:8/511: dread d3/d4/db/d14/d4c/d68/f7a [0,4194304] 0 2024-04-25T23:01:08.416 INFO:tasks.workunit.client.0.smithi043.stdout:7/666: dwrite d3/da/df/d11/f94 [0,4194304] 0 2024-04-25T23:01:08.416 INFO:tasks.workunit.client.0.smithi043.stdout:3/736: mkdir d7/d26/d59/d7c/d10d 0 2024-04-25T23:01:08.416 INFO:tasks.workunit.client.0.smithi043.stdout:5/676: rmdir d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85 39 2024-04-25T23:01:08.416 INFO:tasks.workunit.client.0.smithi043.stdout:7/667: mkdir d3/da/d78/dd4 0 2024-04-25T23:01:08.417 INFO:tasks.workunit.client.0.smithi043.stdout:5/677: symlink d0/d2c/d39/d1c/d5e/lde 0 2024-04-25T23:01:08.418 INFO:tasks.workunit.client.0.smithi043.stdout:7/668: write d3/d9b/d63/d98/fd1 [38398,63547] 0 2024-04-25T23:01:08.418 INFO:tasks.workunit.client.0.smithi043.stdout:3/737: mkdir d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/d10b/d10e 0 2024-04-25T23:01:08.418 INFO:tasks.workunit.client.0.smithi043.stdout:5/678: getdents d0/d2c/d39/dc4 0 2024-04-25T23:01:08.418 INFO:tasks.workunit.client.0.smithi043.stdout:7/669: chown d3/da/df/d11/d8d/da4 216494 1 2024-04-25T23:01:08.419 INFO:tasks.workunit.client.0.smithi043.stdout:7/670: fsync d3/d1e/f4d 0 2024-04-25T23:01:08.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/738: chown d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f9a 51 1 2024-04-25T23:01:08.420 INFO:tasks.workunit.client.0.smithi043.stdout:7/671: chown d3/da/d64/fa3 0 1 2024-04-25T23:01:08.420 INFO:tasks.workunit.client.0.smithi043.stdout:5/679: chown d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/fad 96324 1 2024-04-25T23:01:08.421 INFO:tasks.workunit.client.0.smithi043.stdout:7/672: getdents d3/d52 0 2024-04-25T23:01:08.421 INFO:tasks.workunit.client.0.smithi043.stdout:3/739: link d7/d26/d27/d34/d1a/fb3 d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f10f 0 2024-04-25T23:01:08.422 INFO:tasks.workunit.client.0.smithi043.stdout:3/740: creat d7/d26/d88/f110 x:0 0 0 2024-04-25T23:01:08.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/680: truncate d0/d2c/d39/d1c/d25/d7a/d41/d47/f54 817166 0 2024-04-25T23:01:08.428 INFO:tasks.workunit.client.0.smithi043.stdout:7/673: truncate d3/d1e/d1f/f5f 3504239 0 2024-04-25T23:01:08.428 INFO:tasks.workunit.client.0.smithi043.stdout:3/741: dwrite d7/d26/d27/d34/f35 [0,4194304] 0 2024-04-25T23:01:08.429 INFO:tasks.workunit.client.0.smithi043.stdout:5/681: dread - d0/d2c/d39/d1c/d25/d7a/d41/d47/f8e zero size 2024-04-25T23:01:08.429 INFO:tasks.workunit.client.0.smithi043.stdout:3/742: dread - d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe4 zero size 2024-04-25T23:01:08.430 INFO:tasks.workunit.client.0.smithi043.stdout:3/743: chown d7/d26/d27/c3f 714 1 2024-04-25T23:01:08.431 INFO:tasks.workunit.client.0.smithi043.stdout:5/682: creat d0/d2c/d39/d1c/d25/d7a/d92/fdf x:0 0 0 2024-04-25T23:01:08.431 INFO:tasks.workunit.client.0.smithi043.stdout:2/531: dread d2/d66/d85/d76/f3f [0,4194304] 0 2024-04-25T23:01:08.431 INFO:tasks.workunit.client.0.smithi043.stdout:3/744: unlink d7/d26/d27/d34/d1a/c44 0 2024-04-25T23:01:08.432 INFO:tasks.workunit.client.0.smithi043.stdout:4/685: dread d3/d19/f8d [0,4194304] 0 2024-04-25T23:01:08.433 INFO:tasks.workunit.client.0.smithi043.stdout:4/686: readlink d3/de/d46/d6a/d8f/l6c 0 2024-04-25T23:01:08.433 INFO:tasks.workunit.client.0.smithi043.stdout:5/683: creat d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fe0 x:0 0 0 2024-04-25T23:01:08.434 INFO:tasks.workunit.client.0.smithi043.stdout:2/532: rmdir d2/d66/d85/d76/d97/d63 0 2024-04-25T23:01:08.434 INFO:tasks.workunit.client.0.smithi043.stdout:5/684: fsync d0/d6a/fb4 0 2024-04-25T23:01:08.437 INFO:tasks.workunit.client.0.smithi043.stdout:5/685: readlink d0/l84 0 2024-04-25T23:01:08.437 INFO:tasks.workunit.client.0.smithi043.stdout:4/687: creat d3/d19/ff4 x:0 0 0 2024-04-25T23:01:08.437 INFO:tasks.workunit.client.0.smithi043.stdout:7/674: dread d3/d1e/f39 [0,4194304] 0 2024-04-25T23:01:08.437 INFO:tasks.workunit.client.0.smithi043.stdout:4/688: creat d3/de/d46/d6a/d8f/d8e/db5/ff5 x:0 0 0 2024-04-25T23:01:08.438 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:08.432+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:08.438 INFO:tasks.workunit.client.0.smithi043.stdout:4/689: mknod d3/d19/d34/cf6 0 2024-04-25T23:01:08.438 INFO:tasks.workunit.client.0.smithi043.stdout:5/686: truncate d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 1539509 0 2024-04-25T23:01:08.439 INFO:tasks.workunit.client.0.smithi043.stdout:3/745: dwrite d7/d26/d59/f72 [0,4194304] 0 2024-04-25T23:01:08.439 INFO:tasks.workunit.client.0.smithi043.stdout:5/687: dread - d0/d2c/d39/d1c/d25/d7a/fda zero size 2024-04-25T23:01:08.440 INFO:tasks.workunit.client.0.smithi043.stdout:3/746: creat d7/d26/d27/d34/d1a/d40/d8f/f111 x:0 0 0 2024-04-25T23:01:08.441 INFO:tasks.workunit.client.0.smithi043.stdout:3/747: read - d7/d26/fbc zero size 2024-04-25T23:01:08.442 INFO:tasks.workunit.client.0.smithi043.stdout:3/748: chown d7/d26/d2d/fff 5675 1 2024-04-25T23:01:08.444 INFO:tasks.workunit.client.0.smithi043.stdout:2/533: truncate d2/d3/d13/f1e 3640595 0 2024-04-25T23:01:08.444 INFO:tasks.workunit.client.0.smithi043.stdout:7/675: truncate d3/d1e/d1f/f24 2767138 0 2024-04-25T23:01:08.444 INFO:tasks.workunit.client.0.smithi043.stdout:3/749: fsync d7/d26/fbc 0 2024-04-25T23:01:08.445 INFO:tasks.workunit.client.0.smithi043.stdout:2/534: mkdir d2/d66/d85/d43/d5d/da9 0 2024-04-25T23:01:08.445 INFO:tasks.workunit.client.0.smithi043.stdout:7/676: chown d3/d1e/d1f/d54/l58 27530 1 2024-04-25T23:01:08.446 INFO:tasks.workunit.client.0.smithi043.stdout:2/535: dread - d2/d66/d85/d76/d97/f9e zero size 2024-04-25T23:01:08.446 INFO:tasks.workunit.client.0.smithi043.stdout:6/627: dread d1/f1f [0,4194304] 0 2024-04-25T23:01:08.447 INFO:tasks.workunit.client.0.smithi043.stdout:7/677: chown d3/d1e/d1f/f24 0 1 2024-04-25T23:01:08.449 INFO:tasks.workunit.client.0.smithi043.stdout:7/678: write d3/d1e/fb8 [795863,18428] 0 2024-04-25T23:01:08.449 INFO:tasks.workunit.client.0.smithi043.stdout:2/536: write d2/d66/d85/d43/d5d/f4d [2145117,64173] 0 2024-04-25T23:01:08.451 INFO:tasks.workunit.client.0.smithi043.stdout:2/537: creat d2/d66/d85/d43/d67/faa x:0 0 0 2024-04-25T23:01:08.452 INFO:tasks.workunit.client.0.smithi043.stdout:5/688: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e [0,4194304] 0 2024-04-25T23:01:08.452 INFO:tasks.workunit.client.0.smithi043.stdout:4/690: dread d3/fa [0,4194304] 0 2024-04-25T23:01:08.454 INFO:tasks.workunit.client.0.smithi043.stdout:3/750: dread d7/d26/fca [0,4194304] 0 2024-04-25T23:01:08.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/538: creat d2/d66/d85/d76/d97/d48/fab x:0 0 0 2024-04-25T23:01:08.455 INFO:tasks.workunit.client.0.smithi043.stdout:6/628: dwrite d1/d2a/f4e [0,4194304] 0 2024-04-25T23:01:08.456 INFO:tasks.workunit.client.0.smithi043.stdout:2/539: chown d2/d66/d85/d76/d97 2396 1 2024-04-25T23:01:08.457 INFO:tasks.workunit.client.0.smithi043.stdout:7/679: dwrite d3/d1e/fd2 [0,4194304] 0 2024-04-25T23:01:08.457 INFO:tasks.workunit.client.0.smithi043.stdout:2/540: write d2/d66/d85/d76/d97/d48/f64 [3963638,43622] 0 2024-04-25T23:01:08.459 INFO:tasks.workunit.client.0.smithi043.stdout:6/629: write d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/faa [294035,2678] 0 2024-04-25T23:01:08.459 INFO:tasks.workunit.client.0.smithi043.stdout:7/680: write d3/d9b/f92 [2022054,19574] 0 2024-04-25T23:01:08.460 INFO:tasks.workunit.client.0.smithi043.stdout:5/689: truncate d0/f40 812741 0 2024-04-25T23:01:08.460 INFO:tasks.workunit.client.0.smithi043.stdout:7/681: stat d3/da/df/d11/c4b 0 2024-04-25T23:01:08.460 INFO:tasks.workunit.client.0.smithi043.stdout:6/630: creat d1/d2a/db5/dcb/fd9 x:0 0 0 2024-04-25T23:01:08.461 INFO:tasks.workunit.client.0.smithi043.stdout:7/682: write d3/fad [504719,62346] 0 2024-04-25T23:01:08.463 INFO:tasks.workunit.client.0.smithi043.stdout:4/691: dwrite d3/d21/d6b/d87/f8b [0,4194304] 0 2024-04-25T23:01:08.465 INFO:tasks.workunit.client.0.smithi043.stdout:4/692: rename d3/f41 to d3/d21/d6b/d87/d9a/ff7 0 2024-04-25T23:01:08.465 INFO:tasks.workunit.client.0.smithi043.stdout:3/751: dwrite d7/d26/d27/d34/d1a/d40/f64 [0,4194304] 0 2024-04-25T23:01:08.466 INFO:tasks.workunit.client.0.smithi043.stdout:4/693: write d3/f7d [857047,42070] 0 2024-04-25T23:01:08.468 INFO:tasks.workunit.client.0.smithi043.stdout:3/752: symlink d7/d26/d27/d34/d1a/d28/d9e/l112 0 2024-04-25T23:01:08.468 INFO:tasks.workunit.client.0.smithi043.stdout:4/694: mknod d3/d19/cf8 0 2024-04-25T23:01:08.469 INFO:tasks.workunit.client.0.smithi043.stdout:7/683: dwrite d3/da/d64/fd0 [0,4194304] 0 2024-04-25T23:01:08.469 INFO:tasks.workunit.client.0.smithi043.stdout:3/753: mknod d7/d26/d27/d34/d1a/d40/d8f/dd0/c113 0 2024-04-25T23:01:08.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/684: rmdir d3/d9b/da8 39 2024-04-25T23:01:08.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/685: chown d3 72852051 1 2024-04-25T23:01:08.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/686: stat d3/da/df/d11/d26/c32 0 2024-04-25T23:01:08.472 INFO:tasks.workunit.client.0.smithi043.stdout:3/754: chown d7/d26/d27/c55 2630 1 2024-04-25T23:01:08.475 INFO:tasks.workunit.client.0.smithi043.stdout:3/755: chown d7/d26/d2d/c81 6503 1 2024-04-25T23:01:08.475 INFO:tasks.workunit.client.0.smithi043.stdout:3/756: creat d7/dac/f114 x:0 0 0 2024-04-25T23:01:08.475 INFO:tasks.workunit.client.0.smithi043.stdout:9/647: sync 2024-04-25T23:01:08.478 INFO:tasks.workunit.client.0.smithi043.stdout:9/648: getdents d8/de 0 2024-04-25T23:01:08.478 INFO:tasks.workunit.client.0.smithi043.stdout:7/687: dwrite d3/da/df/d11/f94 [0,4194304] 0 2024-04-25T23:01:08.479 INFO:tasks.workunit.client.0.smithi043.stdout:9/649: symlink d8/de/d44/d5d/dd2/lde 0 2024-04-25T23:01:08.479 INFO:tasks.workunit.client.0.smithi043.stdout:3/757: truncate d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/fe7 810666 0 2024-04-25T23:01:08.480 INFO:tasks.workunit.client.0.smithi043.stdout:7/688: unlink d3/d1e/d1f/l2a 0 2024-04-25T23:01:08.482 INFO:tasks.workunit.client.0.smithi043.stdout:3/758: creat d7/d26/d27/d34/d1a/d40/d8f/d51/f115 x:0 0 0 2024-04-25T23:01:08.482 INFO:tasks.workunit.client.0.smithi043.stdout:7/689: creat d3/da/d78/dd4/fd5 x:0 0 0 2024-04-25T23:01:08.483 INFO:tasks.workunit.client.0.smithi043.stdout:3/759: dread - d7/d26/d27/d34/d1a/d28/d9e/dcc/fd1 zero size 2024-04-25T23:01:08.484 INFO:tasks.workunit.client.0.smithi043.stdout:3/760: chown d7/c85 7 1 2024-04-25T23:01:08.485 INFO:tasks.workunit.client.0.smithi043.stdout:9/650: dread d8/de/d12/d16/f40 [0,4194304] 0 2024-04-25T23:01:08.489 INFO:tasks.workunit.client.0.smithi043.stdout:9/651: read d8/de/d12/d16/f75 [357902,20229] 0 2024-04-25T23:01:08.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/652: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fb9 [0,4194304] 0 2024-04-25T23:01:08.500 INFO:tasks.workunit.client.0.smithi043.stdout:2/541: dread d2/d7f/f81 [0,4194304] 0 2024-04-25T23:01:08.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/542: dread - d2/d66/d85/d76/d97/d77/da2/fa4 zero size 2024-04-25T23:01:08.503 INFO:tasks.workunit.client.0.smithi043.stdout:2/543: rename d2/d66/d85/d43/d67/d8d/f19 to d2/fac 0 2024-04-25T23:01:08.505 INFO:tasks.workunit.client.0.smithi043.stdout:6/631: dread d1/d5/d3b/d4c/d21/d55/d68/d30/f6e [0,4194304] 0 2024-04-25T23:01:08.506 INFO:tasks.workunit.client.0.smithi043.stdout:2/544: rename d2/d66/d85/d76/d97/c33 to d2/d66/d85/d76/d97/cad 0 2024-04-25T23:01:08.507 INFO:tasks.workunit.client.0.smithi043.stdout:6/632: creat d1/d5/d3b/fda x:0 0 0 2024-04-25T23:01:08.508 INFO:tasks.workunit.client.0.smithi043.stdout:2/545: rename d2/d3/d13/l14 to d2/d66/d85/d43/d5d/lae 0 2024-04-25T23:01:08.508 INFO:tasks.workunit.client.0.smithi043.stdout:6/633: truncate d1/d5/d3b/d4c/d21/f7d 311532 0 2024-04-25T23:01:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:9/653: dread d8/de/f78 [0,4194304] 0 2024-04-25T23:01:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:2/546: dwrite d2/d66/d85/d43/f8e [0,4194304] 0 2024-04-25T23:01:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:0/630: sync 2024-04-25T23:01:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:8/512: sync 2024-04-25T23:01:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:5/690: sync 2024-04-25T23:01:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:4/695: sync 2024-04-25T23:01:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:1/620: sync 2024-04-25T23:01:08.515 INFO:tasks.workunit.client.0.smithi043.stdout:0/631: write d1b/f40 [2047470,25494] 0 2024-04-25T23:01:08.515 INFO:tasks.workunit.client.0.smithi043.stdout:9/654: unlink d8/de/d12/d16/d24/f2a 0 2024-04-25T23:01:08.515 INFO:tasks.workunit.client.0.smithi043.stdout:8/513: mkdir d3/d4/db/d14/da5 0 2024-04-25T23:01:08.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/691: mknod d0/d2c/d39/dc4/ce1 0 2024-04-25T23:01:08.516 INFO:tasks.workunit.client.0.smithi043.stdout:4/696: rename d3/d19/f1e to d3/de/d27/ff9 0 2024-04-25T23:01:08.516 INFO:tasks.workunit.client.0.smithi043.stdout:2/547: getdents d2/d66/d85/d76/d97/d48 0 2024-04-25T23:01:08.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/692: creat d0/d2c/d39/dc4/fe2 x:0 0 0 2024-04-25T23:01:08.520 INFO:tasks.workunit.client.0.smithi043.stdout:4/697: link d3/d37/f54 d3/de/d27/d5c/d67/ffa 0 2024-04-25T23:01:08.521 INFO:tasks.workunit.client.0.smithi043.stdout:5/693: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b 39 2024-04-25T23:01:08.521 INFO:tasks.workunit.client.0.smithi043.stdout:9/655: link d8/de/d12/d16/l1d d8/de/d44/d65/ldf 0 2024-04-25T23:01:08.521 INFO:tasks.workunit.client.0.smithi043.stdout:5/694: mknod d0/d22/db8/ce3 0 2024-04-25T23:01:08.521 INFO:tasks.workunit.client.0.smithi043.stdout:9/656: symlink d8/de/d12/le0 0 2024-04-25T23:01:08.522 INFO:tasks.workunit.client.0.smithi043.stdout:9/657: dread - d8/de/fce zero size 2024-04-25T23:01:08.523 INFO:tasks.workunit.client.0.smithi043.stdout:9/658: write d8/de/f78 [5736487,41544] 0 2024-04-25T23:01:08.525 INFO:tasks.workunit.client.0.smithi043.stdout:9/659: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/fe1 x:0 0 0 2024-04-25T23:01:08.528 INFO:tasks.workunit.client.0.smithi043.stdout:9/660: link d8/de/d12/d7a/lcf d8/de/d44/d65/le2 0 2024-04-25T23:01:08.529 INFO:tasks.workunit.client.0.smithi043.stdout:5/695: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e [0,4194304] 0 2024-04-25T23:01:08.532 INFO:tasks.workunit.client.0.smithi043.stdout:5/696: mknod d0/d2c/d39/d1c/d25/d7a/d41/d47/ce4 0 2024-04-25T23:01:08.533 INFO:tasks.workunit.client.0.smithi043.stdout:5/697: stat d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a 0 2024-04-25T23:01:08.535 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:08.532+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:08.536 INFO:tasks.workunit.client.0.smithi043.stdout:8/514: dread d3/d4/db/d14/d56/f70 [0,4194304] 0 2024-04-25T23:01:08.537 INFO:tasks.workunit.client.0.smithi043.stdout:8/515: creat d3/d4/db/fa6 x:0 0 0 2024-04-25T23:01:08.538 INFO:tasks.workunit.client.0.smithi043.stdout:1/621: dread d0/d9/f21 [0,4194304] 0 2024-04-25T23:01:08.538 INFO:tasks.workunit.client.0.smithi043.stdout:9/661: truncate d8/de/d12/d16/d24/dbe/dc6/d2f/f50 937681 0 2024-04-25T23:01:08.539 INFO:tasks.workunit.client.0.smithi043.stdout:1/622: creat d0/d3d/dd7/fe3 x:0 0 0 2024-04-25T23:01:08.539 INFO:tasks.workunit.client.0.smithi043.stdout:2/548: dread d2/d3/f34 [0,4194304] 0 2024-04-25T23:01:08.540 INFO:tasks.workunit.client.0.smithi043.stdout:2/549: read - d2/d3/d13/d40/f7b zero size 2024-04-25T23:01:08.540 INFO:tasks.workunit.client.0.smithi043.stdout:1/623: write d0/d9/faf [42942,94050] 0 2024-04-25T23:01:08.541 INFO:tasks.workunit.client.0.smithi043.stdout:9/662: creat d8/de/d12/d16/d24/dbe/dc6/d2f/dad/fe3 x:0 0 0 2024-04-25T23:01:08.541 INFO:tasks.workunit.client.0.smithi043.stdout:5/698: dwrite d0/d22/f9e [0,4194304] 0 2024-04-25T23:01:08.541 INFO:tasks.workunit.client.0.smithi043.stdout:3/761: sync 2024-04-25T23:01:08.541 INFO:tasks.workunit.client.0.smithi043.stdout:7/690: sync 2024-04-25T23:01:08.543 INFO:tasks.workunit.client.0.smithi043.stdout:2/550: creat d2/d66/d85/d76/faf x:0 0 0 2024-04-25T23:01:08.543 INFO:tasks.workunit.client.0.smithi043.stdout:3/762: readlink d7/d26/d27/l107 0 2024-04-25T23:01:08.543 INFO:tasks.workunit.client.0.smithi043.stdout:1/624: rename d0/d16/d5a/f84 to d0/d16/fe4 0 2024-04-25T23:01:08.544 INFO:tasks.workunit.client.0.smithi043.stdout:2/551: creat d2/fb0 x:0 0 0 2024-04-25T23:01:08.544 INFO:tasks.workunit.client.0.smithi043.stdout:9/663: write d8/de/d12/d16/d24/dbe/dc6/d2f/f6d [2572546,100515] 0 2024-04-25T23:01:08.545 INFO:tasks.workunit.client.0.smithi043.stdout:5/699: getdents d0/d2c/d39/d1c/d25 0 2024-04-25T23:01:08.547 INFO:tasks.workunit.client.0.smithi043.stdout:1/625: rename d0/d16/d5a/d5b/f70 to d0/d16/d5a/d5b/fe5 0 2024-04-25T23:01:08.547 INFO:tasks.workunit.client.0.smithi043.stdout:8/516: dwrite d3/d4/db/d4e/d5c/d2e/f46 [0,4194304] 0 2024-04-25T23:01:08.547 INFO:tasks.workunit.client.0.smithi043.stdout:3/763: truncate d7/d26/d27/d34/d1a/d40/d8f/f86 967885 0 2024-04-25T23:01:08.547 INFO:tasks.workunit.client.0.smithi043.stdout:5/700: chown d0/d22/f7b 65 1 2024-04-25T23:01:08.547 INFO:tasks.workunit.client.0.smithi043.stdout:2/552: getdents d2/d4b 0 2024-04-25T23:01:08.548 INFO:tasks.workunit.client.0.smithi043.stdout:1/626: mkdir d0/d9/ddc/de6 0 2024-04-25T23:01:08.549 INFO:tasks.workunit.client.0.smithi043.stdout:2/553: symlink d2/d66/d85/d43/d67/d8d/lb1 0 2024-04-25T23:01:08.550 INFO:tasks.workunit.client.0.smithi043.stdout:8/517: mkdir d3/d4/db/d14/d56/d5d/d9c/da7 0 2024-04-25T23:01:08.550 INFO:tasks.workunit.client.0.smithi043.stdout:5/701: chown d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/ld9 51219528 1 2024-04-25T23:01:08.551 INFO:tasks.workunit.client.0.smithi043.stdout:2/554: write d2/d4b/f9d [518492,79487] 0 2024-04-25T23:01:08.552 INFO:tasks.workunit.client.0.smithi043.stdout:0/632: dread f1a [0,4194304] 0 2024-04-25T23:01:08.552 INFO:tasks.workunit.client.0.smithi043.stdout:9/664: read d8/de/d44/d5d/da1/fcd [162249,19217] 0 2024-04-25T23:01:08.553 INFO:tasks.workunit.client.0.smithi043.stdout:7/691: dwrite d3/d9b/f66 [0,4194304] 0 2024-04-25T23:01:08.554 INFO:tasks.workunit.client.0.smithi043.stdout:9/665: stat d8/de/d12/d16/d24/dbe/dc6/d6c/l7c 0 2024-04-25T23:01:08.555 INFO:tasks.workunit.client.0.smithi043.stdout:5/702: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/de5 0 2024-04-25T23:01:08.555 INFO:tasks.workunit.client.0.smithi043.stdout:1/627: dread d0/d86/fa0 [0,4194304] 0 2024-04-25T23:01:08.556 INFO:tasks.workunit.client.0.smithi043.stdout:2/555: rename d2/d3/d13/d4f/f96 to d2/d3/d13/d4f/fb2 0 2024-04-25T23:01:08.556 INFO:tasks.workunit.client.0.smithi043.stdout:7/692: rename d3/d9b/d63/l70 to d3/da/df/d11/d8d/d9f/ld6 0 2024-04-25T23:01:08.556 INFO:tasks.workunit.client.0.smithi043.stdout:1/628: readlink d0/ld 0 2024-04-25T23:01:08.556 INFO:tasks.workunit.client.0.smithi043.stdout:0/633: read d1b/d23/f4e [605166,130945] 0 2024-04-25T23:01:08.557 INFO:tasks.workunit.client.0.smithi043.stdout:9/666: write d8/de/d12/d16/d24/dbe/dc6/d2f/f56 [4543120,58165] 0 2024-04-25T23:01:08.558 INFO:tasks.workunit.client.0.smithi043.stdout:1/629: creat d0/d2f/d4b/da6/fe7 x:0 0 0 2024-04-25T23:01:08.558 INFO:tasks.workunit.client.0.smithi043.stdout:7/693: readlink d3/da/d78/l81 0 2024-04-25T23:01:08.558 INFO:tasks.workunit.client.0.smithi043.stdout:0/634: creat d1b/db0/fc5 x:0 0 0 2024-04-25T23:01:08.558 INFO:tasks.workunit.client.0.smithi043.stdout:5/703: chown d0/d2c/d39/d1c/d25/d7a/d41/f86 28821170 1 2024-04-25T23:01:08.559 INFO:tasks.workunit.client.0.smithi043.stdout:7/694: chown d3/d52/f60 24 1 2024-04-25T23:01:08.559 INFO:tasks.workunit.client.0.smithi043.stdout:8/518: dwrite d3/d4/db/d14/f54 [0,4194304] 0 2024-04-25T23:01:08.559 INFO:tasks.workunit.client.0.smithi043.stdout:1/630: write d0/d3d/f50 [3502115,67832] 0 2024-04-25T23:01:08.560 INFO:tasks.workunit.client.0.smithi043.stdout:5/704: write d0/f5 [5296060,12294] 0 2024-04-25T23:01:08.560 INFO:tasks.workunit.client.0.smithi043.stdout:0/635: write d1b/d31/f49 [562616,130629] 0 2024-04-25T23:01:08.560 INFO:tasks.workunit.client.0.smithi043.stdout:5/705: fdatasync d0/d6a/fb1 0 2024-04-25T23:01:08.561 INFO:tasks.workunit.client.0.smithi043.stdout:8/519: write d3/d4/db/d4e/d5c/f1e [716375,119614] 0 2024-04-25T23:01:08.562 INFO:tasks.workunit.client.0.smithi043.stdout:7/695: creat d3/dc1/fd7 x:0 0 0 2024-04-25T23:01:08.562 INFO:tasks.workunit.client.0.smithi043.stdout:1/631: creat d0/d2f/d4b/da6/fe8 x:0 0 0 2024-04-25T23:01:08.562 INFO:tasks.workunit.client.0.smithi043.stdout:0/636: symlink d1b/d23/d39/d90/lc6 0 2024-04-25T23:01:08.562 INFO:tasks.workunit.client.0.smithi043.stdout:5/706: mknod d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/ce6 0 2024-04-25T23:01:08.563 INFO:tasks.workunit.client.0.smithi043.stdout:5/707: readlink d0/lba 0 2024-04-25T23:01:08.563 INFO:tasks.workunit.client.0.smithi043.stdout:8/520: mknod d3/d4/d6d/ca8 0 2024-04-25T23:01:08.563 INFO:tasks.workunit.client.0.smithi043.stdout:1/632: chown d0/d16/d5a 2 1 2024-04-25T23:01:08.563 INFO:tasks.workunit.client.0.smithi043.stdout:2/556: rename d2/d3 to d2/d66/d85/d43/d67/db3 0 2024-04-25T23:01:08.564 INFO:tasks.workunit.client.0.smithi043.stdout:7/696: symlink d3/da/ld8 0 2024-04-25T23:01:08.564 INFO:tasks.workunit.client.0.smithi043.stdout:8/521: stat d3/d4/db/d4e/l88 0 2024-04-25T23:01:08.564 INFO:tasks.workunit.client.0.smithi043.stdout:5/708: mkdir d0/d2c/d39/d63/de7 0 2024-04-25T23:01:08.565 INFO:tasks.workunit.client.0.smithi043.stdout:0/637: mknod d1b/d8b/d7d/dc3/cc7 0 2024-04-25T23:01:08.565 INFO:tasks.workunit.client.0.smithi043.stdout:6/634: sync 2024-04-25T23:01:08.566 INFO:tasks.workunit.client.0.smithi043.stdout:7/697: write d3/d1e/d1f/d54/fb5 [565931,44320] 0 2024-04-25T23:01:08.567 INFO:tasks.workunit.client.0.smithi043.stdout:7/698: readlink d3/da/df/d11/l14 0 2024-04-25T23:01:08.567 INFO:tasks.workunit.client.0.smithi043.stdout:9/667: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fbd [0,4194304] 0 2024-04-25T23:01:08.567 INFO:tasks.workunit.client.0.smithi043.stdout:7/699: write d3/d9b/d63/f95 [407172,97022] 0 2024-04-25T23:01:08.570 INFO:tasks.workunit.client.0.smithi043.stdout:8/522: unlink d3/d4/db/d4e/d5c/d59/d61/d66/c99 0 2024-04-25T23:01:08.570 INFO:tasks.workunit.client.0.smithi043.stdout:6/635: read d1/d5/f3f [2082684,1738] 0 2024-04-25T23:01:08.571 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:08.571 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:08.572 INFO:tasks.workunit.client.0.smithi043.stdout:7/700: symlink d3/d1e/d1f/ld9 0 2024-04-25T23:01:08.572 INFO:tasks.workunit.client.0.smithi043.stdout:2/557: unlink d2/d66/d85/d43/d67/db3/l3b 0 2024-04-25T23:01:08.572 INFO:tasks.workunit.client.0.smithi043.stdout:0/638: dwrite d1b/d23/d39/d90/f92 [0,4194304] 0 2024-04-25T23:01:08.572 INFO:tasks.workunit.client.0.smithi043.stdout:9/668: mkdir d8/de/d12/de4 0 2024-04-25T23:01:08.572 INFO:tasks.workunit.client.0.smithi043.stdout:0/639: chown d1b/d23/d39/db3 0 1 2024-04-25T23:01:08.573 INFO:tasks.workunit.client.0.smithi043.stdout:6/636: mkdir d1/d5/d3b/d4c/d21/d55/da2/ddb 0 2024-04-25T23:01:08.574 INFO:tasks.workunit.client.0.smithi043.stdout:2/558: symlink d2/d66/d85/d43/d67/db3/d13/d4f/lb4 0 2024-04-25T23:01:08.575 INFO:tasks.workunit.client.0.smithi043.stdout:5/709: write d0/f40 [1458050,35031] 0 2024-04-25T23:01:08.575 INFO:tasks.workunit.client.0.smithi043.stdout:0/640: mkdir d1b/d23/d7a/dc8 0 2024-04-25T23:01:08.576 INFO:tasks.workunit.client.0.smithi043.stdout:1/633: dread d0/d3c/f79 [0,4194304] 0 2024-04-25T23:01:08.578 INFO:tasks.workunit.client.0.smithi043.stdout:1/634: chown d0/d9/d63/f90 101399257 1 2024-04-25T23:01:08.578 INFO:tasks.workunit.client.0.smithi043.stdout:6/637: symlink d1/d5/d3b/d4c/d21/d55/d68/d30/ldc 0 2024-04-25T23:01:08.578 INFO:tasks.workunit.client.0.smithi043.stdout:5/710: creat d0/d2c/d39/d63/fe8 x:0 0 0 2024-04-25T23:01:08.579 INFO:tasks.workunit.client.0.smithi043.stdout:0/641: rename d1b/d23/f86 to d1b/d8b/dc0/fc9 0 2024-04-25T23:01:08.579 INFO:tasks.workunit.client.0.smithi043.stdout:1/635: fsync d0/d16/d5a/f6e 0 2024-04-25T23:01:08.579 INFO:tasks.workunit.client.0.smithi043.stdout:0/642: chown d1b/db0 56 1 2024-04-25T23:01:08.579 INFO:tasks.workunit.client.0.smithi043.stdout:2/559: mkdir d2/d66/d85/d76/d97/d77/da2/db5 0 2024-04-25T23:01:08.580 INFO:tasks.workunit.client.0.smithi043.stdout:6/638: write d1/d5/d3b/d4c/d21/d38/d60/fa5 [81819,1599] 0 2024-04-25T23:01:08.580 INFO:tasks.workunit.client.0.smithi043.stdout:0/643: creat d1b/d31/db1/fca x:0 0 0 2024-04-25T23:01:08.581 INFO:tasks.workunit.client.0.smithi043.stdout:5/711: creat d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fe9 x:0 0 0 2024-04-25T23:01:08.581 INFO:tasks.workunit.client.0.smithi043.stdout:6/639: chown d1/d5/d3b/d4c/d21/d38/d60 5051 1 2024-04-25T23:01:08.582 INFO:tasks.workunit.client.0.smithi043.stdout:9/669: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/dad/fe3 [0,4194304] 0 2024-04-25T23:01:08.582 INFO:tasks.workunit.client.0.smithi043.stdout:0/644: mkdir d1b/d23/d7b/da6/dcb 0 2024-04-25T23:01:08.585 INFO:tasks.workunit.client.0.smithi043.stdout:0/645: readlink d1b/l1c 0 2024-04-25T23:01:08.585 INFO:tasks.workunit.client.0.smithi043.stdout:9/670: creat d8/de/d12/de4/fe5 x:0 0 0 2024-04-25T23:01:08.586 INFO:tasks.workunit.client.0.smithi043.stdout:6/640: creat d1/d5/d3b/d4c/d21/d55/d68/d7f/fdd x:0 0 0 2024-04-25T23:01:08.586 INFO:tasks.workunit.client.0.smithi043.stdout:2/560: link d2/d66/d85/d76/d97/c68 d2/d66/d85/d76/d97/d77/cb6 0 2024-04-25T23:01:08.587 INFO:tasks.workunit.client.0.smithi043.stdout:2/561: readlink d2/l53 0 2024-04-25T23:01:08.587 INFO:tasks.workunit.client.0.smithi043.stdout:1/636: dwrite d0/d16/d5a/d5b/fcc [0,4194304] 0 2024-04-25T23:01:08.587 INFO:tasks.workunit.client.0.smithi043.stdout:0/646: write d1b/d31/d3c/f52 [4047318,81313] 0 2024-04-25T23:01:08.588 INFO:tasks.workunit.client.0.smithi043.stdout:2/562: readlink d2/d66/d85/l88 0 2024-04-25T23:01:08.588 INFO:tasks.workunit.client.0.smithi043.stdout:6/641: write d1/d2a/f76 [1859420,122321] 0 2024-04-25T23:01:08.590 INFO:tasks.workunit.client.0.smithi043.stdout:5/712: dwrite d0/d22/f7b [0,4194304] 0 2024-04-25T23:01:08.590 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:08.591 INFO:tasks.workunit.client.0.smithi043.stdout:2/563: mkdir d2/d66/d85/d76/d97/d77/da2/db7 0 2024-04-25T23:01:08.594 INFO:tasks.workunit.client.0.smithi043.stdout:1/637: creat d0/d2f/d4b/fe9 x:0 0 0 2024-04-25T23:01:08.594 INFO:tasks.workunit.client.0.smithi043.stdout:5/713: creat d0/d22/d95/fea x:0 0 0 2024-04-25T23:01:08.594 INFO:tasks.workunit.client.0.smithi043.stdout:9/671: getdents d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31 0 2024-04-25T23:01:08.594 INFO:tasks.workunit.client.0.smithi043.stdout:1/638: creat d0/d3d/fea x:0 0 0 2024-04-25T23:01:08.594 INFO:tasks.workunit.client.0.smithi043.stdout:9/672: mknod d8/de/d44/d65/ce6 0 2024-04-25T23:01:08.594 INFO:tasks.workunit.client.0.smithi043.stdout:5/714: unlink d0/d2c/d39/d1c/d25/d7a/d92/fbf 0 2024-04-25T23:01:08.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:08.596 INFO:tasks.workunit.client.0.smithi043.stdout:6/642: truncate d1/d5/d3b/d4c/d21/d38/f45 209195 0 2024-04-25T23:01:08.596 INFO:tasks.workunit.client.0.smithi043.stdout:9/673: creat d8/de/d12/d16/d24/dbe/dc6/d2f/da6/fe7 x:0 0 0 2024-04-25T23:01:08.597 INFO:tasks.workunit.client.0.smithi043.stdout:6/643: symlink d1/d5/d3b/d62/lde 0 2024-04-25T23:01:08.597 INFO:tasks.workunit.client.0.smithi043.stdout:5/715: getdents d0/d2c/d39/dc4 0 2024-04-25T23:01:08.598 INFO:tasks.workunit.client.0.smithi043.stdout:9/674: chown d8/de/d12/d16/d24/dbe/dc6/d2f/f6d 19383610 1 2024-04-25T23:01:08.599 INFO:tasks.workunit.client.0.smithi043.stdout:3/764: dread d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe2 [0,4194304] 0 2024-04-25T23:01:08.600 INFO:tasks.workunit.client.0.smithi043.stdout:9/675: mkdir d8/de/d44/de8 0 2024-04-25T23:01:08.601 INFO:tasks.workunit.client.0.smithi043.stdout:6/644: link d1/d5/d3b/d4c/d21/d55/d6d/d96/f71 d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/fdf 0 2024-04-25T23:01:08.601 INFO:tasks.workunit.client.0.smithi043.stdout:0/647: dread d1b/d31/d3c/d72/f78 [0,4194304] 0 2024-04-25T23:01:08.602 INFO:tasks.workunit.client.0.smithi043.stdout:3/765: link d7/d26/d88/db0/ldb d7/d26/d59/d7c/l116 0 2024-04-25T23:01:08.603 INFO:tasks.workunit.client.0.smithi043.stdout:9/676: getdents d8 0 2024-04-25T23:01:08.607 INFO:tasks.workunit.client.0.smithi043.stdout:5/716: dwrite d0/d2c/d39/d1c/d25/fa2 [0,4194304] 0 2024-04-25T23:01:08.607 INFO:tasks.workunit.client.0.smithi043.stdout:6/645: write d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/fdf [775761,51827] 0 2024-04-25T23:01:08.607 INFO:tasks.workunit.client.0.smithi043.stdout:3/766: dread d7/d26/d88/db0/ff9 [0,4194304] 0 2024-04-25T23:01:08.607 INFO:tasks.workunit.client.0.smithi043.stdout:1/639: dread d0/f72 [0,4194304] 0 2024-04-25T23:01:08.609 INFO:tasks.workunit.client.0.smithi043.stdout:1/640: chown d0/d86/fa0 5813800 1 2024-04-25T23:01:08.610 INFO:tasks.workunit.client.0.smithi043.stdout:3/767: readlink d7/d26/d27/d34/d1a/d40/d8f/d51/lcd 0 2024-04-25T23:01:08.611 INFO:tasks.workunit.client.0.smithi043.stdout:6/646: write d1/d5/d3b/d4c/d1a/f5b [1018496,91707] 0 2024-04-25T23:01:08.612 INFO:tasks.workunit.client.0.smithi043.stdout:5/717: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/feb x:0 0 0 2024-04-25T23:01:08.612 INFO:tasks.workunit.client.0.smithi043.stdout:9/677: dwrite d8/f89 [0,4194304] 0 2024-04-25T23:01:08.614 INFO:tasks.workunit.client.0.smithi043.stdout:0/648: dwrite d1b/d23/d39/db3/f64 [0,4194304] 0 2024-04-25T23:01:08.618 INFO:tasks.workunit.client.0.smithi043.stdout:4/698: sync 2024-04-25T23:01:08.618 INFO:tasks.workunit.client.0.smithi043.stdout:1/641: truncate d0/d9/f21 2440496 0 2024-04-25T23:01:08.620 INFO:tasks.workunit.client.0.smithi043.stdout:6/647: rename d1/d5/d3b/d4c/d21/d55/d68/cb0 to d1/d5/d3b/d4c/d21/d55/da2/ddb/ce0 0 2024-04-25T23:01:08.620 INFO:tasks.workunit.client.0.smithi043.stdout:9/678: mknod d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/ce9 0 2024-04-25T23:01:08.621 INFO:tasks.workunit.client.0.smithi043.stdout:0/649: mkdir d1b/d23/dab/dbd/dcc 0 2024-04-25T23:01:08.621 INFO:tasks.workunit.client.0.smithi043.stdout:3/768: dwrite d7/d26/d59/d7c/fdf [0,4194304] 0 2024-04-25T23:01:08.621 INFO:tasks.workunit.client.0.smithi043.stdout:1/642: mkdir d0/d2f/deb 0 2024-04-25T23:01:08.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/718: link d0/d2c/d39/d1c/d25/d7a/lc6 d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/lec 0 2024-04-25T23:01:08.623 INFO:tasks.workunit.client.0.smithi043.stdout:0/650: creat d1b/d23/d7b/da6/db7/db9/fcd x:0 0 0 2024-04-25T23:01:08.623 INFO:tasks.workunit.client.0.smithi043.stdout:1/643: truncate d0/d9/d63/f90 4632475 0 2024-04-25T23:01:08.624 INFO:tasks.workunit.client.0.smithi043.stdout:1/644: mknod d0/d3d/cec 0 2024-04-25T23:01:08.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/719: truncate d0/d2c/d39/d1c/d25/d7a/fda 12504 0 2024-04-25T23:01:08.627 INFO:tasks.workunit.client.0.smithi043.stdout:1/645: mknod d0/d16/d5a/ced 0 2024-04-25T23:01:08.630 INFO:tasks.workunit.client.0.smithi043.stdout:9/679: dwrite d8/de/f42 [0,4194304] 0 2024-04-25T23:01:08.630 INFO:tasks.workunit.client.0.smithi043.stdout:6/648: dwrite d1/d5/d3b/f3c [4194304,4194304] 0 2024-04-25T23:01:08.631 INFO:tasks.workunit.client.0.smithi043.stdout:2/564: dread d2/d66/d85/d76/d97/f52 [0,4194304] 0 2024-04-25T23:01:08.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/720: chown d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f5c 419250518 1 2024-04-25T23:01:08.632 INFO:tasks.workunit.client.0.smithi043.stdout:6/649: dread - d1/d2a/db5/dcb/fd0 zero size 2024-04-25T23:01:08.632 INFO:tasks.workunit.client.0.smithi043.stdout:5/721: write d0/d2c/d39/f88 [428648,127903] 0 2024-04-25T23:01:08.633 INFO:tasks.workunit.client.0.smithi043.stdout:0/651: dwrite d1b/f37 [0,4194304] 0 2024-04-25T23:01:08.633 INFO:tasks.workunit.client.0.smithi043.stdout:1/646: link d0/d86/daa/lcb d0/d86/daa/lee 0 2024-04-25T23:01:08.634 INFO:tasks.workunit.client.0.smithi043.stdout:2/565: creat d2/d66/d85/d43/d67/d8d/fb8 x:0 0 0 2024-04-25T23:01:08.635 INFO:tasks.workunit.client.0.smithi043.stdout:0/652: mkdir d1b/d23/d7b/da6/dce 0 2024-04-25T23:01:08.635 INFO:tasks.workunit.client.0.smithi043.stdout:6/650: creat d1/dc8/fe1 x:0 0 0 2024-04-25T23:01:08.636 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:08.634+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:08.639 INFO:tasks.workunit.client.0.smithi043.stdout:2/566: unlink d2/d66/d85/f5f 0 2024-04-25T23:01:08.640 INFO:tasks.workunit.client.0.smithi043.stdout:1/647: getdents d0/d3d 0 2024-04-25T23:01:08.640 INFO:tasks.workunit.client.0.smithi043.stdout:1/648: rename d0/d2f/d4b/fe9 to d0/d3d/fef 0 2024-04-25T23:01:08.640 INFO:tasks.workunit.client.0.smithi043.stdout:1/649: read d0/d3d/d4f/f64 [89802,13135] 0 2024-04-25T23:01:08.640 INFO:tasks.workunit.client.0.smithi043.stdout:2/567: write d2/d66/d85/d43/d67/db3/f2f [4637308,40071] 0 2024-04-25T23:01:08.643 INFO:tasks.workunit.client.0.smithi043.stdout:2/568: stat d2/d66/d85/d43/c58 0 2024-04-25T23:01:08.644 INFO:tasks.workunit.client.0.smithi043.stdout:1/650: rename d0/d16/d5a/d5b/fcc to d0/d2f/d4b/ff0 0 2024-04-25T23:01:08.645 INFO:tasks.workunit.client.0.smithi043.stdout:2/569: stat d2/d66/d85/d43/d67/faa 0 2024-04-25T23:01:08.646 INFO:tasks.workunit.client.0.smithi043.stdout:9/680: dwrite d8/de/d44/d65/faf [0,4194304] 0 2024-04-25T23:01:08.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/722: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/f54 [0,4194304] 0 2024-04-25T23:01:08.647 INFO:tasks.workunit.client.0.smithi043.stdout:0/653: dwrite d1b/d55/f6d [0,4194304] 0 2024-04-25T23:01:08.647 INFO:tasks.workunit.client.0.smithi043.stdout:2/570: chown d2/d66/d85/d43/d67/d8d/l1b 2062201701 1 2024-04-25T23:01:08.647 INFO:tasks.workunit.client.0.smithi043.stdout:0/654: dread - d1b/d55/f8d zero size 2024-04-25T23:01:08.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/723: mkdir d0/d22/d95/ded 0 2024-04-25T23:01:08.648 INFO:tasks.workunit.client.0.smithi043.stdout:9/681: chown d8/de/d12/d16/d24/dbe/dc6/d2f/l57 0 1 2024-04-25T23:01:08.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/724: mknod d0/d2c/d39/d63/cee 0 2024-04-25T23:01:08.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/725: write d0/f7c [120314,14253] 0 2024-04-25T23:01:08.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/651: truncate d1/d5/d3b/d4c/d1a/f2e 7496095 0 2024-04-25T23:01:08.651 INFO:tasks.workunit.client.0.smithi043.stdout:1/651: write d0/d16/f4a [1269987,34079] 0 2024-04-25T23:01:08.652 INFO:tasks.workunit.client.0.smithi043.stdout:0/655: dread d1b/d31/d3c/f7c [0,4194304] 0 2024-04-25T23:01:08.652 INFO:tasks.workunit.client.0.smithi043.stdout:5/726: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/de5 0 2024-04-25T23:01:08.652 INFO:tasks.workunit.client.0.smithi043.stdout:1/652: rename d0/c51 to d0/d16/d5a/cf1 0 2024-04-25T23:01:08.652 INFO:tasks.workunit.client.0.smithi043.stdout:6/652: truncate d1/d5/f95 712201 0 2024-04-25T23:01:08.653 INFO:tasks.workunit.client.0.smithi043.stdout:0/656: chown d1b/d23/c30 577 1 2024-04-25T23:01:08.654 INFO:tasks.workunit.client.0.smithi043.stdout:1/653: creat d0/d2f/deb/ff2 x:0 0 0 2024-04-25T23:01:08.654 INFO:tasks.workunit.client.0.smithi043.stdout:0/657: mkdir d1b/dcf 0 2024-04-25T23:01:08.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/653: creat d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/fe2 x:0 0 0 2024-04-25T23:01:08.656 INFO:tasks.workunit.client.0.smithi043.stdout:7/701: sync 2024-04-25T23:01:08.656 INFO:tasks.workunit.client.0.smithi043.stdout:8/523: sync 2024-04-25T23:01:08.660 INFO:tasks.workunit.client.0.smithi043.stdout:8/524: chown d3/d4/db/d4e/l52 365688266 1 2024-04-25T23:01:08.660 INFO:tasks.workunit.client.0.smithi043.stdout:6/654: mkdir d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/dc3/de3 0 2024-04-25T23:01:08.662 INFO:tasks.workunit.client.0.smithi043.stdout:9/682: dwrite d8/de/d12/d16/d24/dbe/dc6/d6c/f70 [0,4194304] 0 2024-04-25T23:01:08.662 INFO:tasks.workunit.client.0.smithi043.stdout:5/727: dwrite d0/d2c/d39/f88 [0,4194304] 0 2024-04-25T23:01:08.664 INFO:tasks.workunit.client.0.smithi043.stdout:1/654: dwrite d0/d2f/d4b/fa2 [0,4194304] 0 2024-04-25T23:01:08.664 INFO:tasks.workunit.client.0.smithi043.stdout:8/525: creat d3/d4/d7c/d92/d62/fa9 x:0 0 0 2024-04-25T23:01:08.666 INFO:tasks.workunit.client.0.smithi043.stdout:0/658: dwrite d1b/fa4 [0,4194304] 0 2024-04-25T23:01:08.666 INFO:tasks.workunit.client.0.smithi043.stdout:9/683: truncate d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/fe1 915215 0 2024-04-25T23:01:08.667 INFO:tasks.workunit.client.0.smithi043.stdout:5/728: stat d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fd7 0 2024-04-25T23:01:08.668 INFO:tasks.workunit.client.0.smithi043.stdout:9/684: unlink d8/de/d12/d16/c83 0 2024-04-25T23:01:08.673 INFO:tasks.workunit.client.0.smithi043.stdout:5/729: rename d0/d22/db8 to d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2/def 0 2024-04-25T23:01:08.673 INFO:tasks.workunit.client.0.smithi043.stdout:8/526: link d3/d4/db/d14/d4c/d77/f27 d3/d4/db/d4e/d8b/d9f/d8d/faa 0 2024-04-25T23:01:08.674 INFO:tasks.workunit.client.0.smithi043.stdout:6/655: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/f6e [0,4194304] 0 2024-04-25T23:01:08.674 INFO:tasks.workunit.client.0.smithi043.stdout:1/655: dwrite d0/d86/fb6 [0,4194304] 0 2024-04-25T23:01:08.676 INFO:tasks.workunit.client.0.smithi043.stdout:6/656: dread - d1/d2a/db5/dcb/fd9 zero size 2024-04-25T23:01:08.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/702: write d3/da/df/d11/d26/f83 [922198,48672] 0 2024-04-25T23:01:08.681 INFO:tasks.workunit.client.0.smithi043.stdout:1/656: creat d0/d2f/ff3 x:0 0 0 2024-04-25T23:01:08.682 INFO:tasks.workunit.client.0.smithi043.stdout:0/659: dwrite d1b/d8b/dc0/fc9 [0,4194304] 0 2024-04-25T23:01:08.682 INFO:tasks.workunit.client.0.smithi043.stdout:7/703: unlink d3/da/d78/dd4/fd5 0 2024-04-25T23:01:08.685 INFO:tasks.workunit.client.0.smithi043.stdout:9/685: write d8/f59 [572993,130614] 0 2024-04-25T23:01:08.685 INFO:tasks.workunit.client.0.smithi043.stdout:8/527: dwrite d3/d4/f71 [0,4194304] 0 2024-04-25T23:01:08.689 INFO:tasks.workunit.client.0.smithi043.stdout:1/657: write d0/d9/f80 [4599755,51710] 0 2024-04-25T23:01:08.689 INFO:tasks.workunit.client.0.smithi043.stdout:7/704: creat d3/d1e/d1f/fda x:0 0 0 2024-04-25T23:01:08.690 INFO:tasks.workunit.client.0.smithi043.stdout:0/660: mknod d1b/d23/d7a/cd0 0 2024-04-25T23:01:08.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/571: dread d2/d66/d85/d43/d67/db3/d13/d40/f6b [0,4194304] 0 2024-04-25T23:01:08.690 INFO:tasks.workunit.client.0.smithi043.stdout:9/686: creat d8/de/d12/de4/fea x:0 0 0 2024-04-25T23:01:08.690 INFO:tasks.workunit.client.0.smithi043.stdout:5/730: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/f83 [8388608,4194304] 0 2024-04-25T23:01:08.690 INFO:tasks.workunit.client.0.smithi043.stdout:6/657: link d1/d5/d3b/d4c/d21/d55/d68/f9e d1/d5/fe4 0 2024-04-25T23:01:08.691 INFO:tasks.workunit.client.0.smithi043.stdout:1/658: chown d0/ld 1 1 2024-04-25T23:01:08.691 INFO:tasks.workunit.client.0.smithi043.stdout:7/705: stat d3/da/d78/l81 0 2024-04-25T23:01:08.692 INFO:tasks.workunit.client.0.smithi043.stdout:1/659: rename d0/d9 to d0/d9/df4 22 2024-04-25T23:01:08.693 INFO:tasks.workunit.client.0.smithi043.stdout:9/687: mkdir d8/de/d44/deb 0 2024-04-25T23:01:08.694 INFO:tasks.workunit.client.0.smithi043.stdout:7/706: creat d3/d1e/d1f/dc5/fdb x:0 0 0 2024-04-25T23:01:08.694 INFO:tasks.workunit.client.0.smithi043.stdout:9/688: chown d8/de/d44/d5d/da1 145 1 2024-04-25T23:01:08.694 INFO:tasks.workunit.client.0.smithi043.stdout:1/660: chown d0/d2f/d4b/da6/fe8 15 1 2024-04-25T23:01:08.694 INFO:tasks.workunit.client.0.smithi043.stdout:2/572: write d2/d66/d85/d76/d97/d77/da2/fa4 [1026924,87047] 0 2024-04-25T23:01:08.694 INFO:tasks.workunit.client.0.smithi043.stdout:0/661: link d1b/d31/d3c/f43 d1b/dcf/fd1 0 2024-04-25T23:01:08.694 INFO:tasks.workunit.client.0.smithi043.stdout:7/707: mkdir d3/d9b/ddc 0 2024-04-25T23:01:08.694 INFO:tasks.workunit.client.0.smithi043.stdout:0/662: chown d1b/d23/d7b/da6/dcb 1247 1 2024-04-25T23:01:08.695 INFO:tasks.workunit.client.0.smithi043.stdout:9/689: write d8/de/d12/d16/d24/dbe/dc6/d2f/fbc [218771,109480] 0 2024-04-25T23:01:08.697 INFO:tasks.workunit.client.0.smithi043.stdout:1/661: link d0/d16/f2d d0/d86/ff5 0 2024-04-25T23:01:08.697 INFO:tasks.workunit.client.0.smithi043.stdout:2/573: mkdir d2/d66/d85/d43/d67/db3/d13/d4f/db9 0 2024-04-25T23:01:08.697 INFO:tasks.workunit.client.0.smithi043.stdout:9/690: write d8/de/d44/d47/f8a [148977,56925] 0 2024-04-25T23:01:08.698 INFO:tasks.workunit.client.0.smithi043.stdout:2/574: rmdir d2/d66/d85 39 2024-04-25T23:01:08.702 INFO:tasks.workunit.client.0.smithi043.stdout:2/575: creat d2/d66/d85/d43/d67/db3/d13/d40/fba x:0 0 0 2024-04-25T23:01:08.702 INFO:tasks.workunit.client.0.smithi043.stdout:5/731: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f53 [0,4194304] 0 2024-04-25T23:01:08.703 INFO:tasks.workunit.client.0.smithi043.stdout:5/732: stat d0/d22 0 2024-04-25T23:01:08.703 INFO:tasks.workunit.client.0.smithi043.stdout:7/708: dwrite d3/d9b/f80 [0,4194304] 0 2024-04-25T23:01:08.704 INFO:tasks.workunit.client.0.smithi043.stdout:2/576: creat d2/d66/d85/fbb x:0 0 0 2024-04-25T23:01:08.705 INFO:tasks.workunit.client.0.smithi043.stdout:7/709: creat d3/d1e/d1f/d6b/d72/fdd x:0 0 0 2024-04-25T23:01:08.705 INFO:tasks.workunit.client.0.smithi043.stdout:5/733: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/df0 0 2024-04-25T23:01:08.706 INFO:tasks.workunit.client.0.smithi043.stdout:2/577: unlink d2/d66/d85/d43/d67/db3/l99 0 2024-04-25T23:01:08.707 INFO:tasks.workunit.client.0.smithi043.stdout:2/578: chown d2/d66/d85/d76/d97/cad 3731 1 2024-04-25T23:01:08.707 INFO:tasks.workunit.client.0.smithi043.stdout:1/662: truncate d0/d16/d5a/d5b/da4/f93 3411537 0 2024-04-25T23:01:08.708 INFO:tasks.workunit.client.0.smithi043.stdout:5/734: truncate d0/d2c/d39/d1c/d25/d4e/fbd 4121113 0 2024-04-25T23:01:08.708 INFO:tasks.workunit.client.0.smithi043.stdout:1/663: creat d0/d9/ddc/ff6 x:0 0 0 2024-04-25T23:01:08.709 INFO:tasks.workunit.client.0.smithi043.stdout:5/735: write d0/f35 [1978159,126829] 0 2024-04-25T23:01:08.709 INFO:tasks.workunit.client.0.smithi043.stdout:2/579: creat d2/d66/d85/d43/d67/db3/fbc x:0 0 0 2024-04-25T23:01:08.710 INFO:tasks.workunit.client.0.smithi043.stdout:5/736: readlink d0/d2c/d39/la8 0 2024-04-25T23:01:08.710 INFO:tasks.workunit.client.0.smithi043.stdout:1/664: getdents d0 0 2024-04-25T23:01:08.711 INFO:tasks.workunit.client.0.smithi043.stdout:5/737: chown d0/d2c/d39/d1c/d25/f27 79802876 1 2024-04-25T23:01:08.711 INFO:tasks.workunit.client.0.smithi043.stdout:1/665: write d0/d2f/d4b/f7c [2323284,121416] 0 2024-04-25T23:01:08.712 INFO:tasks.workunit.client.0.smithi043.stdout:4/699: sync 2024-04-25T23:01:08.712 INFO:tasks.workunit.client.0.smithi043.stdout:2/580: rename d2/d66/d85/d43/d67/db3/fbc to d2/d66/d85/d43/d67/db3/d13/d40/fbd 0 2024-04-25T23:01:08.712 INFO:tasks.workunit.client.0.smithi043.stdout:3/769: sync 2024-04-25T23:01:08.712 INFO:tasks.workunit.client.0.smithi043.stdout:6/658: sync 2024-04-25T23:01:08.712 INFO:tasks.workunit.client.0.smithi043.stdout:0/663: sync 2024-04-25T23:01:08.712 INFO:tasks.workunit.client.0.smithi043.stdout:1/666: write d0/d2f/d4b/da6/fe7 [689536,4827] 0 2024-04-25T23:01:08.713 INFO:tasks.workunit.client.0.smithi043.stdout:6/659: fsync d1/d5/d3b/f85 0 2024-04-25T23:01:08.713 INFO:tasks.workunit.client.0.smithi043.stdout:0/664: fdatasync d1b/f56 0 2024-04-25T23:01:08.714 INFO:tasks.workunit.client.0.smithi043.stdout:4/700: write d3/d19/d34/f68 [590867,77341] 0 2024-04-25T23:01:08.714 INFO:tasks.workunit.client.0.smithi043.stdout:4/701: sync 2024-04-25T23:01:08.714 INFO:tasks.workunit.client.0.smithi043.stdout:9/691: dread d8/de/d44/d47/d6a/f9e [0,4194304] 0 2024-04-25T23:01:08.714 INFO:tasks.workunit.client.0.smithi043.stdout:6/660: stat d1/f1f 0 2024-04-25T23:01:08.714 INFO:tasks.workunit.client.0.smithi043.stdout:9/692: sync 2024-04-25T23:01:08.714 INFO:tasks.workunit.client.0.smithi043.stdout:7/710: read d3/d1e/f4d [1448123,108816] 0 2024-04-25T23:01:08.715 INFO:tasks.workunit.client.0.smithi043.stdout:1/667: unlink d0/c2b 0 2024-04-25T23:01:08.715 INFO:tasks.workunit.client.0.smithi043.stdout:2/581: creat d2/d66/d85/d43/d67/db3/d13/d4f/da0/fbe x:0 0 0 2024-04-25T23:01:08.716 INFO:tasks.workunit.client.0.smithi043.stdout:0/665: write d1b/d23/f3e [699017,108200] 0 2024-04-25T23:01:08.717 INFO:tasks.workunit.client.0.smithi043.stdout:3/770: rename d7/d26/d27/d34/d1a/d28/d9e/dcc/f102 to d7/d26/d27/d34/d1a/f117 0 2024-04-25T23:01:08.717 INFO:tasks.workunit.client.0.smithi043.stdout:1/668: chown d0/d16/f23 521073880 1 2024-04-25T23:01:08.717 INFO:tasks.workunit.client.0.smithi043.stdout:9/693: fdatasync d8/de/d12/d16/f36 0 2024-04-25T23:01:08.717 INFO:tasks.workunit.client.0.smithi043.stdout:4/702: link d3/d19/f22 d3/de/d27/d5c/d67/ffb 0 2024-04-25T23:01:08.719 INFO:tasks.workunit.client.0.smithi043.stdout:5/738: dwrite d0/d22/f6d [4194304,4194304] 0 2024-04-25T23:01:08.722 INFO:tasks.workunit.client.0.smithi043.stdout:5/739: fdatasync d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fe9 0 2024-04-25T23:01:08.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/582: mkdir d2/d66/d85/d76/d97/d77/da2/db7/dbf 0 2024-04-25T23:01:08.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/583: sync 2024-04-25T23:01:08.722 INFO:tasks.workunit.client.0.smithi043.stdout:6/661: symlink d1/d5/d3b/db6/le5 0 2024-04-25T23:01:08.724 INFO:tasks.workunit.client.0.smithi043.stdout:9/694: rename d8/de/d44/d5d/da1/fa3 to d8/de/fec 0 2024-04-25T23:01:08.724 INFO:tasks.workunit.client.0.smithi043.stdout:4/703: getdents d3 0 2024-04-25T23:01:08.727 INFO:tasks.workunit.client.0.smithi043.stdout:5/740: read d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f96 [81344,31958] 0 2024-04-25T23:01:08.727 INFO:tasks.workunit.client.0.smithi043.stdout:0/666: dwrite d1b/d23/d7a/fa3 [0,4194304] 0 2024-04-25T23:01:08.728 INFO:tasks.workunit.client.0.smithi043.stdout:1/669: dwrite d0/d9/d63/f97 [0,4194304] 0 2024-04-25T23:01:08.730 INFO:tasks.workunit.client.0.smithi043.stdout:5/741: write d0/f35 [2806785,198] 0 2024-04-25T23:01:08.731 INFO:tasks.workunit.client.0.smithi043.stdout:7/711: write d3/da/df/f8c [768868,105887] 0 2024-04-25T23:01:08.733 INFO:tasks.workunit.client.0.smithi043.stdout:7/712: sync 2024-04-25T23:01:08.733 INFO:tasks.workunit.client.0.smithi043.stdout:9/695: fsync d8/de/d12/d16/d24/dbe/dc6/d2f/f50 0 2024-04-25T23:01:08.736 INFO:tasks.workunit.client.0.smithi043.stdout:7/713: rmdir d3/d1e/d1f/d6b 39 2024-04-25T23:01:08.736 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:08.732+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:08.737 INFO:tasks.workunit.client.0.smithi043.stdout:6/662: dwrite d1/d5/d3b/d62/fc1 [0,4194304] 0 2024-04-25T23:01:08.739 INFO:tasks.workunit.client.0.smithi043.stdout:2/584: dwrite d2/d66/d85/f72 [4194304,4194304] 0 2024-04-25T23:01:08.739 INFO:tasks.workunit.client.0.smithi043.stdout:0/667: dread d1b/d55/f6d [0,4194304] 0 2024-04-25T23:01:08.741 INFO:tasks.workunit.client.0.smithi043.stdout:3/771: dread d7/d26/d2d/f67 [0,4194304] 0 2024-04-25T23:01:08.741 INFO:tasks.workunit.client.0.smithi043.stdout:2/585: dread - d2/d66/d85/d43/f8a zero size 2024-04-25T23:01:08.743 INFO:tasks.workunit.client.0.smithi043.stdout:7/714: mknod d3/da/df/d11/d8d/da4/cde 0 2024-04-25T23:01:08.743 INFO:tasks.workunit.client.0.smithi043.stdout:1/670: dwrite d0/d16/d5a/d5b/da4/f81 [0,4194304] 0 2024-04-25T23:01:08.743 INFO:tasks.workunit.client.0.smithi043.stdout:9/696: symlink d8/de/d44/led 0 2024-04-25T23:01:08.743 INFO:tasks.workunit.client.0.smithi043.stdout:6/663: mkdir d1/d5/d3b/d4c/d21/d38/de6 0 2024-04-25T23:01:08.743 INFO:tasks.workunit.client.0.smithi043.stdout:0/668: creat d1b/db0/fd2 x:0 0 0 2024-04-25T23:01:08.743 INFO:tasks.workunit.client.0.smithi043.stdout:5/742: write d0/d22/f76 [1953639,99356] 0 2024-04-25T23:01:08.744 INFO:tasks.workunit.client.0.smithi043.stdout:3/772: rename d7/c31 to d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/c118 0 2024-04-25T23:01:08.745 INFO:tasks.workunit.client.0.smithi043.stdout:1/671: rename d0/d16/d5a/d5b/da4 to d0/d16/df7 0 2024-04-25T23:01:08.745 INFO:tasks.workunit.client.0.smithi043.stdout:6/664: symlink d1/d5/d3b/d4c/d21/d55/d68/le7 0 2024-04-25T23:01:08.745 INFO:tasks.workunit.client.0.smithi043.stdout:2/586: dread - d2/d66/d85/d43/d5d/f84 zero size 2024-04-25T23:01:08.746 INFO:tasks.workunit.client.0.smithi043.stdout:3/773: creat d7/d26/d88/db8/f119 x:0 0 0 2024-04-25T23:01:08.749 INFO:tasks.workunit.client.0.smithi043.stdout:7/715: rename d3/da/df/c22 to d3/da/df/d11/d8d/d9f/cdf 0 2024-04-25T23:01:08.752 INFO:tasks.workunit.client.0.smithi043.stdout:8/528: dread d3/d4/db/f2d [0,4194304] 0 2024-04-25T23:01:08.752 INFO:tasks.workunit.client.0.smithi043.stdout:5/743: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ff1 x:0 0 0 2024-04-25T23:01:08.752 INFO:tasks.workunit.client.0.smithi043.stdout:2/587: mknod d2/d66/cc0 0 2024-04-25T23:01:08.753 INFO:tasks.workunit.client.0.smithi043.stdout:8/529: chown d3/d4/f25 742945861 1 2024-04-25T23:01:08.753 INFO:tasks.workunit.client.0.smithi043.stdout:1/672: creat d0/d2f/d4b/d8f/ff8 x:0 0 0 2024-04-25T23:01:08.753 INFO:tasks.workunit.client.0.smithi043.stdout:2/588: read - d2/d66/d85/f57 zero size 2024-04-25T23:01:08.754 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:08.754 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:08.755 INFO:tasks.workunit.client.0.smithi043.stdout:2/589: readlink d2/d66/d85/d43/d5d/l41 0 2024-04-25T23:01:08.755 INFO:tasks.workunit.client.0.smithi043.stdout:8/530: write d3/d4/db/d4e/d5c/f84 [4947608,4672] 0 2024-04-25T23:01:08.755 INFO:tasks.workunit.client.0.smithi043.stdout:9/697: truncate d8/de/d12/d16/d24/dbe/dc6/d68/fb1 600727 0 2024-04-25T23:01:08.755 INFO:tasks.workunit.client.0.smithi043.stdout:1/673: mknod d0/d16/cf9 0 2024-04-25T23:01:08.755 INFO:tasks.workunit.client.0.smithi043.stdout:5/744: unlink d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/fb6 0 2024-04-25T23:01:08.756 INFO:tasks.workunit.client.0.smithi043.stdout:1/674: chown d0/d16/df7/lb5 57 1 2024-04-25T23:01:08.757 INFO:tasks.workunit.client.0.smithi043.stdout:4/704: dread d3/f7d [0,4194304] 0 2024-04-25T23:01:08.757 INFO:tasks.workunit.client.0.smithi043.stdout:8/531: dread - d3/d4/db/d4e/d8b/d9f/d33/f9a zero size 2024-04-25T23:01:08.757 INFO:tasks.workunit.client.0.smithi043.stdout:2/590: mknod d2/d66/d85/d43/d5d/da9/cc1 0 2024-04-25T23:01:08.760 INFO:tasks.workunit.client.0.smithi043.stdout:0/669: dread d1b/d31/d3c/f6a [0,4194304] 0 2024-04-25T23:01:08.760 INFO:tasks.workunit.client.0.smithi043.stdout:4/705: mknod d3/d21/d6b/d87/d9a/cfc 0 2024-04-25T23:01:08.760 INFO:tasks.workunit.client.0.smithi043.stdout:5/745: truncate d0/d2c/d39/d63/f7d 1760373 0 2024-04-25T23:01:08.760 INFO:tasks.workunit.client.0.smithi043.stdout:1/675: write d0/d2f/ff3 [5449,108944] 0 2024-04-25T23:01:08.760 INFO:tasks.workunit.client.0.smithi043.stdout:5/746: sync 2024-04-25T23:01:08.761 INFO:tasks.workunit.client.0.smithi043.stdout:3/774: dwrite d7/d26/d88/db8/fd7 [0,4194304] 0 2024-04-25T23:01:08.761 INFO:tasks.workunit.client.0.smithi043.stdout:9/698: write d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/fe1 [1529519,27475] 0 2024-04-25T23:01:08.761 INFO:tasks.workunit.client.0.smithi043.stdout:8/532: rmdir d3/d4/db/d4e/d8b/d9f/d33 39 2024-04-25T23:01:08.761 INFO:tasks.workunit.client.0.smithi043.stdout:2/591: fdatasync d2/d66/d85/d76/d97/d48/f5a 0 2024-04-25T23:01:08.762 INFO:tasks.workunit.client.0.smithi043.stdout:4/706: write d3/de/fd [1176118,17618] 0 2024-04-25T23:01:08.764 INFO:tasks.workunit.client.0.smithi043.stdout:4/707: readlink d3/d21/lbb 0 2024-04-25T23:01:08.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/670: rename d1b/c2f to d1b/d31/d3c/cd3 0 2024-04-25T23:01:08.764 INFO:tasks.workunit.client.0.smithi043.stdout:6/665: dwrite d1/d5/d3b/d4c/d21/d55/d68/f42 [0,4194304] 0 2024-04-25T23:01:08.765 INFO:tasks.workunit.client.0.smithi043.stdout:4/708: readlink d3/d21/l56 0 2024-04-25T23:01:08.767 INFO:tasks.workunit.client.0.smithi043.stdout:5/747: symlink d0/d22/d95/ded/lf2 0 2024-04-25T23:01:08.767 INFO:tasks.workunit.client.0.smithi043.stdout:0/671: creat d1b/d23/d7a/dad/fd4 x:0 0 0 2024-04-25T23:01:08.768 INFO:tasks.workunit.client.0.smithi043.stdout:6/666: write d1/d5/d3b/d4c/d21/d55/d6d/d96/fa7 [444864,37798] 0 2024-04-25T23:01:08.768 INFO:tasks.workunit.client.0.smithi043.stdout:7/716: dread d3/da/df/d11/d26/f83 [0,4194304] 0 2024-04-25T23:01:08.768 INFO:tasks.workunit.client.0.smithi043.stdout:4/709: write d3/de/d46/d95/fbc [403449,62282] 0 2024-04-25T23:01:08.769 INFO:tasks.workunit.client.0.smithi043.stdout:3/775: read d7/d26/d59/d7c/db2/d52/f5d [1015477,31256] 0 2024-04-25T23:01:08.770 INFO:tasks.workunit.client.0.smithi043.stdout:5/748: chown d0/d22/lc0 296 1 2024-04-25T23:01:08.770 INFO:tasks.workunit.client.0.smithi043.stdout:0/672: creat d1b/db0/fd5 x:0 0 0 2024-04-25T23:01:08.771 INFO:tasks.workunit.client.0.smithi043.stdout:1/676: dwrite d0/d3d/fea [0,4194304] 0 2024-04-25T23:01:08.772 INFO:tasks.workunit.client.0.smithi043.stdout:7/717: creat d3/d9b/d63/fe0 x:0 0 0 2024-04-25T23:01:08.773 INFO:tasks.workunit.client.0.smithi043.stdout:3/776: chown d7/d26/d27/d34/d1a/d40/d8f/l73 47358739 1 2024-04-25T23:01:08.774 INFO:tasks.workunit.client.0.smithi043.stdout:1/677: readlink d0/d2f/l58 0 2024-04-25T23:01:08.774 INFO:tasks.workunit.client.0.smithi043.stdout:0/673: symlink d1b/d23/d7b/ld6 0 2024-04-25T23:01:08.774 INFO:tasks.workunit.client.0.smithi043.stdout:9/699: dwrite d8/de/d12/de4/fe5 [0,4194304] 0 2024-04-25T23:01:08.776 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:08.777 INFO:tasks.workunit.client.0.smithi043.stdout:6/667: write d1/d5/d3b/d4c/d21/d55/d6d/fcc [2363823,849] 0 2024-04-25T23:01:08.777 INFO:tasks.workunit.client.0.smithi043.stdout:3/777: chown d7/d26/d88/lb4 2 1 2024-04-25T23:01:08.777 INFO:tasks.workunit.client.0.smithi043.stdout:1/678: readlink d0/d9/d63/l88 0 2024-04-25T23:01:08.777 INFO:tasks.workunit.client.0.smithi043.stdout:2/592: truncate d2/d66/d85/d43/d67/db3/f47 1191062 0 2024-04-25T23:01:08.778 INFO:tasks.workunit.client.0.smithi043.stdout:6/668: truncate d1/d2a/db5/dcb/fd9 494941 0 2024-04-25T23:01:08.778 INFO:tasks.workunit.client.0.smithi043.stdout:3/778: symlink d7/d26/d59/d7c/db2/d52/l11a 0 2024-04-25T23:01:08.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/679: fsync d0/d2f/f71 0 2024-04-25T23:01:08.779 INFO:tasks.workunit.client.0.smithi043.stdout:4/710: read d3/d21/d84/faf [46113,12019] 0 2024-04-25T23:01:08.780 INFO:tasks.workunit.client.0.smithi043.stdout:1/680: chown d0/d9 0 1 2024-04-25T23:01:08.780 INFO:tasks.workunit.client.0.smithi043.stdout:3/779: chown d7/d26/d59/d7c/db2/d87/f9d 0 1 2024-04-25T23:01:08.780 INFO:tasks.workunit.client.0.smithi043.stdout:0/674: mkdir d1b/dcf/dd7 0 2024-04-25T23:01:08.781 INFO:tasks.workunit.client.0.smithi043.stdout:5/749: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/df0/df3 0 2024-04-25T23:01:08.781 INFO:tasks.workunit.client.0.smithi043.stdout:6/669: chown d1/d5/d3b/db6/fb8 1851 1 2024-04-25T23:01:08.781 INFO:tasks.workunit.client.0.smithi043.stdout:8/533: dread d3/d4/db/d14/f19 [0,4194304] 0 2024-04-25T23:01:08.781 INFO:tasks.workunit.client.0.smithi043.stdout:2/593: fdatasync d2/d66/d85/d76/d97/f35 0 2024-04-25T23:01:08.781 INFO:tasks.workunit.client.0.smithi043.stdout:3/780: dread - d7/d26/fbc zero size 2024-04-25T23:01:08.782 INFO:tasks.workunit.client.0.smithi043.stdout:4/711: readlink d3/l55 0 2024-04-25T23:01:08.783 INFO:tasks.workunit.client.0.smithi043.stdout:1/681: write d0/d2f/d4b/da6/fd9 [855831,23890] 0 2024-04-25T23:01:08.783 INFO:tasks.workunit.client.0.smithi043.stdout:9/700: dwrite d8/de/d44/d65/fc8 [4194304,4194304] 0 2024-04-25T23:01:08.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/675: write d1b/d23/dab/fc2 [410596,45949] 0 2024-04-25T23:01:08.786 INFO:tasks.workunit.client.0.smithi043.stdout:4/712: mkdir d3/d21/d84/dfd 0 2024-04-25T23:01:08.786 INFO:tasks.workunit.client.0.smithi043.stdout:2/594: chown d2/d66/d85/d76/d97/f52 306 1 2024-04-25T23:01:08.787 INFO:tasks.workunit.client.0.smithi043.stdout:6/670: mknod d1/d5/d3b/d4c/ce8 0 2024-04-25T23:01:08.787 INFO:tasks.workunit.client.0.smithi043.stdout:4/713: chown d3/d19/d34/dea/dc8/le9 683 1 2024-04-25T23:01:08.787 INFO:tasks.workunit.client.0.smithi043.stdout:9/701: fdatasync d8/fd 0 2024-04-25T23:01:08.787 INFO:tasks.workunit.client.0.smithi043.stdout:5/750: mknod d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/cf4 0 2024-04-25T23:01:08.790 INFO:tasks.workunit.client.0.smithi043.stdout:3/781: rename d7/d26/d2d/f67 to d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/f11b 0 2024-04-25T23:01:08.795 INFO:tasks.workunit.client.0.smithi043.stdout:4/714: dwrite d3/de/d27/d5c/d67/fa2 [0,4194304] 0 2024-04-25T23:01:08.795 INFO:tasks.workunit.client.0.smithi043.stdout:9/702: rename d8/de/d12/d16/d24/dbe/dc6/d2f/f56 to d8/de/d44/fee 0 2024-04-25T23:01:08.796 INFO:tasks.workunit.client.0.smithi043.stdout:1/682: dwrite d0/d2f/f61 [0,4194304] 0 2024-04-25T23:01:08.800 INFO:tasks.workunit.client.0.smithi043.stdout:4/715: symlink d3/d21/d84/dfd/lfe 0 2024-04-25T23:01:08.801 INFO:tasks.workunit.client.0.smithi043.stdout:2/595: dwrite d2/d66/d85/d76/d97/d77/da2/fa4 [0,4194304] 0 2024-04-25T23:01:08.802 INFO:tasks.workunit.client.0.smithi043.stdout:9/703: read d8/de/d12/d16/d24/dbe/dc6/d68/f88 [3567604,130857] 0 2024-04-25T23:01:08.802 INFO:tasks.workunit.client.0.smithi043.stdout:5/751: dwrite d0/d2c/d39/d63/fe8 [0,4194304] 0 2024-04-25T23:01:08.803 INFO:tasks.workunit.client.0.smithi043.stdout:4/716: chown d3/d19/fab 56 1 2024-04-25T23:01:08.805 INFO:tasks.workunit.client.0.smithi043.stdout:6/671: link d1/d5/d3b/d62/f69 d1/d5/d3b/d62/fe9 0 2024-04-25T23:01:08.807 INFO:tasks.workunit.client.0.smithi043.stdout:8/534: dwrite d3/d4/db/d14/d3e/f43 [0,4194304] 0 2024-04-25T23:01:08.808 INFO:tasks.workunit.client.0.smithi043.stdout:1/683: dwrite d0/d9/fdb [0,4194304] 0 2024-04-25T23:01:08.810 INFO:tasks.workunit.client.0.smithi043.stdout:6/672: write d1/d5/d3b/f44 [3102901,9529] 0 2024-04-25T23:01:08.812 INFO:tasks.workunit.client.0.smithi043.stdout:2/596: dwrite d2/d66/d85/d43/d67/db3/f2f [4194304,4194304] 0 2024-04-25T23:01:08.812 INFO:tasks.workunit.client.0.smithi043.stdout:9/704: rmdir d8/de/d12/d16/d24/dbe/dc6/d2f/dad 39 2024-04-25T23:01:08.814 INFO:tasks.workunit.client.0.smithi043.stdout:4/717: dwrite d3/d21/f25 [4194304,4194304] 0 2024-04-25T23:01:08.815 INFO:tasks.workunit.client.0.smithi043.stdout:6/673: chown d1/lb 3832 1 2024-04-25T23:01:08.815 INFO:tasks.workunit.client.0.smithi043.stdout:9/705: dread - d8/de/d44/d5d/fdb zero size 2024-04-25T23:01:08.816 INFO:tasks.workunit.client.0.smithi043.stdout:6/674: write d1/d5/d3b/d4c/d21/d38/d60/fa5 [252933,28953] 0 2024-04-25T23:01:08.817 INFO:tasks.workunit.client.0.smithi043.stdout:6/675: chown d1/d5/d3b/f3c 397609697 1 2024-04-25T23:01:08.819 INFO:tasks.workunit.client.0.smithi043.stdout:8/535: mknod d3/d4/db/d14/da5/cab 0 2024-04-25T23:01:08.820 INFO:tasks.workunit.client.0.smithi043.stdout:4/718: mkdir d3/d21/da5/dff 0 2024-04-25T23:01:08.820 INFO:tasks.workunit.client.0.smithi043.stdout:5/752: link d0/d2c/d39/d1c/d25/d7a/d2d/d8b/c67 d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/cf5 0 2024-04-25T23:01:08.820 INFO:tasks.workunit.client.0.smithi043.stdout:6/676: symlink d1/d5/d3b/d4c/d21/d55/d6d/d96/lea 0 2024-04-25T23:01:08.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/536: write d3/d4/d7c/d92/f83 [1304291,74897] 0 2024-04-25T23:01:08.821 INFO:tasks.workunit.client.0.smithi043.stdout:2/597: creat d2/d66/d85/d43/d67/db3/d13/d4f/db9/fc2 x:0 0 0 2024-04-25T23:01:08.822 INFO:tasks.workunit.client.0.smithi043.stdout:4/719: truncate d3/de/d46/d6a/fd0 4386682 0 2024-04-25T23:01:08.823 INFO:tasks.workunit.client.0.smithi043.stdout:8/537: symlink d3/d4/d7c/lac 0 2024-04-25T23:01:08.823 INFO:tasks.workunit.client.0.smithi043.stdout:6/677: creat d1/d5/d3b/d4c/d21/d38/d99/feb x:0 0 0 2024-04-25T23:01:08.824 INFO:tasks.workunit.client.0.smithi043.stdout:8/538: readlink d3/d4/db/l23 0 2024-04-25T23:01:08.824 INFO:tasks.workunit.client.0.smithi043.stdout:6/678: write d1/d2a/f4e [61347,72522] 0 2024-04-25T23:01:08.826 INFO:tasks.workunit.client.0.smithi043.stdout:2/598: creat d2/d66/d85/d43/d5d/da9/fc3 x:0 0 0 2024-04-25T23:01:08.826 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:08.829 INFO:tasks.workunit.client.0.smithi043.stdout:6/679: mknod d1/d5/d3b/d4c/d21/d38/de6/cec 0 2024-04-25T23:01:08.829 INFO:tasks.workunit.client.0.smithi043.stdout:5/753: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/faa [0,4194304] 0 2024-04-25T23:01:08.830 INFO:tasks.workunit.client.0.smithi043.stdout:2/599: rename d2/d4b/f9d to d2/d66/d85/d43/fc4 0 2024-04-25T23:01:08.831 INFO:tasks.workunit.client.0.smithi043.stdout:2/600: dread - d2/d66/d85/f57 zero size 2024-04-25T23:01:08.831 INFO:tasks.workunit.client.0.smithi043.stdout:8/539: dwrite d3/d4/d7c/d92/f58 [0,4194304] 0 2024-04-25T23:01:08.832 INFO:tasks.workunit.client.0.smithi043.stdout:5/754: readlink d0/d2c/d39/d1c/d25/d7a/lc6 0 2024-04-25T23:01:08.832 INFO:tasks.workunit.client.0.smithi043.stdout:4/720: dwrite d3/d21/d6b/f75 [0,4194304] 0 2024-04-25T23:01:08.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/755: dread - d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/fd8 zero size 2024-04-25T23:01:08.835 INFO:tasks.workunit.client.0.smithi043.stdout:5/756: symlink d0/d22/d95/ded/lf6 0 2024-04-25T23:01:08.835 INFO:tasks.workunit.client.0.smithi043.stdout:4/721: creat d3/f100 x:0 0 0 2024-04-25T23:01:08.836 INFO:tasks.workunit.client.0.smithi043.stdout:5/757: mknod d0/d22/d95/cf7 0 2024-04-25T23:01:08.837 INFO:tasks.workunit.client.0.smithi043.stdout:4/722: truncate d3/d21/d6b/d87/d8a/f94 4719743 0 2024-04-25T23:01:08.837 INFO:tasks.workunit.client.0.smithi043.stdout:5/758: write d0/d2c/d39/f88 [2325798,14852] 0 2024-04-25T23:01:08.839 INFO:tasks.workunit.client.0.smithi043.stdout:2/601: dwrite d2/d66/d85/d76/d97/fe [0,4194304] 0 2024-04-25T23:01:08.840 INFO:tasks.workunit.client.0.smithi043.stdout:0/676: dread d1b/d23/d39/f44 [0,4194304] 0 2024-04-25T23:01:08.840 INFO:tasks.workunit.client.0.smithi043.stdout:5/759: unlink d0/d2c/d39/d1c/d25/d7a/d2d/f8a 0 2024-04-25T23:01:08.841 INFO:tasks.workunit.client.0.smithi043.stdout:5/760: write d0/f35 [1545995,43166] 0 2024-04-25T23:01:08.842 INFO:tasks.workunit.client.0.smithi043.stdout:5/761: chown d0/d2c/d39/d1c/d25/d7a/d92 2 1 2024-04-25T23:01:08.843 INFO:tasks.workunit.client.0.smithi043.stdout:5/762: mknod d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/cf8 0 2024-04-25T23:01:08.846 INFO:tasks.workunit.client.0.smithi043.stdout:7/718: dread d3/d1e/fd2 [0,4194304] 0 2024-04-25T23:01:08.846 INFO:tasks.workunit.client.0.smithi043.stdout:5/763: creat d0/d2c/d39/d1c/d25/d7a/d2d/d5f/ff9 x:0 0 0 2024-04-25T23:01:08.847 INFO:tasks.workunit.client.0.smithi043.stdout:0/677: write d1b/d23/d39/f46 [2187654,87706] 0 2024-04-25T23:01:08.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/764: stat d0/d2c/d39/d1c/d25/d7a/f1e 0 2024-04-25T23:01:08.848 INFO:tasks.workunit.client.0.smithi043.stdout:7/719: rmdir d3/d1e/d1f/d6b/d72 39 2024-04-25T23:01:08.848 INFO:tasks.workunit.client.0.smithi043.stdout:4/723: dread d3/d21/d84/faf [0,4194304] 0 2024-04-25T23:01:08.849 INFO:tasks.workunit.client.0.smithi043.stdout:2/602: dwrite d2/d66/d85/d76/f3f [0,4194304] 0 2024-04-25T23:01:08.849 INFO:tasks.workunit.client.0.smithi043.stdout:7/720: mknod d3/da/d78/dd4/ce1 0 2024-04-25T23:01:08.850 INFO:tasks.workunit.client.0.smithi043.stdout:5/765: chown d0/d22/d95/ded/lf6 3489188 1 2024-04-25T23:01:08.850 INFO:tasks.workunit.client.0.smithi043.stdout:4/724: rename d3/d21/d84/dfd to d3/de/d46/d6a/d8f/d8e/d101 0 2024-04-25T23:01:08.851 INFO:tasks.workunit.client.0.smithi043.stdout:2/603: mkdir d2/d66/dc5 0 2024-04-25T23:01:08.851 INFO:tasks.workunit.client.0.smithi043.stdout:4/725: chown d3/de/d27/le5 718 1 2024-04-25T23:01:08.851 INFO:tasks.workunit.client.0.smithi043.stdout:5/766: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fe0 [287937,81725] 0 2024-04-25T23:01:08.851 INFO:tasks.workunit.client.0.smithi043.stdout:4/726: stat d3/d21/lbb 0 2024-04-25T23:01:08.852 INFO:tasks.workunit.client.0.smithi043.stdout:2/604: mkdir d2/d66/dc6 0 2024-04-25T23:01:08.852 INFO:tasks.workunit.client.0.smithi043.stdout:4/727: truncate d3/d21/f7c 537705 0 2024-04-25T23:01:08.853 INFO:tasks.workunit.client.0.smithi043.stdout:2/605: mknod d2/d66/d85/d43/d67/cc7 0 2024-04-25T23:01:08.853 INFO:tasks.workunit.client.0.smithi043.stdout:4/728: mkdir d3/d19/d34/d76/d102 0 2024-04-25T23:01:08.854 INFO:tasks.workunit.client.0.smithi043.stdout:2/606: mkdir d2/d66/dc6/dc8 0 2024-04-25T23:01:08.854 INFO:tasks.workunit.client.0.smithi043.stdout:2/607: creat d2/d66/d85/d76/fc9 x:0 0 0 2024-04-25T23:01:08.855 INFO:tasks.workunit.client.0.smithi043.stdout:4/729: truncate d3/de/d46/d6a/fac 585978 0 2024-04-25T23:01:08.861 INFO:tasks.workunit.client.0.smithi043.stdout:9/706: dread d8/de/d12/d16/f36 [0,4194304] 0 2024-04-25T23:01:08.861 INFO:tasks.workunit.client.0.smithi043.stdout:2/608: dwrite d2/d66/d85/d43/d5d/f84 [0,4194304] 0 2024-04-25T23:01:08.862 INFO:tasks.workunit.client.0.smithi043.stdout:9/707: creat d8/de/d12/d7a/fef x:0 0 0 2024-04-25T23:01:08.863 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:08.860+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:08.863 INFO:tasks.workunit.client.0.smithi043.stdout:3/782: dread d7/d26/d27/d34/d1a/d40/d8f/f5c [0,4194304] 0 2024-04-25T23:01:08.863 INFO:tasks.workunit.client.0.smithi043.stdout:2/609: write d2/d66/d85/d76/d97/fe [4426563,103888] 0 2024-04-25T23:01:08.863 INFO:tasks.workunit.client.0.smithi043.stdout:9/708: dread - d8/de/d12/d16/d24/dbe/dc6/d2f/da6/fe7 zero size 2024-04-25T23:01:08.864 INFO:tasks.workunit.client.0.smithi043.stdout:2/610: creat d2/d66/d85/d76/d97/d77/d9a/fca x:0 0 0 2024-04-25T23:01:08.864 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:08.865 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:08.865 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:08.866 INFO:tasks.workunit.client.0.smithi043.stdout:7/721: write d3/f7b [1110293,122279] 0 2024-04-25T23:01:08.870 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:08.870 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:08.870 INFO:tasks.workunit.client.0.smithi043.stdout:3/783: dread d7/d26/d2d/f36 [0,4194304] 0 2024-04-25T23:01:08.871 INFO:tasks.workunit.client.0.smithi043.stdout:4/730: dwrite d3/de/d27/d5c/d67/ffb [0,4194304] 0 2024-04-25T23:01:08.872 INFO:tasks.workunit.client.0.smithi043.stdout:2/611: write d2/d66/d85/d43/d67/db3/d13/f6e [3683934,63058] 0 2024-04-25T23:01:08.873 INFO:tasks.workunit.client.0.smithi043.stdout:3/784: symlink d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/l11c 0 2024-04-25T23:01:08.874 INFO:tasks.workunit.client.0.smithi043.stdout:2/612: stat d2/d66/d85/d43/d67/db3/d13/l5b 0 2024-04-25T23:01:08.874 INFO:tasks.workunit.client.0.smithi043.stdout:4/731: chown d3/de/d46/d6a/d8f/d8e/le8 254311854 1 2024-04-25T23:01:08.874 INFO:tasks.workunit.client.0.smithi043.stdout:7/722: dwrite d3/da/df/d11/d8d/d9f/fab [0,4194304] 0 2024-04-25T23:01:08.875 INFO:tasks.workunit.client.0.smithi043.stdout:4/732: read - d3/de/d46/d6a/fd2 zero size 2024-04-25T23:01:08.875 INFO:tasks.workunit.client.0.smithi043.stdout:2/613: stat d2/d66/d85/d76/d97/d77/da2/db7 0 2024-04-25T23:01:08.875 INFO:tasks.workunit.client.0.smithi043.stdout:3/785: truncate d7/d26/d27/d34/f37 1488243 0 2024-04-25T23:01:08.876 INFO:tasks.workunit.client.0.smithi043.stdout:7/723: rename d3/da/df/d11/d8d/da4 to d3/da/df/d11/d8d/da4/de2 22 2024-04-25T23:01:08.878 INFO:tasks.workunit.client.0.smithi043.stdout:4/733: mknod d3/de/d46/d6a/c103 0 2024-04-25T23:01:08.878 INFO:tasks.workunit.client.0.smithi043.stdout:2/614: mkdir d2/d66/d85/d43/d67/db3/dcb 0 2024-04-25T23:01:08.878 INFO:tasks.workunit.client.0.smithi043.stdout:1/684: dread d0/d2f/f48 [4194304,4194304] 0 2024-04-25T23:01:08.878 INFO:tasks.workunit.client.0.smithi043.stdout:7/724: mknod d3/da/df/d11/d8d/dd3/ce3 0 2024-04-25T23:01:08.879 INFO:tasks.workunit.client.0.smithi043.stdout:7/725: stat d3/da/df/d11 0 2024-04-25T23:01:08.879 INFO:tasks.workunit.client.0.smithi043.stdout:4/734: dread - d3/de/d46/d6a/d8f/d8e/db5/ff5 zero size 2024-04-25T23:01:08.880 INFO:tasks.workunit.client.0.smithi043.stdout:7/726: fdatasync d3/d52/f60 0 2024-04-25T23:01:08.880 INFO:tasks.workunit.client.0.smithi043.stdout:7/727: fdatasync d3/d52/f60 0 2024-04-25T23:01:08.881 INFO:tasks.workunit.client.0.smithi043.stdout:9/709: dread d8/de/f3e [0,4194304] 0 2024-04-25T23:01:08.881 INFO:tasks.workunit.client.0.smithi043.stdout:3/786: write d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/ff3 [4724502,12490] 0 2024-04-25T23:01:08.881 INFO:tasks.workunit.client.0.smithi043.stdout:2/615: creat d2/d66/d85/d43/d67/d8d/fcc x:0 0 0 2024-04-25T23:01:08.881 INFO:tasks.workunit.client.0.smithi043.stdout:4/735: symlink d3/d21/da5/dff/l104 0 2024-04-25T23:01:08.881 INFO:tasks.workunit.client.0.smithi043.stdout:7/728: link d3/d9b/d63/fe0 d3/da/df/fe4 0 2024-04-25T23:01:08.882 INFO:tasks.workunit.client.0.smithi043.stdout:3/787: fsync d7/d26/d27/d34/d1a/d40/d8f/d51/de1/ffa 0 2024-04-25T23:01:08.882 INFO:tasks.workunit.client.0.smithi043.stdout:4/736: creat d3/d19/f105 x:0 0 0 2024-04-25T23:01:08.883 INFO:tasks.workunit.client.0.smithi043.stdout:4/737: creat d3/de/d27/d5c/db9/f106 x:0 0 0 2024-04-25T23:01:08.884 INFO:tasks.workunit.client.0.smithi043.stdout:4/738: creat d3/de/d46/f107 x:0 0 0 2024-04-25T23:01:08.885 INFO:tasks.workunit.client.0.smithi043.stdout:6/680: sync 2024-04-25T23:01:08.886 INFO:tasks.workunit.client.0.smithi043.stdout:8/540: sync 2024-04-25T23:01:08.886 INFO:tasks.workunit.client.0.smithi043.stdout:3/788: truncate d7/d26/d59/d7c/fdf 3226804 0 2024-04-25T23:01:08.888 INFO:tasks.workunit.client.0.smithi043.stdout:6/681: creat d1/d2a/dd5/fed x:0 0 0 2024-04-25T23:01:08.888 INFO:tasks.workunit.client.0.smithi043.stdout:2/616: dwrite d2/d66/d85/d43/d67/db3/f2f [0,4194304] 0 2024-04-25T23:01:08.890 INFO:tasks.workunit.client.0.smithi043.stdout:7/729: dwrite d3/d1e/d1f/dc5/f82 [0,4194304] 0 2024-04-25T23:01:08.890 INFO:tasks.workunit.client.0.smithi043.stdout:6/682: dread - d1/d5/d3b/d4c/d21/d55/f74 zero size 2024-04-25T23:01:08.891 INFO:tasks.workunit.client.0.smithi043.stdout:6/683: write d1/d5/d3b/d62/f73 [4461383,74443] 0 2024-04-25T23:01:08.892 INFO:tasks.workunit.client.0.smithi043.stdout:6/684: stat d1/d5/d3b/d4c/d21/d55/d6d/d91/d94/cbd 0 2024-04-25T23:01:08.893 INFO:tasks.workunit.client.0.smithi043.stdout:6/685: readlink d1/d5/d3b/d4c/d21/d55/d6d/lb7 0 2024-04-25T23:01:08.894 INFO:tasks.workunit.client.0.smithi043.stdout:7/730: mkdir d3/d1e/d1f/d6b/d72/de5 0 2024-04-25T23:01:08.894 INFO:tasks.workunit.client.0.smithi043.stdout:3/789: dread d7/d26/d27/d34/f37 [0,4194304] 0 2024-04-25T23:01:08.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/686: chown d1/d5/d3b/d4c/d21/d55/d6d/fcc 0 1 2024-04-25T23:01:08.895 INFO:tasks.workunit.client.0.smithi043.stdout:7/731: getdents d3/dc1/dcf 0 2024-04-25T23:01:08.896 INFO:tasks.workunit.client.0.smithi043.stdout:3/790: rename d7/d26/d27/l107 to d7/dac/l11d 0 2024-04-25T23:01:08.896 INFO:tasks.workunit.client.0.smithi043.stdout:7/732: readlink d3/da/la5 0 2024-04-25T23:01:08.897 INFO:tasks.workunit.client.0.smithi043.stdout:3/791: write d7/dac/f114 [931561,108841] 0 2024-04-25T23:01:08.897 INFO:tasks.workunit.client.0.smithi043.stdout:7/733: fsync d3/d1e/f39 0 2024-04-25T23:01:08.897 INFO:tasks.workunit.client.0.smithi043.stdout:2/617: dwrite d2/d66/d85/d43/d5d/da9/fc3 [0,4194304] 0 2024-04-25T23:01:08.897 INFO:tasks.workunit.client.0.smithi043.stdout:7/734: chown d3/d1e/d1f/d6b/d72 3648775 1 2024-04-25T23:01:08.899 INFO:tasks.workunit.client.0.smithi043.stdout:9/710: dread d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/f5b [0,4194304] 0 2024-04-25T23:01:08.900 INFO:tasks.workunit.client.0.smithi043.stdout:7/735: creat d3/d9b/d63/d98/fe6 x:0 0 0 2024-04-25T23:01:08.900 INFO:tasks.workunit.client.0.smithi043.stdout:9/711: readlink d8/de/d44/d65/l64 0 2024-04-25T23:01:08.900 INFO:tasks.workunit.client.0.smithi043.stdout:3/792: rename d7/d26/d88/db0/fe3 to d7/d26/d59/d7c/db2/f11e 0 2024-04-25T23:01:08.901 INFO:tasks.workunit.client.0.smithi043.stdout:3/793: dread - d7/d26/fbc zero size 2024-04-25T23:01:08.902 INFO:tasks.workunit.client.0.smithi043.stdout:3/794: fsync d7/d26/d2d/dab/fc5 0 2024-04-25T23:01:08.902 INFO:tasks.workunit.client.0.smithi043.stdout:9/712: stat d8/de/d12/d16/d24/dbe/dc6/d2f/da6/ld1 0 2024-04-25T23:01:08.903 INFO:tasks.workunit.client.0.smithi043.stdout:9/713: mkdir d8/de/d12/d16/d24/df0 0 2024-04-25T23:01:08.904 INFO:tasks.workunit.client.0.smithi043.stdout:2/618: dwrite d2/d66/d85/d43/d5d/f54 [4194304,4194304] 0 2024-04-25T23:01:08.906 INFO:tasks.workunit.client.0.smithi043.stdout:9/714: mknod d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/cf1 0 2024-04-25T23:01:08.907 INFO:tasks.workunit.client.0.smithi043.stdout:7/736: dwrite d3/fad [0,4194304] 0 2024-04-25T23:01:08.908 INFO:tasks.workunit.client.0.smithi043.stdout:4/739: dread d3/fa [0,4194304] 0 2024-04-25T23:01:08.909 INFO:tasks.workunit.client.0.smithi043.stdout:9/715: link d8/de/d12/c49 d8/de/d44/cf2 0 2024-04-25T23:01:08.910 INFO:tasks.workunit.client.0.smithi043.stdout:9/716: dread - d8/de/d44/d5d/fdb zero size 2024-04-25T23:01:08.911 INFO:tasks.workunit.client.0.smithi043.stdout:4/740: creat d3/d19/d34/d76/d102/f108 x:0 0 0 2024-04-25T23:01:08.913 INFO:tasks.workunit.client.0.smithi043.stdout:9/717: symlink d8/de/d12/d16/d24/dbe/dc6/d2f/dad/lf3 0 2024-04-25T23:01:08.913 INFO:tasks.workunit.client.0.smithi043.stdout:4/741: readlink d3/d19/lb7 0 2024-04-25T23:01:08.914 INFO:tasks.workunit.client.0.smithi043.stdout:7/737: dwrite d3/da/d78/fa9 [0,4194304] 0 2024-04-25T23:01:08.914 INFO:tasks.workunit.client.0.smithi043.stdout:4/742: read d3/de/d46/d6a/fac [211116,1663] 0 2024-04-25T23:01:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/743: chown d3/de/d27/ff9 15 1 2024-04-25T23:01:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:9/718: mknod d8/de/d44/d47/d6a/cf4 0 2024-04-25T23:01:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/744: write d3/de/d46/d6a/d8f/d8e/db5/ff5 [384462,97941] 0 2024-04-25T23:01:08.917 INFO:tasks.workunit.client.0.smithi043.stdout:7/738: symlink d3/da/df/d11/le7 0 2024-04-25T23:01:08.918 INFO:tasks.workunit.client.0.smithi043.stdout:9/719: creat d8/de/d44/d47/d6a/ff5 x:0 0 0 2024-04-25T23:01:08.918 INFO:tasks.workunit.client.0.smithi043.stdout:7/739: fdatasync d3/d9b/d63/d98/f9a 0 2024-04-25T23:01:08.919 INFO:tasks.workunit.client.0.smithi043.stdout:3/795: dread d7/d26/d27/d34/f24 [0,4194304] 0 2024-04-25T23:01:08.920 INFO:tasks.workunit.client.0.smithi043.stdout:4/745: chown d3/de/d27/d5c/d67/ccd 11379969 1 2024-04-25T23:01:08.921 INFO:tasks.workunit.client.0.smithi043.stdout:3/796: chown d7/d26/d27/d34/d1a/fb3 1091 1 2024-04-25T23:01:08.922 INFO:tasks.workunit.client.0.smithi043.stdout:7/740: creat d3/da/df/d11/d8d/d9f/fe8 x:0 0 0 2024-04-25T23:01:08.923 INFO:tasks.workunit.client.0.smithi043.stdout:7/741: creat d3/d9b/d63/dc9/fe9 x:0 0 0 2024-04-25T23:01:08.924 INFO:tasks.workunit.client.0.smithi043.stdout:9/720: dwrite d8/fc1 [0,4194304] 0 2024-04-25T23:01:08.924 INFO:tasks.workunit.client.0.smithi043.stdout:7/742: chown d3/da/df/d11/d26/c32 71 1 2024-04-25T23:01:08.925 INFO:tasks.workunit.client.0.smithi043.stdout:4/746: dread d3/f3c [0,4194304] 0 2024-04-25T23:01:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:4/747: creat d3/d19/d34/d76/f109 x:0 0 0 2024-04-25T23:01:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:9/721: getdents d8/de/d44 0 2024-04-25T23:01:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:9/722: creat d8/de/d12/de4/ff6 x:0 0 0 2024-04-25T23:01:08.929 INFO:tasks.workunit.client.0.smithi043.stdout:9/723: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/ff7 x:0 0 0 2024-04-25T23:01:08.930 INFO:tasks.workunit.client.0.smithi043.stdout:7/743: write d3/d1e/d1f/f24 [694537,109585] 0 2024-04-25T23:01:08.932 INFO:tasks.workunit.client.0.smithi043.stdout:6/687: dread d1/d5/d3b/f44 [0,4194304] 0 2024-04-25T23:01:08.932 INFO:tasks.workunit.client.0.smithi043.stdout:9/724: symlink d8/de/d12/d16/d24/dbe/dc6/d68/lf8 0 2024-04-25T23:01:08.932 INFO:tasks.workunit.client.0.smithi043.stdout:8/541: dread d3/d4/db/d4e/d8b/d9f/d33/f67 [0,4194304] 0 2024-04-25T23:01:08.933 INFO:tasks.workunit.client.0.smithi043.stdout:7/744: rename d3/d1e/f39 to d3/da/df/d11/d8d/dd3/fea 0 2024-04-25T23:01:08.933 INFO:tasks.workunit.client.0.smithi043.stdout:9/725: rmdir d8/de/d12/d16/d24/dbe/dc6 39 2024-04-25T23:01:08.934 INFO:tasks.workunit.client.0.smithi043.stdout:6/688: read d1/d5/f1b [510020,21045] 0 2024-04-25T23:01:08.934 INFO:tasks.workunit.client.0.smithi043.stdout:7/745: write d3/da/f36 [2587004,94701] 0 2024-04-25T23:01:08.934 INFO:tasks.workunit.client.0.smithi043.stdout:8/542: link d3/d4/db/f4a d3/d4/db/d4e/d8b/d91/fad 0 2024-04-25T23:01:08.935 INFO:tasks.workunit.client.0.smithi043.stdout:4/748: dwrite d3/d21/d6b/d87/d8a/fed [0,4194304] 0 2024-04-25T23:01:08.936 INFO:tasks.workunit.client.0.smithi043.stdout:7/746: truncate d3/d1e/d1f/f7c 1101872 0 2024-04-25T23:01:08.936 INFO:tasks.workunit.client.0.smithi043.stdout:6/689: creat d1/d5/d3b/d4c/d21/d55/d6d/d91/fee x:0 0 0 2024-04-25T23:01:08.936 INFO:tasks.workunit.client.0.smithi043.stdout:9/726: creat d8/de/d12/d16/d24/dbe/dc6/d2f/dad/ff9 x:0 0 0 2024-04-25T23:01:08.936 INFO:tasks.workunit.client.0.smithi043.stdout:4/749: creat d3/de/d46/d6a/f10a x:0 0 0 2024-04-25T23:01:08.937 INFO:tasks.workunit.client.0.smithi043.stdout:8/543: write d3/d4/db/d4e/d5c/d59/d61/d66/f6f [578646,102657] 0 2024-04-25T23:01:08.938 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:08.932+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:9/727: chown d8/de/d44/d5d/fc7 29483368 1 2024-04-25T23:01:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:4/750: mkdir d3/d19/d10b 0 2024-04-25T23:01:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:6/690: symlink d1/d5/d3b/d4c/d21/d55/d68/lef 0 2024-04-25T23:01:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:8/544: write d3/d4/db/f2d [2589792,103485] 0 2024-04-25T23:01:08.939 INFO:tasks.workunit.client.0.smithi043.stdout:4/751: unlink d3/de/d27/c43 0 2024-04-25T23:01:08.939 INFO:tasks.workunit.client.0.smithi043.stdout:9/728: mkdir d8/de/d12/dfa 0 2024-04-25T23:01:08.940 INFO:tasks.workunit.client.0.smithi043.stdout:2/619: dread d2/d66/d85/d76/d97/f26 [0,4194304] 0 2024-04-25T23:01:08.940 INFO:tasks.workunit.client.0.smithi043.stdout:7/747: truncate d3/da/df/d11/d8d/dd3/fea 1919374 0 2024-04-25T23:01:08.941 INFO:tasks.workunit.client.0.smithi043.stdout:9/729: mknod d8/de/d44/d5d/cfb 0 2024-04-25T23:01:08.941 INFO:tasks.workunit.client.0.smithi043.stdout:8/545: write d3/d4/db/d4e/d5c/d59/d61/d66/f89 [639946,113421] 0 2024-04-25T23:01:08.941 INFO:tasks.workunit.client.0.smithi043.stdout:6/691: rename d1/d5/d3b/d4c/f6b to d1/d5/d3b/d4c/ff0 0 2024-04-25T23:01:08.941 INFO:tasks.workunit.client.0.smithi043.stdout:7/748: mknod d3/d1e/d1f/d6b/d72/ceb 0 2024-04-25T23:01:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:4/752: getdents d3/de/d46/d6a/d8f/d8e 0 2024-04-25T23:01:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:6/692: mknod d1/d2a/db5/dcb/cf1 0 2024-04-25T23:01:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:8/546: write d3/d4/d7c/d92/fa4 [952417,113663] 0 2024-04-25T23:01:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:9/730: mknod d8/de/d12/d16/d24/df0/cfc 0 2024-04-25T23:01:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:4/753: write d3/d21/f7c [1387356,33697] 0 2024-04-25T23:01:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:7/749: creat d3/d1e/d1f/dc5/fec x:0 0 0 2024-04-25T23:01:08.943 INFO:tasks.workunit.client.0.smithi043.stdout:6/693: write d1/f53 [5641228,73181] 0 2024-04-25T23:01:08.943 INFO:tasks.workunit.client.0.smithi043.stdout:8/547: write d3/d4/d36/f45 [4573371,70760] 0 2024-04-25T23:01:08.943 INFO:tasks.workunit.client.0.smithi043.stdout:7/750: read - d3/da/df/fcb zero size 2024-04-25T23:01:08.944 INFO:tasks.workunit.client.0.smithi043.stdout:8/548: fsync d3/d4/d7c/d92/f58 0 2024-04-25T23:01:08.944 INFO:tasks.workunit.client.0.smithi043.stdout:7/751: dread - d3/dc1/fd7 zero size 2024-04-25T23:01:08.947 INFO:tasks.workunit.client.0.smithi043.stdout:8/549: getdents d3/d4/db/d4e/d5c/d2e 0 2024-04-25T23:01:08.948 INFO:tasks.workunit.client.0.smithi043.stdout:7/752: read d3/d1e/d1f/dc5/f9d [203178,38833] 0 2024-04-25T23:01:08.948 INFO:tasks.workunit.client.0.smithi043.stdout:2/620: dwrite d2/d66/d85/d43/f8a [0,4194304] 0 2024-04-25T23:01:08.948 INFO:tasks.workunit.client.0.smithi043.stdout:8/550: chown d3/d4/c60 187883363 1 2024-04-25T23:01:08.951 INFO:tasks.workunit.client.0.smithi043.stdout:9/731: dwrite d8/de/d12/d16/d24/dbe/dc6/d6c/f70 [4194304,4194304] 0 2024-04-25T23:01:08.951 INFO:tasks.workunit.client.0.smithi043.stdout:2/621: stat d2/l2a 0 2024-04-25T23:01:08.951 INFO:tasks.workunit.client.0.smithi043.stdout:8/551: symlink d3/d4/db/d14/d56/lae 0 2024-04-25T23:01:08.952 INFO:tasks.workunit.client.0.smithi043.stdout:6/694: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fa9 [0,4194304] 0 2024-04-25T23:01:08.952 INFO:tasks.workunit.client.0.smithi043.stdout:7/753: readlink d3/lc2 0 2024-04-25T23:01:08.953 INFO:tasks.workunit.client.0.smithi043.stdout:2/622: chown d2/d66/d85/d43/d67/db3/l70 3400 1 2024-04-25T23:01:08.953 INFO:tasks.workunit.client.0.smithi043.stdout:9/732: chown d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31 110829762 1 2024-04-25T23:01:08.954 INFO:tasks.workunit.client.0.smithi043.stdout:2/623: readlink d2/d66/d85/d76/l7c 0 2024-04-25T23:01:08.954 INFO:tasks.workunit.client.0.smithi043.stdout:9/733: chown d8/de/d44/d47/d6a/fd8 450 1 2024-04-25T23:01:08.955 INFO:tasks.workunit.client.0.smithi043.stdout:7/754: creat d3/d9b/fed x:0 0 0 2024-04-25T23:01:08.955 INFO:tasks.workunit.client.0.smithi043.stdout:8/552: getdents d3/d4/d7c/d92 0 2024-04-25T23:01:08.955 INFO:tasks.workunit.client.0.smithi043.stdout:7/755: chown d3/da/d78/dd4 227762322 1 2024-04-25T23:01:08.956 INFO:tasks.workunit.client.0.smithi043.stdout:9/734: fsync d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f66 0 2024-04-25T23:01:08.956 INFO:tasks.workunit.client.0.smithi043.stdout:8/553: creat d3/faf x:0 0 0 2024-04-25T23:01:08.957 INFO:tasks.workunit.client.0.smithi043.stdout:2/624: write d2/d66/d85/d43/d67/d8d/fb8 [45229,114491] 0 2024-04-25T23:01:08.958 INFO:tasks.workunit.client.0.smithi043.stdout:8/554: write d3/d4/db/d4e/d5c/d59/d61/d66/f6f [5146991,108273] 0 2024-04-25T23:01:08.959 INFO:tasks.workunit.client.0.smithi043.stdout:6/695: dread d1/d5/d3b/d4c/ff0 [0,4194304] 0 2024-04-25T23:01:08.959 INFO:tasks.workunit.client.0.smithi043.stdout:8/555: mkdir d3/d4/db/d4e/d8b/d9f/d33/db0 0 2024-04-25T23:01:08.959 INFO:tasks.workunit.client.0.smithi043.stdout:9/735: truncate d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/fe1 2519013 0 2024-04-25T23:01:08.960 INFO:tasks.workunit.client.0.smithi043.stdout:6/696: fsync d1/f1f 0 2024-04-25T23:01:08.960 INFO:tasks.workunit.client.0.smithi043.stdout:9/736: readlink d8/de/d12/le0 0 2024-04-25T23:01:08.960 INFO:tasks.workunit.client.0.smithi043.stdout:6/697: fdatasync d1/f78 0 2024-04-25T23:01:08.961 INFO:tasks.workunit.client.0.smithi043.stdout:8/556: symlink d3/d4/db/lb1 0 2024-04-25T23:01:08.961 INFO:tasks.workunit.client.0.smithi043.stdout:9/737: creat d8/de/d12/de4/ffd x:0 0 0 2024-04-25T23:01:08.962 INFO:tasks.workunit.client.0.smithi043.stdout:6/698: chown d1/d5/d3b/d4c/d21/d55/d6d 206903273 1 2024-04-25T23:01:08.962 INFO:tasks.workunit.client.0.smithi043.stdout:9/738: mknod d8/de/d12/d16/cfe 0 2024-04-25T23:01:08.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/756: dwrite d3/da/df/fe4 [0,4194304] 0 2024-04-25T23:01:08.966 INFO:tasks.workunit.client.0.smithi043.stdout:9/739: link d8/de/d44/d47/d6a/fd8 d8/de/d44/d5d/dd2/fff 0 2024-04-25T23:01:08.967 INFO:tasks.workunit.client.0.smithi043.stdout:9/740: chown d8/de/d44/d65/faf 3385 1 2024-04-25T23:01:08.968 INFO:tasks.workunit.client.0.smithi043.stdout:9/741: mknod d8/de/c100 0 2024-04-25T23:01:08.968 INFO:tasks.workunit.client.0.smithi043.stdout:6/699: dwrite d1/f1f [0,4194304] 0 2024-04-25T23:01:08.970 INFO:tasks.workunit.client.0.smithi043.stdout:6/700: unlink d1/d5/d3b/d4c/f93 0 2024-04-25T23:01:08.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/742: read d8/de/d44/d5d/da1/fcd [858091,26467] 0 2024-04-25T23:01:08.971 INFO:tasks.workunit.client.0.smithi043.stdout:7/757: dwrite d3/d1e/d1f/d6b/d72/fdd [0,4194304] 0 2024-04-25T23:01:08.972 INFO:tasks.workunit.client.0.smithi043.stdout:9/743: write d8/f96 [802648,75201] 0 2024-04-25T23:01:08.973 INFO:tasks.workunit.client.0.smithi043.stdout:7/758: rmdir d3/d1e/d1f 39 2024-04-25T23:01:08.973 INFO:tasks.workunit.client.0.smithi043.stdout:9/744: symlink d8/de/d44/d5d/dd2/l101 0 2024-04-25T23:01:08.975 INFO:tasks.workunit.client.0.smithi043.stdout:0/678: sync 2024-04-25T23:01:08.975 INFO:tasks.workunit.client.0.smithi043.stdout:5/767: sync 2024-04-25T23:01:08.975 INFO:tasks.workunit.client.0.smithi043.stdout:9/745: mknod d8/de/d44/d65/c102 0 2024-04-25T23:01:08.975 INFO:tasks.workunit.client.0.smithi043.stdout:7/759: getdents d3/d1e/d1f 0 2024-04-25T23:01:08.976 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:08.977 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:08.977 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:08.977 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:08.977 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:08.977 INFO:tasks.workunit.client.0.smithi043.stdout:6/701: dwrite d1/d2a/f4e [0,4194304] 0 2024-04-25T23:01:08.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/702: dread d1/d5/f3f [4194304,4194304] 0 2024-04-25T23:01:08.980 INFO:tasks.workunit.client.0.smithi043.stdout:7/760: dread d3/da/df/d11/d8d/d9f/fab [0,4194304] 0 2024-04-25T23:01:08.981 INFO:tasks.workunit.client.0.smithi043.stdout:7/761: mkdir d3/da/d64/dee 0 2024-04-25T23:01:08.982 INFO:tasks.workunit.client.0.smithi043.stdout:7/762: chown d3/da/d78/dd4 40419477 1 2024-04-25T23:01:08.982 INFO:tasks.workunit.client.0.smithi043.stdout:0/679: dwrite d1b/faa [0,4194304] 0 2024-04-25T23:01:08.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/763: truncate d3/d1e/d1f/dc5/fdb 1045546 0 2024-04-25T23:01:08.983 INFO:tasks.workunit.client.0.smithi043.stdout:0/680: unlink d1b/d23/d39/db3/f88 0 2024-04-25T23:01:08.984 INFO:tasks.workunit.client.0.smithi043.stdout:7/764: symlink d3/da/d64/lef 0 2024-04-25T23:01:08.984 INFO:tasks.workunit.client.0.smithi043.stdout:0/681: chown d1b/d31/f96 11328 1 2024-04-25T23:01:08.985 INFO:tasks.workunit.client.0.smithi043.stdout:7/765: mknod d3/d1e/d1f/d54/cf0 0 2024-04-25T23:01:08.988 INFO:tasks.workunit.client.0.smithi043.stdout:9/746: write d8/de/d12/d16/d24/dbe/dc6/d2f/f50 [1585566,31470] 0 2024-04-25T23:01:08.989 INFO:tasks.workunit.client.0.smithi043.stdout:0/682: dwrite d1b/d23/f2a [0,4194304] 0 2024-04-25T23:01:08.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:08.992 INFO:tasks.workunit.client.0.smithi043.stdout:0/683: creat d1b/d7f/fd8 x:0 0 0 2024-04-25T23:01:08.992 INFO:tasks.workunit.client.0.smithi043.stdout:9/747: write d8/de/d12/d16/d24/dbe/dc6/d68/f88 [4374058,113563] 0 2024-04-25T23:01:08.992 INFO:tasks.workunit.client.0.smithi043.stdout:7/766: dwrite d3/da/df/fb7 [0,4194304] 0 2024-04-25T23:01:08.993 INFO:tasks.workunit.client.0.smithi043.stdout:7/767: fdatasync d3/da/df/f3f 0 2024-04-25T23:01:08.993 INFO:tasks.workunit.client.0.smithi043.stdout:9/748: chown d8/de/d12/d16/d24/dbe/dc6/d2f/dad/ld0 100563 1 2024-04-25T23:01:08.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/754: dread d3/de/d46/d95/fbe [0,4194304] 0 2024-04-25T23:01:08.995 INFO:tasks.workunit.client.0.smithi043.stdout:7/768: rename d3/da/df/d11/d8d/da4/fb9 to d3/da/df/d11/d8d/dba/ff1 0 2024-04-25T23:01:08.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/769: mkdir d3/da/df/d11/df2 0 2024-04-25T23:01:08.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/770: mknod d3/da/df/d11/df2/cf3 0 2024-04-25T23:01:08.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/771: write d3/d9b/f80 [2093810,56910] 0 2024-04-25T23:01:09.002 INFO:tasks.workunit.client.0.smithi043.stdout:9/749: dread d8/de/d12/d16/f25 [0,4194304] 0 2024-04-25T23:01:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:0/684: write d1b/f45 [4614693,127935] 0 2024-04-25T23:01:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:4/755: write d3/d37/d4d/fb0 [2228161,77924] 0 2024-04-25T23:01:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/750: write d8/de/f78 [4472972,19875] 0 2024-04-25T23:01:09.004 INFO:tasks.workunit.client.0.smithi043.stdout:4/756: dread - d3/d19/d34/d76/d102/f108 zero size 2024-04-25T23:01:09.004 INFO:tasks.workunit.client.0.smithi043.stdout:2/625: dread d2/d66/d85/d43/d5d/f54 [0,4194304] 0 2024-04-25T23:01:09.004 INFO:tasks.workunit.client.0.smithi043.stdout:9/751: mkdir d8/de/d44/d65/d103 0 2024-04-25T23:01:09.005 INFO:tasks.workunit.client.0.smithi043.stdout:2/626: creat d2/d66/d85/d76/d97/fcd x:0 0 0 2024-04-25T23:01:09.006 INFO:tasks.workunit.client.0.smithi043.stdout:0/685: read d1b/d23/f3e [766085,97717] 0 2024-04-25T23:01:09.007 INFO:tasks.workunit.client.0.smithi043.stdout:2/627: creat d2/d66/d85/d76/d97/d77/fce x:0 0 0 2024-04-25T23:01:09.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/752: link d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/l92 d8/de/d44/d5d/l104 0 2024-04-25T23:01:09.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/686: mknod d1b/db0/cd9 0 2024-04-25T23:01:09.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/687: rmdir d1b 39 2024-04-25T23:01:09.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/753: stat d8/de/d44/d47/d6a/fd8 0 2024-04-25T23:01:09.008 INFO:tasks.workunit.client.0.smithi043.stdout:2/628: fsync d2/d66/d85/d43/d67/db3/d13/d4f/da0/fbe 0 2024-04-25T23:01:09.009 INFO:tasks.workunit.client.0.smithi043.stdout:2/629: write d2/d66/d85/d43/d67/d8d/f79 [5348016,108501] 0 2024-04-25T23:01:09.010 INFO:tasks.workunit.client.0.smithi043.stdout:4/757: dwrite d3/d37/d7a/fdd [0,4194304] 0 2024-04-25T23:01:09.014 INFO:tasks.workunit.client.0.smithi043.stdout:2/630: symlink d2/d66/d85/d43/d67/db3/d13/d4f/db9/lcf 0 2024-04-25T23:01:09.015 INFO:tasks.workunit.client.0.smithi043.stdout:0/688: dwrite d1b/d31/d3c/fae [0,4194304] 0 2024-04-25T23:01:09.017 INFO:tasks.workunit.client.0.smithi043.stdout:0/689: mknod d1b/dcf/cda 0 2024-04-25T23:01:09.017 INFO:tasks.workunit.client.0.smithi043.stdout:2/631: creat d2/d4b/fd0 x:0 0 0 2024-04-25T23:01:09.017 INFO:tasks.workunit.client.0.smithi043.stdout:4/758: dwrite d3/d37/d4d/f52 [0,4194304] 0 2024-04-25T23:01:09.018 INFO:tasks.workunit.client.0.smithi043.stdout:2/632: rmdir d2/d66/d85/d43/d67/db3/d13/d4f/db9 39 2024-04-25T23:01:09.018 INFO:tasks.workunit.client.0.smithi043.stdout:0/690: creat d1b/d23/d7a/fdb x:0 0 0 2024-04-25T23:01:09.019 INFO:tasks.workunit.client.0.smithi043.stdout:0/691: write d1b/d55/d8f/fa1 [465149,482] 0 2024-04-25T23:01:09.021 INFO:tasks.workunit.client.0.smithi043.stdout:0/692: link d1b/c25 d1b/d23/d7b/da6/db7/cdc 0 2024-04-25T23:01:09.021 INFO:tasks.workunit.client.0.smithi043.stdout:0/693: fdatasync d1b/f40 0 2024-04-25T23:01:09.022 INFO:tasks.workunit.client.0.smithi043.stdout:0/694: mkdir d1b/d23/d91/ddd 0 2024-04-25T23:01:09.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/759: truncate d3/f96 2008925 0 2024-04-25T23:01:09.023 INFO:tasks.workunit.client.0.smithi043.stdout:0/695: creat d1b/d23/d39/d90/fde x:0 0 0 2024-04-25T23:01:09.025 INFO:tasks.workunit.client.0.smithi043.stdout:4/760: rename d3/de/d46/l69 to d3/de/d46/d6a/d8f/d8e/l10c 0 2024-04-25T23:01:09.025 INFO:tasks.workunit.client.0.smithi043.stdout:7/772: dread d3/da/df/d11/f93 [0,4194304] 0 2024-04-25T23:01:09.025 INFO:tasks.workunit.client.0.smithi043.stdout:7/773: fdatasync d3/dc1/fd7 0 2024-04-25T23:01:09.026 INFO:tasks.workunit.client.0.smithi043.stdout:2/633: dwrite d2/d66/d85/d76/d97/d77/d9a/fca [0,4194304] 0 2024-04-25T23:01:09.026 INFO:tasks.workunit.client.0.smithi043.stdout:7/774: dread - d3/d1e/d1f/d6b/d72/f97 zero size 2024-04-25T23:01:09.027 INFO:tasks.workunit.client.0.smithi043.stdout:7/775: write d3/d1e/d1f/f6a [2068595,119622] 0 2024-04-25T23:01:09.028 INFO:tasks.workunit.client.0.smithi043.stdout:7/776: chown d3/d1e/d1f/d6b/d72/lc7 213826427 1 2024-04-25T23:01:09.030 INFO:tasks.workunit.client.0.smithi043.stdout:7/777: dread d3/d1e/d1f/dc5/fdb [0,4194304] 0 2024-04-25T23:01:09.031 INFO:tasks.workunit.client.0.smithi043.stdout:7/778: rename d3/da/df/fcb to d3/d9b/d63/dc9/ff4 0 2024-04-25T23:01:09.032 INFO:tasks.workunit.client.0.smithi043.stdout:7/779: mknod d3/da/df/d11/cf5 0 2024-04-25T23:01:09.033 INFO:tasks.workunit.client.0.smithi043.stdout:9/754: dread d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/fd3 [4194304,4194304] 0 2024-04-25T23:01:09.033 INFO:tasks.workunit.client.0.smithi043.stdout:7/780: symlink d3/da/df/d11/d8d/dba/lf6 0 2024-04-25T23:01:09.034 INFO:tasks.workunit.client.0.smithi043.stdout:7/781: chown d3/d9b/f4a 14 1 2024-04-25T23:01:09.035 INFO:tasks.workunit.client.0.smithi043.stdout:7/782: creat d3/da/d64/dee/ff7 x:0 0 0 2024-04-25T23:01:09.036 INFO:tasks.workunit.client.0.smithi043.stdout:7/783: chown d3/d9b/d63/dc9 105598600 1 2024-04-25T23:01:09.036 INFO:tasks.workunit.client.0.smithi043.stdout:7/784: mknod d3/d52/cf8 0 2024-04-25T23:01:09.037 INFO:tasks.workunit.client.0.smithi043.stdout:2/634: write d2/d66/d85/d76/d97/d48/f5a [3450207,4445] 0 2024-04-25T23:01:09.037 INFO:tasks.workunit.client.0.smithi043.stdout:7/785: rename d3/d52/c5e to d3/da/df/d11/d8d/da4/cf9 0 2024-04-25T23:01:09.038 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.034+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.038 INFO:tasks.workunit.client.0.smithi043.stdout:2/635: symlink d2/d66/d85/d43/d5d/da9/ld1 0 2024-04-25T23:01:09.038 INFO:tasks.workunit.client.0.smithi043.stdout:7/786: dread - d3/da/d64/dee/ff7 zero size 2024-04-25T23:01:09.039 INFO:tasks.workunit.client.0.smithi043.stdout:9/755: dwrite d8/de/d12/fa2 [0,4194304] 0 2024-04-25T23:01:09.040 INFO:tasks.workunit.client.0.smithi043.stdout:7/787: dread d3/da/d78/fbe [0,4194304] 0 2024-04-25T23:01:09.041 INFO:tasks.workunit.client.0.smithi043.stdout:9/756: rmdir d8 39 2024-04-25T23:01:09.041 INFO:tasks.workunit.client.0.smithi043.stdout:2/636: unlink d2/d66/d85/d43/d67/db3/d13/d4f/db9/fc2 0 2024-04-25T23:01:09.042 INFO:tasks.workunit.client.0.smithi043.stdout:7/788: getdents d3/da/df/d11/d8d/d9f 0 2024-04-25T23:01:09.042 INFO:tasks.workunit.client.0.smithi043.stdout:2/637: creat d2/d66/d85/d76/d97/fd2 x:0 0 0 2024-04-25T23:01:09.043 INFO:tasks.workunit.client.0.smithi043.stdout:2/638: rmdir d2/d66/d85/d43/d67/d8d 39 2024-04-25T23:01:09.045 INFO:tasks.workunit.client.0.smithi043.stdout:2/639: mknod d2/d66/d85/cd3 0 2024-04-25T23:01:09.046 INFO:tasks.workunit.client.0.smithi043.stdout:2/640: readlink d2/d66/d85/d43/d67/db3/d13/l5c 0 2024-04-25T23:01:09.046 INFO:tasks.workunit.client.0.smithi043.stdout:2/641: rename d2 to d2/d7f/dd4 22 2024-04-25T23:01:09.048 INFO:tasks.workunit.client.0.smithi043.stdout:2/642: creat d2/d66/d85/d76/d97/d77/fd5 x:0 0 0 2024-04-25T23:01:09.048 INFO:tasks.workunit.client.0.smithi043.stdout:9/757: dwrite d8/de/d44/d47/d6a/fd8 [0,4194304] 0 2024-04-25T23:01:09.048 INFO:tasks.workunit.client.0.smithi043.stdout:7/789: dwrite d3/d1e/f50 [0,4194304] 0 2024-04-25T23:01:09.048 INFO:tasks.workunit.client.0.smithi043.stdout:7/790: chown d3/lc2 26 1 2024-04-25T23:01:09.051 INFO:tasks.workunit.client.0.smithi043.stdout:2/643: creat d2/d66/d85/d43/d67/db3/d13/d4f/db9/fd6 x:0 0 0 2024-04-25T23:01:09.051 INFO:tasks.workunit.client.0.smithi043.stdout:7/791: creat d3/da/df/d11/d8d/d9f/ffa x:0 0 0 2024-04-25T23:01:09.053 INFO:tasks.workunit.client.0.smithi043.stdout:7/792: link d3/d1e/d1f/l5b d3/d9b/ddc/lfb 0 2024-04-25T23:01:09.058 INFO:tasks.workunit.client.0.smithi043.stdout:9/758: dread d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/f3f [0,4194304] 0 2024-04-25T23:01:09.059 INFO:tasks.workunit.client.0.smithi043.stdout:9/759: write d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fd5 [646945,108180] 0 2024-04-25T23:01:09.061 INFO:tasks.workunit.client.0.smithi043.stdout:9/760: rename d8/de/d44/d5d/lcb to d8/de/d12/d16/d24/dbe/dc6/d2f/d84/l105 0 2024-04-25T23:01:09.061 INFO:tasks.workunit.client.0.smithi043.stdout:2/644: read d2/d66/d85/d43/fc4 [15577,22842] 0 2024-04-25T23:01:09.064 INFO:tasks.workunit.client.0.smithi043.stdout:0/696: dread d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:0/697: write d1b/db0/fd5 [404077,24789] 0 2024-04-25T23:01:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:0/698: chown d1b/db0/fd2 1 1 2024-04-25T23:01:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:1/685: sync 2024-04-25T23:01:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:8/557: sync 2024-04-25T23:01:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:3/797: sync 2024-04-25T23:01:09.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/768: sync 2024-04-25T23:01:09.066 INFO:tasks.workunit.client.0.smithi043.stdout:0/699: mkdir d1b/d31/d3c/d72/ddf 0 2024-04-25T23:01:09.066 INFO:tasks.workunit.client.0.smithi043.stdout:3/798: mknod d7/dac/c11f 0 2024-04-25T23:01:09.067 INFO:tasks.workunit.client.0.smithi043.stdout:1/686: chown d0/d86/daa/lee 122787 1 2024-04-25T23:01:09.067 INFO:tasks.workunit.client.0.smithi043.stdout:9/761: dwrite d8/de/d12/d16/f40 [4194304,4194304] 0 2024-04-25T23:01:09.067 INFO:tasks.workunit.client.0.smithi043.stdout:8/558: mknod d3/d4/db/d14/cb2 0 2024-04-25T23:01:09.067 INFO:tasks.workunit.client.0.smithi043.stdout:1/687: chown d0/d86/fb7 219235898 1 2024-04-25T23:01:09.068 INFO:tasks.workunit.client.0.smithi043.stdout:1/688: stat d0/fa 0 2024-04-25T23:01:09.068 INFO:tasks.workunit.client.0.smithi043.stdout:5/769: write d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ff1 [989222,101504] 0 2024-04-25T23:01:09.069 INFO:tasks.workunit.client.0.smithi043.stdout:9/762: rmdir d8/de/d12 39 2024-04-25T23:01:09.069 INFO:tasks.workunit.client.0.smithi043.stdout:1/689: creat d0/d3d/dd7/ffa x:0 0 0 2024-04-25T23:01:09.069 INFO:tasks.workunit.client.0.smithi043.stdout:5/770: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fb3 [1039078,29077] 0 2024-04-25T23:01:09.070 INFO:tasks.workunit.client.0.smithi043.stdout:0/700: getdents d1b/d23/d7b/da6/dcb 0 2024-04-25T23:01:09.070 INFO:tasks.workunit.client.0.smithi043.stdout:7/793: dread d3/da/f36 [4194304,4194304] 0 2024-04-25T23:01:09.070 INFO:tasks.workunit.client.0.smithi043.stdout:5/771: fsync d0/d6a/fcd 0 2024-04-25T23:01:09.071 INFO:tasks.workunit.client.0.smithi043.stdout:1/690: unlink d0/d16/f6d 0 2024-04-25T23:01:09.071 INFO:tasks.workunit.client.0.smithi043.stdout:0/701: chown d1b/d31/f49 34 1 2024-04-25T23:01:09.071 INFO:tasks.workunit.client.0.smithi043.stdout:9/763: write d8/de/d12/de4/ffd [371475,25003] 0 2024-04-25T23:01:09.071 INFO:tasks.workunit.client.0.smithi043.stdout:1/691: unlink d0/d3c/lab 0 2024-04-25T23:01:09.071 INFO:tasks.workunit.client.0.smithi043.stdout:7/794: symlink d3/d9b/da8/lfc 0 2024-04-25T23:01:09.072 INFO:tasks.workunit.client.0.smithi043.stdout:1/692: fdatasync d0/f2 0 2024-04-25T23:01:09.072 INFO:tasks.workunit.client.0.smithi043.stdout:2/645: rename d2/d66/d85/d43/d67/db3/d13/d4f to d2/d66/d85/d43/d5d/da9/dd7 0 2024-04-25T23:01:09.072 INFO:tasks.workunit.client.0.smithi043.stdout:7/795: chown d3/da/df/d11/d8d/dba/lf6 14 1 2024-04-25T23:01:09.072 INFO:tasks.workunit.client.0.smithi043.stdout:1/693: fdatasync d0/d2f/d4b/da6/fe7 0 2024-04-25T23:01:09.073 INFO:tasks.workunit.client.0.smithi043.stdout:0/702: rename d1b/c25 to d1b/d8b/da2/ce0 0 2024-04-25T23:01:09.073 INFO:tasks.workunit.client.0.smithi043.stdout:6/703: sync 2024-04-25T23:01:09.073 INFO:tasks.workunit.client.0.smithi043.stdout:7/796: unlink d3/da/df/d11/f94 0 2024-04-25T23:01:09.074 INFO:tasks.workunit.client.0.smithi043.stdout:1/694: symlink d0/d3d/d4f/lfb 0 2024-04-25T23:01:09.074 INFO:tasks.workunit.client.0.smithi043.stdout:9/764: rename d8/de/d44/d47/c9f to d8/de/d44/d47/d6a/c106 0 2024-04-25T23:01:09.074 INFO:tasks.workunit.client.0.smithi043.stdout:0/703: symlink d1b/d23/d7b/le1 0 2024-04-25T23:01:09.074 INFO:tasks.workunit.client.0.smithi043.stdout:2/646: mknod d2/d66/d85/d43/d67/db3/d13/cd8 0 2024-04-25T23:01:09.074 INFO:tasks.workunit.client.0.smithi043.stdout:6/704: creat d1/dc8/ff2 x:0 0 0 2024-04-25T23:01:09.075 INFO:tasks.workunit.client.0.smithi043.stdout:1/695: creat d0/d3c/ffc x:0 0 0 2024-04-25T23:01:09.075 INFO:tasks.workunit.client.0.smithi043.stdout:7/797: symlink d3/da/df/d11/d8d/da4/lfd 0 2024-04-25T23:01:09.075 INFO:tasks.workunit.client.0.smithi043.stdout:6/705: unlink d1/d5/d3b/d4c/d1a/f27 0 2024-04-25T23:01:09.076 INFO:tasks.workunit.client.0.smithi043.stdout:1/696: write d0/d16/df7/f81 [2811523,64812] 0 2024-04-25T23:01:09.076 INFO:tasks.workunit.client.0.smithi043.stdout:2/647: mknod d2/d66/d85/d43/cd9 0 2024-04-25T23:01:09.076 INFO:tasks.workunit.client.0.smithi043.stdout:5/772: dread d0/d2c/d39/d1c/d25/d7a/d2d/f74 [0,4194304] 0 2024-04-25T23:01:09.076 INFO:tasks.workunit.client.0.smithi043.stdout:0/704: link d1b/d8b/d7d/ca9 d1b/d23/dab/ce2 0 2024-04-25T23:01:09.076 INFO:tasks.workunit.client.0.smithi043.stdout:1/697: dread - d0/d86/fa3 zero size 2024-04-25T23:01:09.077 INFO:tasks.workunit.client.0.smithi043.stdout:1/698: readlink d0/d9/dc0/lc8 0 2024-04-25T23:01:09.077 INFO:tasks.workunit.client.0.smithi043.stdout:6/706: write d1/d5/d3b/d4c/d21/d55/d6d/fcc [1799434,87583] 0 2024-04-25T23:01:09.077 INFO:tasks.workunit.client.0.smithi043.stdout:0/705: rename d1b/d23/d7a/cd0 to d1b/dcf/dd7/ce3 0 2024-04-25T23:01:09.078 INFO:tasks.workunit.client.0.smithi043.stdout:2/648: chown d2/d66/d85/d76/d97/d48/f64 61 1 2024-04-25T23:01:09.078 INFO:tasks.workunit.client.0.smithi043.stdout:1/699: fsync d0/d2f/fb0 0 2024-04-25T23:01:09.079 INFO:tasks.workunit.client.0.smithi043.stdout:5/773: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ffa x:0 0 0 2024-04-25T23:01:09.079 INFO:tasks.workunit.client.0.smithi043.stdout:2/649: fdatasync d2/d66/d85/d76/f91 0 2024-04-25T23:01:09.079 INFO:tasks.workunit.client.0.smithi043.stdout:6/707: rmdir d1/d5/d3b/d4c/d21/d55/d68 39 2024-04-25T23:01:09.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/700: creat d0/d2f/d4b/d8f/ffd x:0 0 0 2024-04-25T23:01:09.080 INFO:tasks.workunit.client.0.smithi043.stdout:2/650: chown d2/d66/d85/d43/cd9 0 1 2024-04-25T23:01:09.080 INFO:tasks.workunit.client.0.smithi043.stdout:6/708: readlink d1/d5/d3b/d4c/l5c 0 2024-04-25T23:01:09.080 INFO:tasks.workunit.client.0.smithi043.stdout:5/774: write d0/d2c/d39/d63/fe8 [1094183,1112] 0 2024-04-25T23:01:09.080 INFO:tasks.workunit.client.0.smithi043.stdout:1/701: link d0/d9/fb4 d0/d9/d63/ffe 0 2024-04-25T23:01:09.080 INFO:tasks.workunit.client.0.smithi043.stdout:6/709: write d1/d5/d3b/d4c/d21/d38/d99/feb [525446,4105] 0 2024-04-25T23:01:09.081 INFO:tasks.workunit.client.0.smithi043.stdout:2/651: read d2/d66/d85/d43/d67/db3/d13/f32 [3400805,66687] 0 2024-04-25T23:01:09.081 INFO:tasks.workunit.client.0.smithi043.stdout:6/710: chown d1/d5/d3b/d62/fe9 3838206 1 2024-04-25T23:01:09.082 INFO:tasks.workunit.client.0.smithi043.stdout:4/761: sync 2024-04-25T23:01:09.082 INFO:tasks.workunit.client.0.smithi043.stdout:5/775: sync 2024-04-25T23:01:09.084 INFO:tasks.workunit.client.0.smithi043.stdout:7/798: truncate d3/f19 2079101 0 2024-04-25T23:01:09.085 INFO:tasks.workunit.client.0.smithi043.stdout:7/799: creat d3/da/d64/ffe x:0 0 0 2024-04-25T23:01:09.086 INFO:tasks.workunit.client.0.smithi043.stdout:2/652: dread d2/d66/d85/d43/f8a [0,4194304] 0 2024-04-25T23:01:09.086 INFO:tasks.workunit.client.0.smithi043.stdout:7/800: write d3/d9b/f92 [1210130,102252] 0 2024-04-25T23:01:09.086 INFO:tasks.workunit.client.0.smithi043.stdout:8/559: dread d3/f48 [0,4194304] 0 2024-04-25T23:01:09.086 INFO:tasks.workunit.client.0.smithi043.stdout:1/702: dread d0/d9/faf [0,4194304] 0 2024-04-25T23:01:09.087 INFO:tasks.workunit.client.0.smithi043.stdout:5/776: fdatasync d0/d2c/d39/d63/fe8 0 2024-04-25T23:01:09.087 INFO:tasks.workunit.client.0.smithi043.stdout:1/703: readlink d0/d9/ld0 0 2024-04-25T23:01:09.087 INFO:tasks.workunit.client.0.smithi043.stdout:2/653: creat d2/d66/d85/d43/d5d/da9/fda x:0 0 0 2024-04-25T23:01:09.088 INFO:tasks.workunit.client.0.smithi043.stdout:6/711: read d1/d5/d3b/d4c/d21/d55/d68/d30/f6e [2148755,1098] 0 2024-04-25T23:01:09.088 INFO:tasks.workunit.client.0.smithi043.stdout:1/704: chown d0/d2f/d4b/d8f/f99 73077619 1 2024-04-25T23:01:09.089 INFO:tasks.workunit.client.0.smithi043.stdout:7/801: rename d3/da/df/d11/d8d/d9f/cae to d3/cff 0 2024-04-25T23:01:09.089 INFO:tasks.workunit.client.0.smithi043.stdout:8/560: truncate d3/d4/d7c/d92/d62/fa9 751731 0 2024-04-25T23:01:09.089 INFO:tasks.workunit.client.0.smithi043.stdout:5/777: rename d0/d2c/d39/d1c/d25/d7a/d41/cc1 to d0/d2c/d39/d1c/d25/cfb 0 2024-04-25T23:01:09.090 INFO:tasks.workunit.client.0.smithi043.stdout:6/712: chown d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/c89 11252 1 2024-04-25T23:01:09.090 INFO:tasks.workunit.client.0.smithi043.stdout:2/654: mknod d2/d66/d85/d76/d97/d77/da2/db7/dbf/cdb 0 2024-04-25T23:01:09.090 INFO:tasks.workunit.client.0.smithi043.stdout:7/802: mknod d3/d1e/d1f/d6b/c100 0 2024-04-25T23:01:09.091 INFO:tasks.workunit.client.0.smithi043.stdout:8/561: rmdir d3/d4/db/d53 0 2024-04-25T23:01:09.091 INFO:tasks.workunit.client.0.smithi043.stdout:9/765: sync 2024-04-25T23:01:09.091 INFO:tasks.workunit.client.0.smithi043.stdout:6/713: truncate d1/f78 1687175 0 2024-04-25T23:01:09.091 INFO:tasks.workunit.client.0.smithi043.stdout:9/766: readlink d8/de/d12/d16/l2b 0 2024-04-25T23:01:09.092 INFO:tasks.workunit.client.0.smithi043.stdout:7/803: mkdir d3/da/df/d11/d26/d101 0 2024-04-25T23:01:09.093 INFO:tasks.workunit.client.0.smithi043.stdout:6/714: chown d1/d2a/db5/dc4/dc9 18712 1 2024-04-25T23:01:09.093 INFO:tasks.workunit.client.0.smithi043.stdout:2/655: write d2/d66/d85/d43/d67/db3/d13/d40/f51 [2257365,79512] 0 2024-04-25T23:01:09.094 INFO:tasks.workunit.client.0.smithi043.stdout:8/562: rename d3/d4/db/d4e/l52 to d3/d4/db/d4e/d5c/lb3 0 2024-04-25T23:01:09.095 INFO:tasks.workunit.client.0.smithi043.stdout:7/804: truncate d3/d1e/d1f/d54/fb5 635219 0 2024-04-25T23:01:09.095 INFO:tasks.workunit.client.0.smithi043.stdout:6/715: chown d1/d5/d3b/d4c/ld3 29009901 1 2024-04-25T23:01:09.097 INFO:tasks.workunit.client.0.smithi043.stdout:1/705: dwrite d0/d3c/f6c [0,4194304] 0 2024-04-25T23:01:09.098 INFO:tasks.workunit.client.0.smithi043.stdout:9/767: dread d8/de/d12/fa2 [0,4194304] 0 2024-04-25T23:01:09.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/716: truncate d1/d5/d3b/d4c/d21/d38/d99/f9d 1289427 0 2024-04-25T23:01:09.099 INFO:tasks.workunit.client.0.smithi043.stdout:3/799: dread d7/d26/f3d [0,4194304] 0 2024-04-25T23:01:09.100 INFO:tasks.workunit.client.0.smithi043.stdout:7/805: creat d3/da/d64/f102 x:0 0 0 2024-04-25T23:01:09.100 INFO:tasks.workunit.client.0.smithi043.stdout:8/563: mkdir d3/d4/db/d4e/d8b/d9f/db4 0 2024-04-25T23:01:09.100 INFO:tasks.workunit.client.0.smithi043.stdout:6/717: truncate d1/d5/d3b/d4c/f15 3393281 0 2024-04-25T23:01:09.103 INFO:tasks.workunit.client.0.smithi043.stdout:3/800: rename d7/d26/d27/d34/d1a/d28/c90 to d7/d26/d59/d7c/db2/d87/c120 0 2024-04-25T23:01:09.104 INFO:tasks.workunit.client.0.smithi043.stdout:2/656: dread d2/d66/d85/d43/d67/db3/f47 [0,4194304] 0 2024-04-25T23:01:09.104 INFO:tasks.workunit.client.0.smithi043.stdout:6/718: mkdir d1/d5/d3b/d4c/d21/df3 0 2024-04-25T23:01:09.105 INFO:tasks.workunit.client.0.smithi043.stdout:3/801: read - d7/d26/d97/fc3 zero size 2024-04-25T23:01:09.105 INFO:tasks.workunit.client.0.smithi043.stdout:9/768: dread d8/f96 [0,4194304] 0 2024-04-25T23:01:09.105 INFO:tasks.workunit.client.0.smithi043.stdout:4/762: dread d3/d21/d6b/f81 [0,4194304] 0 2024-04-25T23:01:09.106 INFO:tasks.workunit.client.0.smithi043.stdout:1/706: dwrite d0/d2f/d4b/d8f/fd8 [0,4194304] 0 2024-04-25T23:01:09.107 INFO:tasks.workunit.client.0.smithi043.stdout:3/802: mkdir d7/d26/d88/d121 0 2024-04-25T23:01:09.107 INFO:tasks.workunit.client.0.smithi043.stdout:4/763: creat d3/d37/d4d/f10d x:0 0 0 2024-04-25T23:01:09.108 INFO:tasks.workunit.client.0.smithi043.stdout:1/707: write d0/d9/fae [2018747,119546] 0 2024-04-25T23:01:09.110 INFO:tasks.workunit.client.0.smithi043.stdout:3/803: mkdir d7/d26/d27/d34/d1a/d40/d8f/d122 0 2024-04-25T23:01:09.110 INFO:tasks.workunit.client.0.smithi043.stdout:8/564: write d3/d4/db/d14/d4c/d77/f27 [9949969,4005] 0 2024-04-25T23:01:09.110 INFO:tasks.workunit.client.0.smithi043.stdout:4/764: creat d3/d21/d6b/d87/d8a/f10e x:0 0 0 2024-04-25T23:01:09.111 INFO:tasks.workunit.client.0.smithi043.stdout:5/778: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ffa [0,4194304] 0 2024-04-25T23:01:09.112 INFO:tasks.workunit.client.0.smithi043.stdout:8/565: fdatasync d3/f48 0 2024-04-25T23:01:09.113 INFO:tasks.workunit.client.0.smithi043.stdout:9/769: dread d8/de/d44/d47/d6a/fd8 [0,4194304] 0 2024-04-25T23:01:09.113 INFO:tasks.workunit.client.0.smithi043.stdout:0/706: dread d1b/fa4 [0,4194304] 0 2024-04-25T23:01:09.113 INFO:tasks.workunit.client.0.smithi043.stdout:6/719: rename d1/d5/d3b/d4c/d21/d38/de6/cec to d1/d5/d3b/d4c/cf4 0 2024-04-25T23:01:09.114 INFO:tasks.workunit.client.0.smithi043.stdout:3/804: dread - d7/d26/d27/d34/d1a/d28/d9e/dcc/fd1 zero size 2024-04-25T23:01:09.114 INFO:tasks.workunit.client.0.smithi043.stdout:4/765: mkdir d3/d10f 0 2024-04-25T23:01:09.114 INFO:tasks.workunit.client.0.smithi043.stdout:2/657: truncate d2/d66/d85/d43/d67/db3/f42 3738628 0 2024-04-25T23:01:09.114 INFO:tasks.workunit.client.0.smithi043.stdout:6/720: fdatasync d1/f6a 0 2024-04-25T23:01:09.115 INFO:tasks.workunit.client.0.smithi043.stdout:4/766: chown d3/d21/d6b/d87/c9d 7084 1 2024-04-25T23:01:09.116 INFO:tasks.workunit.client.0.smithi043.stdout:3/805: sync 2024-04-25T23:01:09.116 INFO:tasks.workunit.client.0.smithi043.stdout:9/770: write d8/de/d12/d16/d24/dbe/dc6/d2f/f50 [2426787,31507] 0 2024-04-25T23:01:09.116 INFO:tasks.workunit.client.0.smithi043.stdout:1/708: creat d0/d16/d5a/d5b/fff x:0 0 0 2024-04-25T23:01:09.116 INFO:tasks.workunit.client.0.smithi043.stdout:4/767: stat d3/l62 0 2024-04-25T23:01:09.117 INFO:tasks.workunit.client.0.smithi043.stdout:0/707: creat d1b/d23/d39/db3/fe4 x:0 0 0 2024-04-25T23:01:09.117 INFO:tasks.workunit.client.0.smithi043.stdout:2/658: mknod d2/d7f/cdc 0 2024-04-25T23:01:09.117 INFO:tasks.workunit.client.0.smithi043.stdout:8/566: creat d3/fb5 x:0 0 0 2024-04-25T23:01:09.118 INFO:tasks.workunit.client.0.smithi043.stdout:5/779: truncate d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ffa 4397922 0 2024-04-25T23:01:09.118 INFO:tasks.workunit.client.0.smithi043.stdout:7/806: dwrite d3/d1e/d1f/f7c [0,4194304] 0 2024-04-25T23:01:09.118 INFO:tasks.workunit.client.0.smithi043.stdout:4/768: chown d3/d21/d6b/f75 1 1 2024-04-25T23:01:09.118 INFO:tasks.workunit.client.0.smithi043.stdout:6/721: creat d1/d5/d3b/d4c/d21/d55/d68/d30/ff5 x:0 0 0 2024-04-25T23:01:09.119 INFO:tasks.workunit.client.0.smithi043.stdout:0/708: write d1b/d23/d39/db3/f54 [198105,118309] 0 2024-04-25T23:01:09.119 INFO:tasks.workunit.client.0.smithi043.stdout:3/806: creat d7/d26/d27/d34/d1a/d28/d9e/f123 x:0 0 0 2024-04-25T23:01:09.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/659: mkdir d2/d66/d85/d43/d67/ddd 0 2024-04-25T23:01:09.120 INFO:tasks.workunit.client.0.smithi043.stdout:1/709: rename d0/d16/d5a/d5b/fe5 to d0/d16/dd1/f100 0 2024-04-25T23:01:09.120 INFO:tasks.workunit.client.0.smithi043.stdout:6/722: mkdir d1/d2a/db5/df6 0 2024-04-25T23:01:09.120 INFO:tasks.workunit.client.0.smithi043.stdout:5/780: write d0/d2c/d39/d1c/d25/d7a/d2d/f74 [811610,61291] 0 2024-04-25T23:01:09.120 INFO:tasks.workunit.client.0.smithi043.stdout:4/769: stat d3/d19/cf3 0 2024-04-25T23:01:09.120 INFO:tasks.workunit.client.0.smithi043.stdout:7/807: mknod d3/da/df/d11/d8d/d9f/c103 0 2024-04-25T23:01:09.121 INFO:tasks.workunit.client.0.smithi043.stdout:0/709: fsync d1b/d23/f3e 0 2024-04-25T23:01:09.122 INFO:tasks.workunit.client.0.smithi043.stdout:6/723: write d1/d5/d3b/d4c/d21/d38/d60/fa5 [499245,15031] 0 2024-04-25T23:01:09.122 INFO:tasks.workunit.client.0.smithi043.stdout:1/710: write d0/d86/fb7 [691389,92088] 0 2024-04-25T23:01:09.122 INFO:tasks.workunit.client.0.smithi043.stdout:2/660: mknod d2/d66/d85/d43/d67/d8d/cde 0 2024-04-25T23:01:09.123 INFO:tasks.workunit.client.0.smithi043.stdout:0/710: creat d1b/d23/d39/db3/fe5 x:0 0 0 2024-04-25T23:01:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:9/771: getdents d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9 0 2024-04-25T23:01:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:5/781: link d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fb3 d0/d2c/d39/d1c/d5e/ffc 0 2024-04-25T23:01:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:3/807: rmdir d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/d10b/d10e 0 2024-04-25T23:01:09.125 INFO:tasks.workunit.client.0.smithi043.stdout:6/724: stat d1/d5/d3b/d4c/d1a/c66 0 2024-04-25T23:01:09.125 INFO:tasks.workunit.client.0.smithi043.stdout:5/782: mknod d0/d22/d95/cfd 0 2024-04-25T23:01:09.126 INFO:tasks.workunit.client.0.smithi043.stdout:2/661: read d2/d66/d85/d43/f8a [2093332,43319] 0 2024-04-25T23:01:09.126 INFO:tasks.workunit.client.0.smithi043.stdout:3/808: symlink d7/d26/d59/l124 0 2024-04-25T23:01:09.126 INFO:tasks.workunit.client.0.smithi043.stdout:0/711: unlink d1b/d23/d7a/dad/fbf 0 2024-04-25T23:01:09.129 INFO:tasks.workunit.client.0.smithi043.stdout:6/725: rmdir d1/d5/d3b/d4c/d21/d55/d68/d30/d8f 0 2024-04-25T23:01:09.131 INFO:tasks.workunit.client.0.smithi043.stdout:5/783: creat d0/d2c/d39/d1c/d25/ffe x:0 0 0 2024-04-25T23:01:09.131 INFO:tasks.workunit.client.0.smithi043.stdout:2/662: mknod d2/d66/d85/d43/d67/db3/d13/d40/cdf 0 2024-04-25T23:01:09.131 INFO:tasks.workunit.client.0.smithi043.stdout:7/808: dwrite d3/d9b/d63/f73 [0,4194304] 0 2024-04-25T23:01:09.131 INFO:tasks.workunit.client.0.smithi043.stdout:1/711: dwrite d0/d86/fa3 [0,4194304] 0 2024-04-25T23:01:09.131 INFO:tasks.workunit.client.0.smithi043.stdout:3/809: mknod d7/d26/d88/d121/c125 0 2024-04-25T23:01:09.133 INFO:tasks.workunit.client.0.smithi043.stdout:3/810: stat d7/d26/d59/d7c/fa1 0 2024-04-25T23:01:09.134 INFO:tasks.workunit.client.0.smithi043.stdout:7/809: fsync d3/da/df/d11/d26/f74 0 2024-04-25T23:01:09.134 INFO:tasks.workunit.client.0.smithi043.stdout:9/772: dwrite d8/fc1 [0,4194304] 0 2024-04-25T23:01:09.134 INFO:tasks.workunit.client.0.smithi043.stdout:1/712: mknod d0/d16/df7/dbf/c101 0 2024-04-25T23:01:09.135 INFO:tasks.workunit.client.0.smithi043.stdout:7/810: chown d3/c53 35469 1 2024-04-25T23:01:09.136 INFO:tasks.workunit.client.0.smithi043.stdout:0/712: dwrite d1b/db0/fd2 [0,4194304] 0 2024-04-25T23:01:09.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/773: chown d8/de/d12/d16/d24/dbe/dc6/d68/fc4 3106974 1 2024-04-25T23:01:09.137 INFO:tasks.workunit.client.0.smithi043.stdout:9/774: chown d8/de/d8c/faa 1283 1 2024-04-25T23:01:09.138 INFO:tasks.workunit.client.0.smithi043.stdout:1/713: creat d0/d9/ddc/f102 x:0 0 0 2024-04-25T23:01:09.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/811: symlink d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/d10b/l126 0 2024-04-25T23:01:09.138 INFO:tasks.workunit.client.0.smithi043.stdout:6/726: getdents d1/d5/d3b/d4c/d1a 0 2024-04-25T23:01:09.139 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.134+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.139 INFO:tasks.workunit.client.0.smithi043.stdout:7/811: write d3/da/df/d11/d8d/d9f/ffa [256270,87623] 0 2024-04-25T23:01:09.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/663: getdents d2/d66/d85/d76/d97 0 2024-04-25T23:01:09.141 INFO:tasks.workunit.client.0.smithi043.stdout:5/784: getdents d0/d2c/d39/d1c 0 2024-04-25T23:01:09.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/664: sync 2024-04-25T23:01:09.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/812: mkdir d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/d127 0 2024-04-25T23:01:09.142 INFO:tasks.workunit.client.0.smithi043.stdout:9/775: symlink d8/de/d12/d16/d24/dbe/dc6/d6c/l107 0 2024-04-25T23:01:09.145 INFO:tasks.workunit.client.0.smithi043.stdout:0/713: dwrite d1b/d7f/fd8 [0,4194304] 0 2024-04-25T23:01:09.145 INFO:tasks.workunit.client.0.smithi043.stdout:6/727: write d1/d2a/db5/dcb/fd9 [1275452,12905] 0 2024-04-25T23:01:09.147 INFO:tasks.workunit.client.0.smithi043.stdout:3/813: creat d7/d26/d88/db8/d101/f128 x:0 0 0 2024-04-25T23:01:09.148 INFO:tasks.workunit.client.0.smithi043.stdout:9/776: link d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fb9 d8/de/d8c/f108 0 2024-04-25T23:01:09.148 INFO:tasks.workunit.client.0.smithi043.stdout:0/714: creat d1b/d23/d7a/dc8/fe6 x:0 0 0 2024-04-25T23:01:09.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/785: rename d0/f35 to d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fff 0 2024-04-25T23:01:09.149 INFO:tasks.workunit.client.0.smithi043.stdout:7/812: dwrite d3/d1e/fd2 [0,4194304] 0 2024-04-25T23:01:09.150 INFO:tasks.workunit.client.0.smithi043.stdout:3/814: creat d7/d26/d59/f129 x:0 0 0 2024-04-25T23:01:09.150 INFO:tasks.workunit.client.0.smithi043.stdout:0/715: rmdir d1b 39 2024-04-25T23:01:09.151 INFO:tasks.workunit.client.0.smithi043.stdout:5/786: chown d0/d2c/d39/d1c/d25/d7a/f1e 8 1 2024-04-25T23:01:09.152 INFO:tasks.workunit.client.0.smithi043.stdout:5/787: unlink d0/d22/d95/cf7 0 2024-04-25T23:01:09.153 INFO:tasks.workunit.client.0.smithi043.stdout:2/665: dwrite d2/d66/d85/d76/d97/f39 [0,4194304] 0 2024-04-25T23:01:09.154 INFO:tasks.workunit.client.0.smithi043.stdout:7/813: write d3/dc1/fc3 [520542,35863] 0 2024-04-25T23:01:09.156 INFO:tasks.workunit.client.0.smithi043.stdout:2/666: mknod d2/d66/dc5/ce0 0 2024-04-25T23:01:09.157 INFO:tasks.workunit.client.0.smithi043.stdout:7/814: symlink d3/d1e/l104 0 2024-04-25T23:01:09.158 INFO:tasks.workunit.client.0.smithi043.stdout:8/567: dread d3/d4/d7c/f9e [0,4194304] 0 2024-04-25T23:01:09.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/777: dwrite d8/de/d44/d47/d6a/ff5 [0,4194304] 0 2024-04-25T23:01:09.160 INFO:tasks.workunit.client.0.smithi043.stdout:5/788: read d0/d2c/d39/d1c/d5e/ffc [2799806,11604] 0 2024-04-25T23:01:09.160 INFO:tasks.workunit.client.0.smithi043.stdout:0/716: dwrite d1b/d23/d39/d90/f97 [0,4194304] 0 2024-04-25T23:01:09.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/778: write d8/de/d12/d16/d24/dbe/dc6/d2f/dad/ff9 [60965,74355] 0 2024-04-25T23:01:09.161 INFO:tasks.workunit.client.0.smithi043.stdout:4/770: dread d3/d37/d4d/fc5 [0,4194304] 0 2024-04-25T23:01:09.161 INFO:tasks.workunit.client.0.smithi043.stdout:5/789: mknod d0/d2c/d39/d1c/c100 0 2024-04-25T23:01:09.163 INFO:tasks.workunit.client.0.smithi043.stdout:9/779: creat d8/de/d44/d65/f109 x:0 0 0 2024-04-25T23:01:09.164 INFO:tasks.workunit.client.0.smithi043.stdout:4/771: symlink d3/d19/d34/d76/l110 0 2024-04-25T23:01:09.164 INFO:tasks.workunit.client.0.smithi043.stdout:8/568: creat d3/d4/db/d14/d56/d5d/d9c/da7/fb6 x:0 0 0 2024-04-25T23:01:09.165 INFO:tasks.workunit.client.0.smithi043.stdout:3/815: write d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f10f [723054,9302] 0 2024-04-25T23:01:09.165 INFO:tasks.workunit.client.0.smithi043.stdout:8/569: read - d3/d4/db/fa6 zero size 2024-04-25T23:01:09.166 INFO:tasks.workunit.client.0.smithi043.stdout:9/780: fdatasync d8/de/d12/d16/d24/dbe/dc6/d2f/f43 0 2024-04-25T23:01:09.166 INFO:tasks.workunit.client.0.smithi043.stdout:6/728: truncate d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fc0 4023200 0 2024-04-25T23:01:09.166 INFO:tasks.workunit.client.0.smithi043.stdout:2/667: dwrite d2/d66/d85/d43/d67/db3/f2c [0,4194304] 0 2024-04-25T23:01:09.167 INFO:tasks.workunit.client.0.smithi043.stdout:7/815: dwrite d3/d1e/d1f/d6b/d72/f77 [0,4194304] 0 2024-04-25T23:01:09.167 INFO:tasks.workunit.client.0.smithi043.stdout:8/570: mkdir d3/d4/db/d4e/d5c/d59/db7 0 2024-04-25T23:01:09.168 INFO:tasks.workunit.client.0.smithi043.stdout:3/816: mkdir d7/d26/d59/d7c/db2/d87/d12a 0 2024-04-25T23:01:09.168 INFO:tasks.workunit.client.0.smithi043.stdout:9/781: mkdir d8/de/d12/d10a 0 2024-04-25T23:01:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:8/571: dread - d3/faf zero size 2024-04-25T23:01:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:6/729: symlink d1/d2a/db5/dcb/lf7 0 2024-04-25T23:01:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:7/816: chown d3/d9b/f4a 7994720 1 2024-04-25T23:01:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:2/668: creat d2/d66/d85/d76/d97/d77/da2/db5/fe1 x:0 0 0 2024-04-25T23:01:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/782: write d8/de/d44/d65/faf [1049695,88997] 0 2024-04-25T23:01:09.170 INFO:tasks.workunit.client.0.smithi043.stdout:6/730: fsync d1/d5/d3b/d4c/d21/d38/f45 0 2024-04-25T23:01:09.171 INFO:tasks.workunit.client.0.smithi043.stdout:9/783: write d8/de/d44/d65/f109 [134559,75057] 0 2024-04-25T23:01:09.171 INFO:tasks.workunit.client.0.smithi043.stdout:7/817: link d3/d1e/d1f/c6f d3/da/df/c105 0 2024-04-25T23:01:09.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/669: write d2/d66/d85/d43/d67/db3/d13/d40/f7b [860361,91466] 0 2024-04-25T23:01:09.172 INFO:tasks.workunit.client.0.smithi043.stdout:6/731: rmdir d1/d2a/db5/df6 0 2024-04-25T23:01:09.172 INFO:tasks.workunit.client.0.smithi043.stdout:2/670: readlink d2/l53 0 2024-04-25T23:01:09.172 INFO:tasks.workunit.client.0.smithi043.stdout:7/818: unlink d3/d1e/f9e 0 2024-04-25T23:01:09.173 INFO:tasks.workunit.client.0.smithi043.stdout:7/819: mkdir d3/d9b/da8/d106 0 2024-04-25T23:01:09.175 INFO:tasks.workunit.client.0.smithi043.stdout:6/732: write d1/d5/d3b/d4c/d21/d55/d68/d30/f35 [2233952,57804] 0 2024-04-25T23:01:09.177 INFO:tasks.workunit.client.0.smithi043.stdout:3/817: dwrite d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe2 [0,4194304] 0 2024-04-25T23:01:09.177 INFO:tasks.workunit.client.0.smithi043.stdout:4/772: symlink d3/d19/d34/d76/d102/l111 0 2024-04-25T23:01:09.179 INFO:tasks.workunit.client.0.smithi043.stdout:6/733: fdatasync d1/d5/d3b/fac 0 2024-04-25T23:01:09.179 INFO:tasks.workunit.client.0.smithi043.stdout:5/790: readlink d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/lac 0 2024-04-25T23:01:09.181 INFO:tasks.workunit.client.0.smithi043.stdout:9/784: dread d8/de/d44/d47/fd7 [0,4194304] 0 2024-04-25T23:01:09.182 INFO:tasks.workunit.client.0.smithi043.stdout:8/572: dwrite d3/d4/db/d4e/d5c/d2e/f46 [0,4194304] 0 2024-04-25T23:01:09.186 INFO:tasks.workunit.client.0.smithi043.stdout:3/818: unlink d7/d26/d59/d7c/db2/d87/fa5 0 2024-04-25T23:01:09.186 INFO:tasks.workunit.client.0.smithi043.stdout:4/773: symlink d3/d21/l112 0 2024-04-25T23:01:09.186 INFO:tasks.workunit.client.0.smithi043.stdout:0/717: dwrite d1b/d8b/f9c [0,4194304] 0 2024-04-25T23:01:09.186 INFO:tasks.workunit.client.0.smithi043.stdout:6/734: symlink d1/d5/d3b/d4c/d21/d55/d68/d7f/lf8 0 2024-04-25T23:01:09.186 INFO:tasks.workunit.client.0.smithi043.stdout:2/671: dwrite d2/d66/d85/d43/d5d/f7d [0,4194304] 0 2024-04-25T23:01:09.186 INFO:tasks.workunit.client.0.smithi043.stdout:7/820: dwrite d3/da/df/fb7 [0,4194304] 0 2024-04-25T23:01:09.187 INFO:tasks.workunit.client.0.smithi043.stdout:7/821: fsync d3/d9b/f92 0 2024-04-25T23:01:09.187 INFO:tasks.workunit.client.0.smithi043.stdout:3/819: fsync d7/d26/d59/d7c/db2/d87/fe8 0 2024-04-25T23:01:09.187 INFO:tasks.workunit.client.0.smithi043.stdout:4/774: write d3/d21/d6b/d87/d9a/fc2 [234790,53963] 0 2024-04-25T23:01:09.187 INFO:tasks.workunit.client.0.smithi043.stdout:6/735: creat d1/d2a/ff9 x:0 0 0 2024-04-25T23:01:09.188 INFO:tasks.workunit.client.0.smithi043.stdout:0/718: write d1b/d23/d39/f67 [508734,12449] 0 2024-04-25T23:01:09.188 INFO:tasks.workunit.client.0.smithi043.stdout:5/791: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/fff [3608325,92611] 0 2024-04-25T23:01:09.188 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.315193745, 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.193 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.315162759, 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:09.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:09.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.315120337, 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:09.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.315089518000001, 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:09.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:09.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.315059839, 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:09.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:09.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.300802839999999, 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:09.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.300392473, 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:09.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.297891776, 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:09.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:09.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:09.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.297839175, 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.297805729, 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:09.232 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:09.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:09.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:09.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.290453545, 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.237 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:09.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:09.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.290340228, 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.242 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:09.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:09.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.290276284000001, 2024-04-25T23:01:09.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.290231272, 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.290194026, 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.288860127, 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.2866994, 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.284553499999999, 2024-04-25T23:01:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.284187430999999, 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.280733590000001, 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:09.289 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:09.291 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:09.295 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.286+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.306 INFO:tasks.workunit.client.0.smithi043.stdout:0/719: rmdir d1b/d8b 39 2024-04-25T23:01:09.306 INFO:tasks.workunit.client.0.smithi043.stdout:2/672: fdatasync d2/d66/d85/d43/d67/db3/d13/d40/fba 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:5/792: unlink d0/d2c/d39/d1c/d25/d4e/fbd 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:4/775: rename d3/d21/d6b/d87/fb1 to d3/de/d46/d6a/d8f/d8e/db5/dda/f113 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:3/820: write d7/d26/d27/d34/d1a/d40/d8f/f3e [3298104,21920] 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:2/673: chown d2/d66/d85/d76/d97/d77/da2/fa4 1393300563 1 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:7/822: mkdir d3/da/d78/dd4/d107 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:3/821: mknod d7/d26/d59/d7c/db2/d87/c12b 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:7/823: creat d3/f108 x:0 0 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:4/776: rename d3/d19/d34/dea/dc8/ld9 to d3/d19/l114 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:3/822: chown d7/d26/d59/d7c/db2/d87/fec 14089409 1 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:4/777: rename d3/d10f to d3/d19/d34/d76/d115 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:3/823: creat d7/d26/d59/d7c/f12c x:0 0 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:9/785: read d8/de/d12/d16/f40 [1462701,3247] 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:7/824: truncate d3/d1e/d1f/d6b/d72/f77 3489455 0 2024-04-25T23:01:09.307 INFO:tasks.workunit.client.0.smithi043.stdout:8/573: dwrite d3/d4/db/d4e/d8b/d9f/f65 [0,4194304] 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/825: rmdir d3/da/df/d11/d8d/dd3 39 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/786: link d8/de/d12/d16/l7f d8/de/d44/de8/l10b 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/826: symlink d3/da/df/d11/d8d/da4/l109 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/827: symlink d3/da/d78/dd4/d107/l10a 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/787: link d8/de/d12/d7a/fef d8/de/d44/d47/f10c 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/788: chown d8/de/d12/le0 24749 1 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/789: mkdir d8/de/d12/d16/d24/dbe/d10d 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:8/574: dwrite d3/fb5 [0,4194304] 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/790: symlink d8/de/d8c/l10e 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/828: dwrite d3/d1e/d1f/fda [0,4194304] 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/791: stat d8/de/d12/c49 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/829: creat d3/d9b/ddc/f10b x:0 0 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:0/720: truncate d1b/d8b/dc0/fc9 4055015 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:0/721: write d1b/d31/d3c/d50/f9b [4375058,91777] 0 2024-04-25T23:01:09.308 INFO:tasks.workunit.client.0.smithi043.stdout:4/778: write d3/d21/f63 [2763545,84372] 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/792: truncate d8/de/d44/d5d/dd2/fff 3725970 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/793: sync 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/793: creat d8/de/d44/d5d/f10f x:0 0 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/794: mkdir d8/de/d44/d5d/d4f/d110 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/794: unlink d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/ce6 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:4/779: link d3/d19/d34/cf6 d3/d19/d34/d76/c116 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/795: mkdir d0/d2c/d39/d1c/d101 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/795: mkdir d8/de/d12/d16/d24/dbe/d10d/d111 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/796: unlink d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fc5 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/722: dwrite d1b/d23/d7b/da6/fb8 [0,4194304] 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/723: fdatasync d1b/dcf/fd1 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/797: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d102 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/798: symlink d0/d2c/d39/d1c/d25/d7a/d2d/dc9/l103 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/736: dread d1/d5/d3b/d4c/d21/f97 [0,4194304] 0 2024-04-25T23:01:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/796: truncate d8/f96 114051 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:7/830: dread d3/da/d64/f8b [0,4194304] 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:0/724: truncate d1b/f37 3793261 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:6/737: chown d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/f75 1941065165 1 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:7/831: chown d3/da/df/fb7 10199068 1 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:9/797: symlink d8/de/d44/d65/l112 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:0/725: creat d1b/d23/d91/fe7 x:0 0 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/799: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/feb [0,4194304] 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:0/726: creat d1b/d8b/da2/fe8 x:0 0 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/800: sync 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:6/738: rename d1/d5/d3b/d4c/d21/d55/d6d/d91 to d1/d2a/db5/dc4/dfa 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:7/832: rmdir d3/d1e/d1f/d6b/d72/de5 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:6/739: fsync d1/d5/d3b/d62/fc1 0 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:6/740: chown d1/d2a/c4d 1139058 1 2024-04-25T23:01:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/801: stat d0/d2c/d39/d1c/d25/d7a/d41/l8d 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:5/802: sync 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/833: fdatasync d3/da/df/f48 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/834: mkdir d3/d9b/ddc/d10c 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:5/803: symlink d0/d2c/d39/d1c/d25/d7a/d2d/d8b/l104 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/741: truncate d1/d5/f2c 160030 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/742: chown d1/d5/d3b/d62/d79 1087 1 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/835: truncate d3/d9b/ddc/f10b 1014702 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:5/804: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/d105 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:0/727: dwrite d1b/fa4 [0,4194304] 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/743: stat d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/cd1 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/836: readlink d3/da/df/d11/l3a 0 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:5/805: read - d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62/fd6 zero size 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/744: chown d1/fe 52 1 2024-04-25T23:01:09.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/745: creat d1/d5/d3b/d4c/d21/d38/de6/ffb x:0 0 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:0/728: dwrite d1b/d23/f3e [0,4194304] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:3/824: dread d7/dac/f114 [0,4194304] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/746: creat d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/ffc x:0 0 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:5/806: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d8b/daf/fd3 [0,4194304] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:3/825: write d7/d26/f7e [558663,25015] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:7/837: dwrite d3/d1e/d1f/dc5/fdb [0,4194304] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/747: mknod d1/d5/d3b/d4c/d21/d55/cfd 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:3/826: write d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f10f [689668,107761] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/748: creat d1/d5/d3b/d4c/d21/d55/d6d/ffe x:0 0 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:3/827: read d7/d26/f3d [1687621,116335] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:3/828: chown d7/d26/d97/fc3 0 1 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:1/714: dread d0/d3d/fea [0,4194304] 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/749: rename d1/f6a to d1/d2a/db5/dcb/fff 0 2024-04-25T23:01:09.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/750: sync 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:3/829: stat d7/d26/d27/d34/d1a/d40/d8f/d51/fd2 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/715: creat d0/d2f/d4b/f103 x:0 0 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/716: sync 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:3/830: fdatasync d7/d26/d27/d34/d1a/d40/d8f/d51/f10c 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/717: creat d0/d2f/d4b/da6/f104 x:0 0 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/718: mkdir d0/d3d/d105 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/719: write d0/d16/f4a [141571,80585] 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/720: write d0/d3c/f62 [97056,86149] 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/674: dread d2/d66/d85/d76/d97/f52 [0,4194304] 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/721: write d0/d3d/dd7/fe3 [939270,23274] 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:6/751: write d1/d5/d3b/fda [888762,34347] 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/675: fdatasync d2/d66/d85/d43/d67/db3/f34 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:9/798: dread d8/de/d44/d65/faf [0,4194304] 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:6/752: stat d1/d5/d3b/d4c/d21/d55/d68/lef 0 2024-04-25T23:01:09.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/676: write d2/d66/d85/d76/d97/f26 [5869326,41227] 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/722: link d0/dce/cdf d0/d3d/c106 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/723: rmdir d0/d9 39 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/799: getdents d8/de/d12/d16/d24/dbe/dc6 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/677: creat d2/d66/d85/d76/d97/d77/da2/db7/fe2 x:0 0 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/724: mkdir d0/d3d/dd7/d107 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/800: dread - d8/de/d12/d16/d24/dbe/dc6/d2f/fb7 zero size 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/838: dread d3/dc1/fc3 [0,4194304] 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:3/831: dread d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/f11b [0,4194304] 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/725: fsync d0/d2f/d4b/d8f/fb8 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/678: write d2/d66/d85/d43/d67/db3/f2f [8944032,59418] 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/801: write d8/de/d12/d16/f75 [2519542,91798] 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/839: mkdir d3/da/d64/dee/d10d 0 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/679: dread - d2/d66/d85/d43/d67/db3/d13/d40/fba zero size 2024-04-25T23:01:09.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/753: dread d1/d5/f2c [0,4194304] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/754: symlink d1/d5/d3b/d4c/d21/d55/d68/l100 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/680: dwrite d2/f98 [0,4194304] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/681: symlink d2/d66/d85/d43/d5d/da9/dd7/da0/le3 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/682: write d2/d66/d85/d43/d67/db3/d13/fa6 [951915,84404] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/683: getdents d2/d66/d85/d43/d67 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/684: fdatasync d2/d66/d85/d76/d97/f39 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:7/840: write d3/da/df/f48 [1421774,12904] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:7/841: creat d3/d9b/d63/f10e x:0 0 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:9/802: dread d8/de/d12/d16/f25 [0,4194304] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:7/842: write d3/da/df/fe4 [1693190,69488] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/755: dwrite d1/d5/d3b/d62/fe9 [8388608,4194304] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:8/575: dread d3/d4/d36/f64 [0,4194304] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:8/576: mknod d3/cb8 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:4/780: dread d3/d19/f22 [0,4194304] 0 2024-04-25T23:01:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:7/843: dwrite d3/da/d78/fa9 [0,4194304] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:8/577: chown d3/d4/db/d4e/d8b/d9f/f3b 10373 1 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:4/781: write d3/d21/d6b/d87/d8a/f94 [445356,90789] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/756: dwrite d1/d5/d3b/d62/f73 [0,4194304] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:8/578: symlink d3/lb9 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:4/782: write d3/d21/da5/fba [3081465,53465] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/844: getdents d3/da/df/d11/d8d/dd3 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/803: dwrite d8/de/d44/d47/fd7 [4194304,4194304] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/845: fsync d3/f108 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:8/579: write d3/d4/d7c/d92/d62/fa9 [1254102,101308] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:4/783: creat d3/d21/d6b/d87/d8a/f117 x:0 0 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/804: stat d8/de/d44/d47 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:4/784: symlink d3/d19/d34/d76/dde/l118 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:8/580: write d3/d4/db/d4e/d5c/f1e [35000,79508] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/757: dwrite d1/d5/d3b/d4c/d21/d55/d68/f36 [0,4194304] 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/805: symlink d8/de/d12/d16/d24/l113 0 2024-04-25T23:01:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:0/729: dread f11 [0,4194304] 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:5/807: dread d0/d2c/d39/d1c/d25/d7a/d41/f86 [0,4194304] 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:1/726: dread d0/d16/f23 [0,4194304] 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:6/758: chown d1/d5/d3b/d4c/d21/d38/d99 4810 1 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:9/806: chown d8/de/d12/d7a 297 1 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:3/832: dread d7/d26/fdc [0,4194304] 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:4/785: creat d3/db6/f119 x:0 0 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:8/581: fsync d3/d4/db/d14/d4c/d68/f7a 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:7/846: dwrite d3/d1e/d1f/dc5/f82 [0,4194304] 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:5/808: symlink d0/d22/l106 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:3/833: chown d7/d26/d27/d34/d1a/d40/d8f/dd0 11 1 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:9/807: readlink d8/de/d12/d16/l1d 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:7/847: read d3/d1e/fd2 [3145386,45693] 0 2024-04-25T23:01:09.317 INFO:tasks.workunit.client.0.smithi043.stdout:1/727: unlink d0/d9/f9e 0 2024-04-25T23:01:09.318 INFO:tasks.workunit.client.0.smithi043.stdout:6/759: unlink d1/l84 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:9/808: chown d8/de/d12/d16/d24/dbe/dc6/d6c 494272 1 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:4/786: creat d3/d19/d34/d76/f11a x:0 0 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:7/848: unlink d3/da/df/d11/l3a 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:1/728: symlink d0/d16/l108 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:8/582: rename d3/d4/db/d4e/d8b/d9f/d8d/c90 to d3/d4/db/d4e/d8b/d91/cba 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:5/809: creat d0/d2c/d39/d1c/d25/d7a/f107 x:0 0 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:4/787: chown d3/de/d46/d6a/fac 1 1 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/760: rename d1/d5/d3b/d4c/f28 to d1/dc8/f101 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:8/583: creat d3/d4/db/d14/d4c/fbb x:0 0 0 2024-04-25T23:01:09.321 INFO:tasks.workunit.client.0.smithi043.stdout:1/729: creat d0/d9/ddc/de6/f109 x:0 0 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:5/810: creat d0/d22/d95/ded/f108 x:0 0 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/849: rename d3/d1e/l67 to d3/d9b/ddc/l10f 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:8/584: mknod d3/d4/cbc 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:4/788: mknod d3/de/d46/d6a/d8f/d8e/c11b 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:1/730: chown d0/d9/c73 19262711 1 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:5/811: creat d0/d2c/f109 x:0 0 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/850: mkdir d3/d1e/d1f/dc5/d110 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:8/585: creat d3/d4/d7d/fbd x:0 0 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/761: creat d1/d5/d3b/d4c/d21/d55/d68/d7f/f102 x:0 0 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/851: write d3/da/df/d11/d8d/d9f/fa2 [3124764,17234] 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:8/586: mknod d3/d4/db/d14/d56/d5d/cbe 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:4/789: truncate d3/de/d27/d5c/d67/fe6 925439 0 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/762: dread - d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/ffc zero size 2024-04-25T23:01:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/852: mkdir d3/d1e/d1f/d111 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/685: dread d2/fc [0,4194304] 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:8/587: rmdir d3/d4/db/d4e/d5c/d59/d61/d66 39 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/686: chown d2/fa8 0 1 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/763: write d1/d5/d3b/d4c/d21/d38/f59 [20147,102198] 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:7/853: rmdir d3/da/df/d11/d26/d101 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:8/588: chown d3/d4/db/d14/d56/d5d/c9d 7121 1 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/764: fdatasync d1/d5/d3b/d4c/d21/f7d 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:0/730: dread d1b/d8b/f60 [0,4194304] 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:4/790: dread d3/f3c [0,4194304] 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:7/854: write d3/da/d64/dee/ff7 [385534,93811] 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/687: write d2/d66/d85/d43/d67/db3/d13/d40/f6b [2040188,67007] 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:1/731: dwrite d0/d9/d63/ffe [0,4194304] 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/765: creat d1/d2a/db5/dc4/f103 x:0 0 0 2024-04-25T23:01:09.323 INFO:tasks.workunit.client.0.smithi043.stdout:8/589: rename d3/d4/c29 to d3/d4/d98/cbf 0 2024-04-25T23:01:09.324 INFO:tasks.workunit.client.0.smithi043.stdout:8/590: chown d3/fb5 909 1 2024-04-25T23:01:09.324 INFO:tasks.workunit.client.0.smithi043.stdout:0/731: symlink d1b/d8b/da2/le9 0 2024-04-25T23:01:09.326 INFO:tasks.workunit.client.0.smithi043.stdout:0/732: read d1b/d23/dab/fc2 [122029,99858] 0 2024-04-25T23:01:09.336 INFO:tasks.workunit.client.0.smithi043.stdout:4/791: dwrite d3/de/d27/d45/fcf [0,4194304] 0 2024-04-25T23:01:09.336 INFO:tasks.workunit.client.0.smithi043.stdout:2/688: dwrite d2/d66/d85/d76/d97/fe [0,4194304] 0 2024-04-25T23:01:09.336 INFO:tasks.workunit.client.0.smithi043.stdout:7/855: dwrite d3/da/d64/fa3 [0,4194304] 0 2024-04-25T23:01:09.336 INFO:tasks.workunit.client.0.smithi043.stdout:6/766: dwrite d1/dc8/fe1 [0,4194304] 0 2024-04-25T23:01:09.337 INFO:tasks.workunit.client.0.smithi043.stdout:3/834: dread d7/d26/d59/d7c/db2/f4a [0,4194304] 0 2024-04-25T23:01:09.337 INFO:tasks.workunit.client.0.smithi043.stdout:5/812: truncate d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f3e 2132370 0 2024-04-25T23:01:09.337 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:01:09.337 INFO:tasks.workunit.client.0.smithi043.stdout:4/792: fsync d3/f24 0 2024-04-25T23:01:09.337 INFO:tasks.workunit.client.0.smithi043.stdout:4/793: chown d3/d37/c3b 14229 1 2024-04-25T23:01:09.338 INFO:tasks.workunit.client.0.smithi043.stdout:2/689: symlink d2/d66/d85/d43/d5d/da9/dd7/da3/le4 0 2024-04-25T23:01:09.338 INFO:tasks.workunit.client.0.smithi043.stdout:7/856: creat d3/da/df/f112 x:0 0 0 2024-04-25T23:01:09.338 INFO:tasks.workunit.client.0.smithi043.stdout:6/767: creat d1/d5/d3b/d4c/d21/d55/f104 x:0 0 0 2024-04-25T23:01:09.338 INFO:tasks.workunit.client.0.smithi043.stdout:4/794: fsync d3/d21/d6b/f81 0 2024-04-25T23:01:09.339 INFO:tasks.workunit.client.0.smithi043.stdout:3/835: read - d7/d26/d27/d34/d1a/d40/d8f/d51/f115 zero size 2024-04-25T23:01:09.340 INFO:tasks.workunit.client.0.smithi043.stdout:6/768: mknod d1/d2a/db5/dc4/dfa/c105 0 2024-04-25T23:01:09.340 INFO:tasks.workunit.client.0.smithi043.stdout:4/795: stat d3/d21/d84/ca9 0 2024-04-25T23:01:09.341 INFO:tasks.workunit.client.0.smithi043.stdout:2/690: getdents d2/d66/d85/d76/d97 0 2024-04-25T23:01:09.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/769: chown d1/d5/d3b/d4c/d21/d55/d6d/fcc 1261 1 2024-04-25T23:01:09.341 INFO:tasks.workunit.client.0.smithi043.stdout:4/796: symlink d3/d19/l11c 0 2024-04-25T23:01:09.341 INFO:tasks.workunit.client.0.smithi043.stdout:3/836: mkdir d7/d26/d59/d7c/db2/d12d 0 2024-04-25T23:01:09.341 INFO:tasks.workunit.client.0.smithi043.stdout:7/857: link d3/d1e/d1f/f5f d3/da/df/d11/d8d/f113 0 2024-04-25T23:01:09.342 INFO:tasks.workunit.client.0.smithi043.stdout:6/770: write d1/d2a/db5/dc4/f103 [161251,26144] 0 2024-04-25T23:01:09.342 INFO:tasks.workunit.client.0.smithi043.stdout:4/797: chown d3/de/d27/ff9 45256 1 2024-04-25T23:01:09.343 INFO:tasks.workunit.client.0.smithi043.stdout:9/809: dread d8/de/d12/d16/f75 [0,4194304] 0 2024-04-25T23:01:09.343 INFO:tasks.workunit.client.0.smithi043.stdout:0/733: truncate d1b/d23/d39/db3/f64 3254034 0 2024-04-25T23:01:09.343 INFO:tasks.workunit.client.0.smithi043.stdout:4/798: chown d3/d21/d6b/d87/d8a/f9e 60 1 2024-04-25T23:01:09.345 INFO:tasks.workunit.client.0.smithi043.stdout:0/734: mkdir d1b/dea 0 2024-04-25T23:01:09.345 INFO:tasks.workunit.client.0.smithi043.stdout:6/771: truncate d1/d5/f7 8476161 0 2024-04-25T23:01:09.345 INFO:tasks.workunit.client.0.smithi043.stdout:3/837: getdents d7/d26/d27/d34/d1a/d40/d8f 0 2024-04-25T23:01:09.347 INFO:tasks.workunit.client.0.smithi043.stdout:0/735: symlink d1b/d23/d91/leb 0 2024-04-25T23:01:09.349 INFO:tasks.workunit.client.0.smithi043.stdout:4/799: creat d3/d37/f11d x:0 0 0 2024-04-25T23:01:09.350 INFO:tasks.workunit.client.0.smithi043.stdout:6/772: getdents d1/d2a/db5/dc4/dc9 0 2024-04-25T23:01:09.351 INFO:tasks.workunit.client.0.smithi043.stdout:2/691: dwrite d2/d66/d85/d43/d67/f7a [0,4194304] 0 2024-04-25T23:01:09.352 INFO:tasks.workunit.client.0.smithi043.stdout:7/858: dwrite d3/da/df/f48 [0,4194304] 0 2024-04-25T23:01:09.353 INFO:tasks.workunit.client.0.smithi043.stdout:9/810: dwrite d8/de/f10 [4194304,4194304] 0 2024-04-25T23:01:09.358 INFO:tasks.workunit.client.0.smithi043.stdout:4/800: mknod d3/de/d46/d6a/d8f/d8e/d101/c11e 0 2024-04-25T23:01:09.358 INFO:tasks.workunit.client.0.smithi043.stdout:6/773: fsync d1/d5/d3b/d4c/d1a/f2e 0 2024-04-25T23:01:09.358 INFO:tasks.workunit.client.0.smithi043.stdout:0/736: dwrite d1b/d23/d7b/da6/db7/db9/fcd [0,4194304] 0 2024-04-25T23:01:09.359 INFO:tasks.workunit.client.0.smithi043.stdout:2/692: write d2/d7f/f81 [1713583,128512] 0 2024-04-25T23:01:09.361 INFO:tasks.workunit.client.0.smithi043.stdout:7/859: dwrite d3/d1e/d1f/dc5/fdb [0,4194304] 0 2024-04-25T23:01:09.364 INFO:tasks.workunit.client.0.smithi043.stdout:2/693: unlink d2/d66/d85/d43/d67/db3/l1c 0 2024-04-25T23:01:09.365 INFO:tasks.workunit.client.0.smithi043.stdout:3/838: truncate d7/d26/d27/d34/d1a/d40/d8f/f5c 4078198 0 2024-04-25T23:01:09.366 INFO:tasks.workunit.client.0.smithi043.stdout:0/737: rename d1b/d31/d3c/fae to d1b/d31/fec 0 2024-04-25T23:01:09.366 INFO:tasks.workunit.client.0.smithi043.stdout:1/732: dread d0/d9/f80 [0,4194304] 0 2024-04-25T23:01:09.366 INFO:tasks.workunit.client.0.smithi043.stdout:7/860: creat d3/d1e/f114 x:0 0 0 2024-04-25T23:01:09.367 INFO:tasks.workunit.client.0.smithi043.stdout:2/694: write d2/fac [2167203,11428] 0 2024-04-25T23:01:09.368 INFO:tasks.workunit.client.0.smithi043.stdout:3/839: truncate d7/d26/d27/d34/d1a/f117 673182 0 2024-04-25T23:01:09.368 INFO:tasks.workunit.client.0.smithi043.stdout:4/801: dwrite d3/d21/d6b/fc0 [0,4194304] 0 2024-04-25T23:01:09.369 INFO:tasks.workunit.client.0.smithi043.stdout:7/861: write d3/d9b/d63/d98/fd1 [847144,109151] 0 2024-04-25T23:01:09.369 INFO:tasks.workunit.client.0.smithi043.stdout:3/840: symlink d7/dac/l12e 0 2024-04-25T23:01:09.369 INFO:tasks.workunit.client.0.smithi043.stdout:0/738: getdents d1b/d8b/dc0 0 2024-04-25T23:01:09.370 INFO:tasks.workunit.client.0.smithi043.stdout:7/862: stat d3/da/d64/ffe 0 2024-04-25T23:01:09.371 INFO:tasks.workunit.client.0.smithi043.stdout:0/739: fsync d1b/d55/f8d 0 2024-04-25T23:01:09.371 INFO:tasks.workunit.client.0.smithi043.stdout:6/774: dwrite d1/f78 [0,4194304] 0 2024-04-25T23:01:09.373 INFO:tasks.workunit.client.0.smithi043.stdout:3/841: stat d7/d26/d27/d34/f106 0 2024-04-25T23:01:09.373 INFO:tasks.workunit.client.0.smithi043.stdout:3/842: stat d7/d26/d59/f7a 0 2024-04-25T23:01:09.374 INFO:tasks.workunit.client.0.smithi043.stdout:6/775: getdents d1/d5/d3b 0 2024-04-25T23:01:09.375 INFO:tasks.workunit.client.0.smithi043.stdout:3/843: getdents d7/d26/d88 0 2024-04-25T23:01:09.377 INFO:tasks.workunit.client.0.smithi043.stdout:2/695: dread d2/d66/d85/f36 [0,4194304] 0 2024-04-25T23:01:09.377 INFO:tasks.workunit.client.0.smithi043.stdout:8/591: dread d3/d4/db/d4e/d8b/d9f/d33/f1a [0,4194304] 0 2024-04-25T23:01:09.377 INFO:tasks.workunit.client.0.smithi043.stdout:3/844: creat d7/f12f x:0 0 0 2024-04-25T23:01:09.379 INFO:tasks.workunit.client.0.smithi043.stdout:2/696: write d2/d66/d85/d76/fc9 [808088,87597] 0 2024-04-25T23:01:09.380 INFO:tasks.workunit.client.0.smithi043.stdout:8/592: mknod d3/d4/db/d4e/d5c/d59/d61/d66/cc0 0 2024-04-25T23:01:09.381 INFO:tasks.workunit.client.0.smithi043.stdout:0/740: dwrite d1b/d23/d7b/da6/db7/db9/fcd [0,4194304] 0 2024-04-25T23:01:09.381 INFO:tasks.workunit.client.0.smithi043.stdout:7/863: dwrite d3/da/df/d11/d8d/d9f/ffa [0,4194304] 0 2024-04-25T23:01:09.381 INFO:tasks.workunit.client.0.smithi043.stdout:5/813: dread d0/d2c/d39/d1c/d25/fa2 [0,4194304] 0 2024-04-25T23:01:09.383 INFO:tasks.workunit.client.0.smithi043.stdout:8/593: mknod d3/d4/d6d/cc1 0 2024-04-25T23:01:09.384 INFO:tasks.workunit.client.0.smithi043.stdout:2/697: mknod d2/d66/d85/ce5 0 2024-04-25T23:01:09.387 INFO:tasks.workunit.client.0.smithi043.stdout:3/845: link d7/d26/d59/d7c/db2/d52/cea d7/d26/d27/d34/d1a/d28/d9e/dcc/c130 0 2024-04-25T23:01:09.387 INFO:tasks.workunit.client.0.smithi043.stdout:8/594: mknod d3/d4/db/d4e/d8b/d9f/d33/cc2 0 2024-04-25T23:01:09.387 INFO:tasks.workunit.client.0.smithi043.stdout:2/698: rename d2/d7f/f80 to d2/d66/d85/d76/d97/d77/da2/db7/fe6 0 2024-04-25T23:01:09.387 INFO:tasks.workunit.client.0.smithi043.stdout:5/814: link d0/d22/d95/fc3 d0/d2c/d39/d1c/d25/d7a/f10a 0 2024-04-25T23:01:09.389 INFO:tasks.workunit.client.0.smithi043.stdout:3/846: write d7/d26/d2d/f36 [983156,40905] 0 2024-04-25T23:01:09.389 INFO:tasks.workunit.client.0.smithi043.stdout:8/595: truncate d3/d4/db/d14/f19 740603 0 2024-04-25T23:01:09.389 INFO:tasks.workunit.client.0.smithi043.stdout:7/864: dread d3/da/df/f48 [0,4194304] 0 2024-04-25T23:01:09.389 INFO:tasks.workunit.client.0.smithi043.stdout:3/847: dread - d7/d26/d97/fc3 zero size 2024-04-25T23:01:09.389 INFO:tasks.workunit.client.0.smithi043.stdout:0/741: dwrite d1b/d7f/fd8 [0,4194304] 0 2024-04-25T23:01:09.389 INFO:tasks.workunit.client.0.smithi043.stdout:5/815: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/df0/d10b 0 2024-04-25T23:01:09.390 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.386+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.391 INFO:tasks.workunit.client.0.smithi043.stdout:5/816: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d10c 0 2024-04-25T23:01:09.391 INFO:tasks.workunit.client.0.smithi043.stdout:7/865: write d3/f108 [442501,22228] 0 2024-04-25T23:01:09.396 INFO:tasks.workunit.client.0.smithi043.stdout:2/699: dwrite d2/d66/d85/d43/d67/db3/d13/d40/f51 [0,4194304] 0 2024-04-25T23:01:09.398 INFO:tasks.workunit.client.0.smithi043.stdout:7/866: dwrite d3/da/df/d11/d26/f83 [0,4194304] 0 2024-04-25T23:01:09.399 INFO:tasks.workunit.client.0.smithi043.stdout:7/867: chown d3/da/d78/la0 25 1 2024-04-25T23:01:09.401 INFO:tasks.workunit.client.0.smithi043.stdout:7/868: mkdir d3/d9b/d63/dc9/d115 0 2024-04-25T23:01:09.403 INFO:tasks.workunit.client.0.smithi043.stdout:7/869: symlink d3/da/d64/l116 0 2024-04-25T23:01:09.404 INFO:tasks.workunit.client.0.smithi043.stdout:9/811: dread d8/f89 [0,4194304] 0 2024-04-25T23:01:09.405 INFO:tasks.workunit.client.0.smithi043.stdout:8/596: truncate d3/d4/d36/f64 3681702 0 2024-04-25T23:01:09.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/848: truncate d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe2 1390631 0 2024-04-25T23:01:09.405 INFO:tasks.workunit.client.0.smithi043.stdout:5/817: getdents d0/d2c/d39/d1c/d25/d7a/d2d/d5f 0 2024-04-25T23:01:09.406 INFO:tasks.workunit.client.0.smithi043.stdout:2/700: dwrite d2/d66/d85/d76/d97/d77/fce [0,4194304] 0 2024-04-25T23:01:09.409 INFO:tasks.workunit.client.0.smithi043.stdout:3/849: mknod d7/d26/d59/d7c/db2/d12d/c131 0 2024-04-25T23:01:09.409 INFO:tasks.workunit.client.0.smithi043.stdout:9/812: link d8/de/d44/d65/ce6 d8/de/d12/d16/d24/dbe/dc6/d2f/d84/c114 0 2024-04-25T23:01:09.409 INFO:tasks.workunit.client.0.smithi043.stdout:3/850: unlink d7/d26/d27/d34/l49 0 2024-04-25T23:01:09.409 INFO:tasks.workunit.client.0.smithi043.stdout:9/813: write d8/de/f10 [4016903,41262] 0 2024-04-25T23:01:09.410 INFO:tasks.workunit.client.0.smithi043.stdout:9/814: stat d8/de/d44/d47/l7d 0 2024-04-25T23:01:09.410 INFO:tasks.workunit.client.0.smithi043.stdout:7/870: dread d3/d1e/fb8 [0,4194304] 0 2024-04-25T23:01:09.411 INFO:tasks.workunit.client.0.smithi043.stdout:7/871: fdatasync d3/da/f62 0 2024-04-25T23:01:09.411 INFO:tasks.workunit.client.0.smithi043.stdout:3/851: truncate d7/d26/d27/d34/d1a/d40/d8f/d51/de1/ffa 908262 0 2024-04-25T23:01:09.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/815: mkdir d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115 0 2024-04-25T23:01:09.414 INFO:tasks.workunit.client.0.smithi043.stdout:1/733: dread d0/d16/f5e [0,4194304] 0 2024-04-25T23:01:09.414 INFO:tasks.workunit.client.0.smithi043.stdout:9/816: write d8/de/d12/d16/d24/dbe/dc6/d68/fc4 [468703,84278] 0 2024-04-25T23:01:09.415 INFO:tasks.workunit.client.0.smithi043.stdout:7/872: rename d3/da/df/cb1 to d3/d9b/d63/d98/c117 0 2024-04-25T23:01:09.416 INFO:tasks.workunit.client.0.smithi043.stdout:1/734: symlink d0/d3d/d105/l10a 0 2024-04-25T23:01:09.416 INFO:tasks.workunit.client.0.smithi043.stdout:3/852: rename d7/d26/d59/d7c/db2/d12d/c131 to d7/d26/d27/d34/d1a/d28/d9e/dcc/c132 0 2024-04-25T23:01:09.416 INFO:tasks.workunit.client.0.smithi043.stdout:2/701: dwrite d2/f98 [4194304,4194304] 0 2024-04-25T23:01:09.416 INFO:tasks.workunit.client.0.smithi043.stdout:4/802: dread d3/d21/f2e [0,4194304] 0 2024-04-25T23:01:09.416 INFO:tasks.workunit.client.0.smithi043.stdout:7/873: mknod d3/da/c118 0 2024-04-25T23:01:09.417 INFO:tasks.workunit.client.0.smithi043.stdout:1/735: chown d0/d9/d63/ffe 26059519 1 2024-04-25T23:01:09.417 INFO:tasks.workunit.client.0.smithi043.stdout:4/803: stat d3/de/d27/d5c/ld5 0 2024-04-25T23:01:09.417 INFO:tasks.workunit.client.0.smithi043.stdout:2/702: creat d2/d7f/fe7 x:0 0 0 2024-04-25T23:01:09.418 INFO:tasks.workunit.client.0.smithi043.stdout:3/853: fdatasync d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/fe7 0 2024-04-25T23:01:09.418 INFO:tasks.workunit.client.0.smithi043.stdout:9/817: rename d8/de/d12/de4/fe5 to d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/f116 0 2024-04-25T23:01:09.418 INFO:tasks.workunit.client.0.smithi043.stdout:1/736: dread - d0/fb2 zero size 2024-04-25T23:01:09.418 INFO:tasks.workunit.client.0.smithi043.stdout:7/874: creat d3/da/df/d11/d8d/dba/f119 x:0 0 0 2024-04-25T23:01:09.419 INFO:tasks.workunit.client.0.smithi043.stdout:4/804: symlink d3/d37/d4d/l11f 0 2024-04-25T23:01:09.419 INFO:tasks.workunit.client.0.smithi043.stdout:7/875: symlink d3/dc1/l11a 0 2024-04-25T23:01:09.419 INFO:tasks.workunit.client.0.smithi043.stdout:2/703: symlink d2/d66/d85/d43/d67/db3/le8 0 2024-04-25T23:01:09.420 INFO:tasks.workunit.client.0.smithi043.stdout:1/737: rename d0/d3d/dd7/d107 to d0/d86/d10b 0 2024-04-25T23:01:09.420 INFO:tasks.workunit.client.0.smithi043.stdout:7/876: creat d3/d9b/da8/f11b x:0 0 0 2024-04-25T23:01:09.421 INFO:tasks.workunit.client.0.smithi043.stdout:1/738: getdents d0/d16 0 2024-04-25T23:01:09.421 INFO:tasks.workunit.client.0.smithi043.stdout:7/877: mkdir d3/d1e/d1f/d54/d11c 0 2024-04-25T23:01:09.422 INFO:tasks.workunit.client.0.smithi043.stdout:1/739: fsync d0/d2f/f48 0 2024-04-25T23:01:09.423 INFO:tasks.workunit.client.0.smithi043.stdout:7/878: stat d3/da/df/d11/d26/c32 0 2024-04-25T23:01:09.426 INFO:tasks.workunit.client.0.smithi043.stdout:9/818: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/fa5 [0,4194304] 0 2024-04-25T23:01:09.428 INFO:tasks.workunit.client.0.smithi043.stdout:4/805: dwrite d3/d21/d84/faf [0,4194304] 0 2024-04-25T23:01:09.428 INFO:tasks.workunit.client.0.smithi043.stdout:2/704: dwrite d2/d66/d85/d43/d67/db3/f4a [0,4194304] 0 2024-04-25T23:01:09.431 INFO:tasks.workunit.client.0.smithi043.stdout:1/740: dwrite d0/d16/d5a/d5b/fff [0,4194304] 0 2024-04-25T23:01:09.433 INFO:tasks.workunit.client.0.smithi043.stdout:9/819: rename d8/de/d44/l9d to d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/l117 0 2024-04-25T23:01:09.434 INFO:tasks.workunit.client.0.smithi043.stdout:1/741: mknod d0/d86/daa/c10c 0 2024-04-25T23:01:09.434 INFO:tasks.workunit.client.0.smithi043.stdout:4/806: mkdir d3/d21/d120 0 2024-04-25T23:01:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:1/742: mkdir d0/d86/d10d 0 2024-04-25T23:01:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:9/820: write d8/fc1 [2855926,125197] 0 2024-04-25T23:01:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:4/807: fdatasync d3/de/f49 0 2024-04-25T23:01:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:1/743: chown d0/d3c/f6c 18272 1 2024-04-25T23:01:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:4/808: readlink d3/de/d46/d6a/d8f/l6c 0 2024-04-25T23:01:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:2/705: symlink d2/d66/d85/d76/d97/d77/da2/db7/dbf/le9 0 2024-04-25T23:01:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:1/744: truncate d0/d86/fd5 775375 0 2024-04-25T23:01:09.436 INFO:tasks.workunit.client.0.smithi043.stdout:2/706: creat d2/d66/fea x:0 0 0 2024-04-25T23:01:09.440 INFO:tasks.workunit.client.0.smithi043.stdout:4/809: truncate d3/f7d 333655 0 2024-04-25T23:01:09.440 INFO:tasks.workunit.client.0.smithi043.stdout:9/821: stat d8/de/d44/deb 0 2024-04-25T23:01:09.440 INFO:tasks.workunit.client.0.smithi043.stdout:2/707: dread d2/d66/d85/d43/d67/db3/f4a [0,4194304] 0 2024-04-25T23:01:09.442 INFO:tasks.workunit.client.0.smithi043.stdout:1/745: dwrite d0/d16/f65 [0,4194304] 0 2024-04-25T23:01:09.442 INFO:tasks.workunit.client.0.smithi043.stdout:2/708: write d2/d66/d85/d76/f3f [669477,77050] 0 2024-04-25T23:01:09.442 INFO:tasks.workunit.client.0.smithi043.stdout:1/746: readlink d0/d9/l37 0 2024-04-25T23:01:09.443 INFO:tasks.workunit.client.0.smithi043.stdout:9/822: dread d8/de/d44/d65/fae [0,4194304] 0 2024-04-25T23:01:09.443 INFO:tasks.workunit.client.0.smithi043.stdout:1/747: chown d0/d9/c77 1 1 2024-04-25T23:01:09.444 INFO:tasks.workunit.client.0.smithi043.stdout:2/709: creat d2/d66/d85/d43/d5d/da9/dd7/da0/feb x:0 0 0 2024-04-25T23:01:09.444 INFO:tasks.workunit.client.0.smithi043.stdout:1/748: mkdir d0/d86/d10b/d10e 0 2024-04-25T23:01:09.445 INFO:tasks.workunit.client.0.smithi043.stdout:9/823: chown d8/de/d12/d16/d24/dbe/dc6/d2f/da6/fe7 0 1 2024-04-25T23:01:09.446 INFO:tasks.workunit.client.0.smithi043.stdout:9/824: chown d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/cd4 15 1 2024-04-25T23:01:09.446 INFO:tasks.workunit.client.0.smithi043.stdout:4/810: dwrite d3/d21/d6b/f7f [0,4194304] 0 2024-04-25T23:01:09.448 INFO:tasks.workunit.client.0.smithi043.stdout:9/825: creat d8/de/d12/d16/d24/dbe/dc6/f118 x:0 0 0 2024-04-25T23:01:09.448 INFO:tasks.workunit.client.0.smithi043.stdout:4/811: readlink d3/de/d46/d6a/d8f/d8e/l10c 0 2024-04-25T23:01:09.449 INFO:tasks.workunit.client.0.smithi043.stdout:9/826: read - d8/de/d44/d5d/f10f zero size 2024-04-25T23:01:09.449 INFO:tasks.workunit.client.0.smithi043.stdout:4/812: write d3/de/f14 [305632,36803] 0 2024-04-25T23:01:09.450 INFO:tasks.workunit.client.0.smithi043.stdout:9/827: rename d8/de/d12/d16/d24/dbe to d8/de/d12/d16/d24/dbe/d10d/d119 22 2024-04-25T23:01:09.450 INFO:tasks.workunit.client.0.smithi043.stdout:2/710: dwrite d2/d66/d85/d43/d67/f7a [0,4194304] 0 2024-04-25T23:01:09.452 INFO:tasks.workunit.client.0.smithi043.stdout:1/749: read d0/d2f/ff3 [95125,40239] 0 2024-04-25T23:01:09.452 INFO:tasks.workunit.client.0.smithi043.stdout:3/854: dread d7/d26/f7e [0,4194304] 0 2024-04-25T23:01:09.453 INFO:tasks.workunit.client.0.smithi043.stdout:9/828: creat d8/de/d44/f11a x:0 0 0 2024-04-25T23:01:09.453 INFO:tasks.workunit.client.0.smithi043.stdout:2/711: truncate d2/d66/d85/d76/d97/f9e 815616 0 2024-04-25T23:01:09.454 INFO:tasks.workunit.client.0.smithi043.stdout:2/712: readlink d2/d66/d85/d43/d67/db3/d13/l21 0 2024-04-25T23:01:09.454 INFO:tasks.workunit.client.0.smithi043.stdout:4/813: truncate d3/de/d27/d5c/d67/fa2 2152882 0 2024-04-25T23:01:09.455 INFO:tasks.workunit.client.0.smithi043.stdout:1/750: creat d0/d16/d5a/d5b/f10f x:0 0 0 2024-04-25T23:01:09.455 INFO:tasks.workunit.client.0.smithi043.stdout:1/751: creat d0/dce/f110 x:0 0 0 2024-04-25T23:01:09.455 INFO:tasks.workunit.client.0.smithi043.stdout:4/814: creat d3/de/d46/d6a/d8f/d8e/db5/f121 x:0 0 0 2024-04-25T23:01:09.456 INFO:tasks.workunit.client.0.smithi043.stdout:0/742: dread d1b/f37 [0,4194304] 0 2024-04-25T23:01:09.456 INFO:tasks.workunit.client.0.smithi043.stdout:9/829: rename d8/de/d44/d5d/da1 to d8/de/d12/d16/d11b 0 2024-04-25T23:01:09.457 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:09.457 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:09.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.457 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:14192 4.20 e55/17 4:0454ba71:::100000037f3.00000000:head v 55'219, mlcod=54'217)", 2024-04-25T23:01:09.457 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:09.446994+0000", 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.010361074, 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010379721999999999, 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.446994+0000", 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.446994+0000", 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.446995+0000", 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6000000000000003e-07 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.451068+0000", 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040726959999999998 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.451082+0000", 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4093e-05 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.451094+0000", 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2007e-05 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.451155+0000", 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1067000000000003e-05 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:09.451174+0000", 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9100999999999999e-05 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 1 2024-04-25T23:01:09.461 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:09.462 INFO:tasks.workunit.client.0.smithi043.stdout:3/855: truncate d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f9a 3063338 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/743: write d1b/d23/f53 [338124,446] 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:4/815: stat d3/de/d46/d6a/fd2 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/856: unlink d7/f12f 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:9/830: symlink d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/l11c 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/744: truncate d1b/d23/d7a/dc8/fe6 819686 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:4/816: link d3/de/d46/d6a/d8f/d8e/db5/f121 d3/de/d46/f122 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/745: stat d1b/d23/d7a/dad/fd4 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:9/831: rename d8/de/d8c/f108 to d8/de/d44/f11d 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:1/752: dwrite d0/f72 [0,4194304] 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:4/817: mknod d3/d21/d84/c123 0 2024-04-25T23:01:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:2/713: dwrite d2/d66/d85/d43/d67/db3/f4a [0,4194304] 0 2024-04-25T23:01:09.464 INFO:tasks.workunit.client.0.smithi043.stdout:2/714: stat d2/d66/d85/d76/d97/d77/da2/db7/dbf/le9 0 2024-04-25T23:01:09.465 INFO:tasks.workunit.client.0.smithi043.stdout:0/746: fsync d1b/d23/f3d 0 2024-04-25T23:01:09.465 INFO:tasks.workunit.client.0.smithi043.stdout:3/857: write d7/d26/d88/ff7 [616586,102509] 0 2024-04-25T23:01:09.466 INFO:tasks.workunit.client.0.smithi043.stdout:1/753: creat d0/d9/ddc/f111 x:0 0 0 2024-04-25T23:01:09.466 INFO:tasks.workunit.client.0.smithi043.stdout:4/818: mknod d3/d21/d6b/d87/c124 0 2024-04-25T23:01:09.466 INFO:tasks.workunit.client.0.smithi043.stdout:2/715: chown d2/d66/d85/d76/d97/f52 7058 1 2024-04-25T23:01:09.467 INFO:tasks.workunit.client.0.smithi043.stdout:9/832: read d8/f96 [65443,76476] 0 2024-04-25T23:01:09.467 INFO:tasks.workunit.client.0.smithi043.stdout:0/747: unlink d1b/d31/d3c/cd3 0 2024-04-25T23:01:09.467 INFO:tasks.workunit.client.0.smithi043.stdout:1/754: creat d0/d3d/d105/f112 x:0 0 0 2024-04-25T23:01:09.468 INFO:tasks.workunit.client.0.smithi043.stdout:0/748: creat d1b/d7f/fed x:0 0 0 2024-04-25T23:01:09.468 INFO:tasks.workunit.client.0.smithi043.stdout:3/858: truncate d7/d26/d27/d34/f24 3779259 0 2024-04-25T23:01:09.469 INFO:tasks.workunit.client.0.smithi043.stdout:5/818: dread d0/d22/f7b [0,4194304] 0 2024-04-25T23:01:09.470 INFO:tasks.workunit.client.0.smithi043.stdout:9/833: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f11e x:0 0 0 2024-04-25T23:01:09.471 INFO:tasks.workunit.client.0.smithi043.stdout:0/749: symlink d1b/db0/lee 0 2024-04-25T23:01:09.471 INFO:tasks.workunit.client.0.smithi043.stdout:2/716: rename d2/d66/d85/d43/d67/db3/d13/d40/fba to d2/d66/dc5/fec 0 2024-04-25T23:01:09.472 INFO:tasks.workunit.client.0.smithi043.stdout:9/834: readlink d8/de/d12/d16/d24/dbe/dc6/d6c/l7c 0 2024-04-25T23:01:09.472 INFO:tasks.workunit.client.0.smithi043.stdout:5/819: symlink d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62/l10d 0 2024-04-25T23:01:09.473 INFO:tasks.workunit.client.0.smithi043.stdout:4/819: dwrite d3/d21/f25 [8388608,4194304] 0 2024-04-25T23:01:09.473 INFO:tasks.workunit.client.0.smithi043.stdout:0/750: write d1b/d31/f96 [4950690,53395] 0 2024-04-25T23:01:09.473 INFO:tasks.workunit.client.0.smithi043.stdout:3/859: getdents d7/d26/d97 0 2024-04-25T23:01:09.474 INFO:tasks.workunit.client.0.smithi043.stdout:4/820: write d3/d19/f22 [3526974,3100] 0 2024-04-25T23:01:09.476 INFO:tasks.workunit.client.0.smithi043.stdout:1/755: dwrite d0/d16/f5e [4194304,4194304] 0 2024-04-25T23:01:09.476 INFO:tasks.workunit.client.0.smithi043.stdout:9/835: mkdir d8/de/d44/d5d/d4f/d110/d11f 0 2024-04-25T23:01:09.477 INFO:tasks.workunit.client.0.smithi043.stdout:3/860: fsync d7/d26/d27/d34/f17 0 2024-04-25T23:01:09.477 INFO:tasks.workunit.client.0.smithi043.stdout:1/756: readlink d0/d3c/lc7 0 2024-04-25T23:01:09.477 INFO:tasks.workunit.client.0.smithi043.stdout:2/717: rename d2/d66/d85/d76/d97/d77/fce to d2/d66/d85/d43/d5d/da9/dd7/fed 0 2024-04-25T23:01:09.477 INFO:tasks.workunit.client.0.smithi043.stdout:4/821: getdents d3/d19/d34/d76/d102 0 2024-04-25T23:01:09.478 INFO:tasks.workunit.client.0.smithi043.stdout:9/836: creat d8/de/d12/d16/d24/dbe/dc6/d2f/da6/f120 x:0 0 0 2024-04-25T23:01:09.479 INFO:tasks.workunit.client.0.smithi043.stdout:4/822: creat d3/d37/d7a/de7/f125 x:0 0 0 2024-04-25T23:01:09.479 INFO:tasks.workunit.client.0.smithi043.stdout:2/718: chown d2/d66/fea 3975051 1 2024-04-25T23:01:09.481 INFO:tasks.workunit.client.0.smithi043.stdout:4/823: unlink d3/de/d27/le5 0 2024-04-25T23:01:09.481 INFO:tasks.workunit.client.0.smithi043.stdout:9/837: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f121 x:0 0 0 2024-04-25T23:01:09.481 INFO:tasks.workunit.client.0.smithi043.stdout:2/719: rename d2/d4b to d2/d66/d85/d43/d5d/dee 0 2024-04-25T23:01:09.481 INFO:tasks.workunit.client.0.smithi043.stdout:4/824: stat d3/de/c7b 0 2024-04-25T23:01:09.483 INFO:tasks.workunit.client.0.smithi043.stdout:4/825: readlink d3/d19/lb7 0 2024-04-25T23:01:09.483 INFO:tasks.workunit.client.0.smithi043.stdout:9/838: truncate d8/de/d8c/faa 206360 0 2024-04-25T23:01:09.483 INFO:tasks.workunit.client.0.smithi043.stdout:1/757: read d0/d2f/d4b/da6/fd9 [409344,107300] 0 2024-04-25T23:01:09.483 INFO:tasks.workunit.client.0.smithi043.stdout:4/826: fsync d3/d21/d6b/d87/d8a/fed 0 2024-04-25T23:01:09.483 INFO:tasks.workunit.client.0.smithi043.stdout:9/839: read - d8/de/fce zero size 2024-04-25T23:01:09.483 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:09.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/758: rmdir d0/d2f 39 2024-04-25T23:01:09.484 INFO:tasks.workunit.client.0.smithi043.stdout:3/861: dwrite d7/d26/d27/d34/d1a/d40/d8f/d51/f115 [0,4194304] 0 2024-04-25T23:01:09.484 INFO:tasks.workunit.client.0.smithi043.stdout:9/840: mknod d8/de/d44/d5d/c122 0 2024-04-25T23:01:09.485 INFO:tasks.workunit.client.0.smithi043.stdout:9/841: write d8/de/d12/de4/ffd [1052106,89300] 0 2024-04-25T23:01:09.485 INFO:tasks.workunit.client.0.smithi043.stdout:1/759: link d0/l10 d0/d2f/deb/l113 0 2024-04-25T23:01:09.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/862: write d7/d26/d27/d34/d1a/d40/d8f/d51/f115 [1289022,52192] 0 2024-04-25T23:01:09.486 INFO:tasks.workunit.client.0.smithi043.stdout:4/827: read d3/d19/fab [3210800,45435] 0 2024-04-25T23:01:09.486 INFO:tasks.workunit.client.0.smithi043.stdout:3/863: mknod d7/d26/d59/d7c/db2/d87/c133 0 2024-04-25T23:01:09.489 INFO:tasks.workunit.client.0.smithi043.stdout:3/864: symlink d7/d26/d27/d34/d1a/d28/l134 0 2024-04-25T23:01:09.489 INFO:tasks.workunit.client.0.smithi043.stdout:1/760: truncate d0/d9/d63/f90 285432 0 2024-04-25T23:01:09.490 INFO:tasks.workunit.client.0.smithi043.stdout:4/828: read d3/d21/f3d [221154,99315] 0 2024-04-25T23:01:09.491 INFO:tasks.workunit.client.0.smithi043.stdout:4/829: symlink d3/d19/d34/dea/l126 0 2024-04-25T23:01:09.491 INFO:tasks.workunit.client.0.smithi043.stdout:1/761: write d0/d2f/d4b/ff0 [189991,34132] 0 2024-04-25T23:01:09.492 INFO:tasks.workunit.client.0.smithi043.stdout:1/762: write d0/d2f/fb0 [466970,64827] 0 2024-04-25T23:01:09.492 INFO:tasks.workunit.client.0.smithi043.stdout:9/842: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f11e [0,4194304] 0 2024-04-25T23:01:09.493 INFO:tasks.workunit.client.0.smithi043.stdout:4/830: creat d3/d19/d10b/f127 x:0 0 0 2024-04-25T23:01:09.493 INFO:tasks.workunit.client.0.smithi043.stdout:1/763: write d0/d16/f1b [2056687,12167] 0 2024-04-25T23:01:09.496 INFO:tasks.workunit.client.0.smithi043.stdout:4/831: creat d3/de/d27/d5c/d67/f128 x:0 0 0 2024-04-25T23:01:09.496 INFO:tasks.workunit.client.0.smithi043.stdout:9/843: creat d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/f123 x:0 0 0 2024-04-25T23:01:09.496 INFO:tasks.workunit.client.0.smithi043.stdout:3/865: dwrite d7/d26/d27/d34/f45 [0,4194304] 0 2024-04-25T23:01:09.497 INFO:tasks.workunit.client.0.smithi043.stdout:9/844: fsync d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fd5 0 2024-04-25T23:01:09.497 INFO:tasks.workunit.client.0.smithi043.stdout:1/764: write d0/d2f/d4b/f75 [712094,87704] 0 2024-04-25T23:01:09.498 INFO:tasks.workunit.client.0.smithi043.stdout:3/866: creat d7/d26/d88/db0/f135 x:0 0 0 2024-04-25T23:01:09.499 INFO:tasks.workunit.client.0.smithi043.stdout:1/765: write d0/f26 [1821178,33415] 0 2024-04-25T23:01:09.499 INFO:tasks.workunit.client.0.smithi043.stdout:3/867: fsync d7/dac/f114 0 2024-04-25T23:01:09.500 INFO:tasks.workunit.client.0.smithi043.stdout:9/845: mknod d8/de/c124 0 2024-04-25T23:01:09.500 INFO:tasks.workunit.client.0.smithi043.stdout:1/766: mknod d0/d3d/d105/c114 0 2024-04-25T23:01:09.501 INFO:tasks.workunit.client.0.smithi043.stdout:9/846: getdents d8/de/d12/d16/d24/df0 0 2024-04-25T23:01:09.504 INFO:tasks.workunit.client.0.smithi043.stdout:9/847: creat d8/de/d12/d16/d24/dbe/f125 x:0 0 0 2024-04-25T23:01:09.504 INFO:tasks.workunit.client.0.smithi043.stdout:9/848: chown d8/de 9 1 2024-04-25T23:01:09.505 INFO:tasks.workunit.client.0.smithi043.stdout:4/832: dwrite d3/d19/f8d [4194304,4194304] 0 2024-04-25T23:01:09.506 INFO:tasks.workunit.client.0.smithi043.stdout:4/833: readlink d3/de/d46/d95/l97 0 2024-04-25T23:01:09.507 INFO:tasks.workunit.client.0.smithi043.stdout:1/767: dwrite d0/d86/fb7 [0,4194304] 0 2024-04-25T23:01:09.507 INFO:tasks.workunit.client.0.smithi043.stdout:3/868: dwrite d7/d26/d88/db8/f119 [0,4194304] 0 2024-04-25T23:01:09.507 INFO:tasks.workunit.client.0.smithi043.stdout:4/834: unlink d3/d19/d34/d76/f11a 0 2024-04-25T23:01:09.508 INFO:tasks.workunit.client.0.smithi043.stdout:1/768: write d0/d86/fb7 [3338325,57285] 0 2024-04-25T23:01:09.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/769: write d0/dce/f110 [168286,96035] 0 2024-04-25T23:01:09.512 INFO:tasks.workunit.client.0.smithi043.stdout:3/869: rename d7/d26/d2d/fa3 to d7/d26/d59/d7c/f136 0 2024-04-25T23:01:09.512 INFO:tasks.workunit.client.0.smithi043.stdout:4/835: unlink d3/d37/d4d/fe3 0 2024-04-25T23:01:09.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/849: link d8/de/d12/d16/d24/dbe/dc6/d68/c85 d8/c126 0 2024-04-25T23:01:09.513 INFO:tasks.workunit.client.0.smithi043.stdout:1/770: getdents d0/d86/daa 0 2024-04-25T23:01:09.513 INFO:tasks.workunit.client.0.smithi043.stdout:4/836: dread - d3/d19/d10b/f127 zero size 2024-04-25T23:01:09.515 INFO:tasks.workunit.client.0.smithi043.stdout:9/850: chown d8/de/d12/d7a/lcf 2225 1 2024-04-25T23:01:09.515 INFO:tasks.workunit.client.0.smithi043.stdout:1/771: creat d0/d3d/d4f/f115 x:0 0 0 2024-04-25T23:01:09.515 INFO:tasks.workunit.client.0.smithi043.stdout:4/837: creat d3/d21/da5/dff/f129 x:0 0 0 2024-04-25T23:01:09.517 INFO:tasks.workunit.client.0.smithi043.stdout:0/751: dread d1b/faa [0,4194304] 0 2024-04-25T23:01:09.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/752: link d1b/db0/fc5 d1b/dea/fef 0 2024-04-25T23:01:09.519 INFO:tasks.workunit.client.0.smithi043.stdout:3/870: dwrite d7/d26/d88/db0/f105 [0,4194304] 0 2024-04-25T23:01:09.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/871: creat d7/dac/f137 x:0 0 0 2024-04-25T23:01:09.521 INFO:tasks.workunit.client.0.smithi043.stdout:1/772: dwrite d0/d2f/ff3 [0,4194304] 0 2024-04-25T23:01:09.522 INFO:tasks.workunit.client.0.smithi043.stdout:3/872: mknod d7/d26/c138 0 2024-04-25T23:01:09.522 INFO:tasks.workunit.client.0.smithi043.stdout:0/753: truncate f1a 4125776 0 2024-04-25T23:01:09.522 INFO:tasks.workunit.client.0.smithi043.stdout:1/773: creat d0/d2f/f116 x:0 0 0 2024-04-25T23:01:09.523 INFO:tasks.workunit.client.0.smithi043.stdout:3/873: chown d7/d26/d27/d34/d1a/d40/d8f/f38 6603800 1 2024-04-25T23:01:09.523 INFO:tasks.workunit.client.0.smithi043.stdout:1/774: rename d0/d3d to d0/d86/d10d/d117 0 2024-04-25T23:01:09.524 INFO:tasks.workunit.client.0.smithi043.stdout:1/775: write d0/d16/f5e [2466595,109505] 0 2024-04-25T23:01:09.524 INFO:tasks.workunit.client.0.smithi043.stdout:1/776: readlink d0/ld 0 2024-04-25T23:01:09.526 INFO:tasks.workunit.client.0.smithi043.stdout:1/777: creat d0/d16/d5a/d5b/f118 x:0 0 0 2024-04-25T23:01:09.526 INFO:tasks.workunit.client.0.smithi043.stdout:1/778: creat d0/d86/d10d/d117/f119 x:0 0 0 2024-04-25T23:01:09.527 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.526+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.527 INFO:tasks.workunit.client.0.smithi043.stdout:3/874: truncate d7/f9 1707019 0 2024-04-25T23:01:09.527 INFO:tasks.workunit.client.0.smithi043.stdout:1/779: mkdir d0/d2f/d11a 0 2024-04-25T23:01:09.529 INFO:tasks.workunit.client.0.smithi043.stdout:1/780: chown d0/d3c/lc7 1330531 1 2024-04-25T23:01:09.529 INFO:tasks.workunit.client.0.smithi043.stdout:1/781: fsync d0/d9/ddc/f111 0 2024-04-25T23:01:09.529 INFO:tasks.workunit.client.0.smithi043.stdout:3/875: link d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/fe4 d7/d26/d59/f139 0 2024-04-25T23:01:09.529 INFO:tasks.workunit.client.0.smithi043.stdout:1/782: write d0/dce/f110 [1086740,9835] 0 2024-04-25T23:01:09.529 INFO:tasks.workunit.client.0.smithi043.stdout:3/876: write d7/d26/d27/d34/d1a/fb3 [931595,48056] 0 2024-04-25T23:01:09.530 INFO:tasks.workunit.client.0.smithi043.stdout:1/783: write d0/d9/ddc/de6/f109 [251825,33198] 0 2024-04-25T23:01:09.531 INFO:tasks.workunit.client.0.smithi043.stdout:3/877: truncate d7/d26/d59/d7c/db2/fda 835684 0 2024-04-25T23:01:09.531 INFO:tasks.workunit.client.0.smithi043.stdout:1/784: getdents d0/d86/d10d/d117/dd7 0 2024-04-25T23:01:09.532 INFO:tasks.workunit.client.0.smithi043.stdout:3/878: dread d7/d26/f7e [0,4194304] 0 2024-04-25T23:01:09.532 INFO:tasks.workunit.client.0.smithi043.stdout:4/838: dread d3/d37/d4d/fc5 [0,4194304] 0 2024-04-25T23:01:09.533 INFO:tasks.workunit.client.0.smithi043.stdout:1/785: rename d0/d86/d10d/d117/cd6 to d0/d3c/c11b 0 2024-04-25T23:01:09.533 INFO:tasks.workunit.client.0.smithi043.stdout:4/839: symlink d3/de/d27/d5c/db9/l12a 0 2024-04-25T23:01:09.534 INFO:tasks.workunit.client.0.smithi043.stdout:4/840: getdents d3/de/d27/d5c/de2 0 2024-04-25T23:01:09.535 INFO:tasks.workunit.client.0.smithi043.stdout:4/841: unlink d3/de/d27/d5c/d67/ffa 0 2024-04-25T23:01:09.536 INFO:tasks.workunit.client.0.smithi043.stdout:1/786: getdents d0/d3c 0 2024-04-25T23:01:09.536 INFO:tasks.workunit.client.0.smithi043.stdout:3/879: dread d7/d26/d88/db0/f105 [0,4194304] 0 2024-04-25T23:01:09.536 INFO:tasks.workunit.client.0.smithi043.stdout:4/842: creat d3/d37/d7a/f12b x:0 0 0 2024-04-25T23:01:09.536 INFO:tasks.workunit.client.0.smithi043.stdout:1/787: chown d0/d9/l37 479830331 1 2024-04-25T23:01:09.537 INFO:tasks.workunit.client.0.smithi043.stdout:3/880: creat d7/d26/d2d/dce/f13a x:0 0 0 2024-04-25T23:01:09.538 INFO:tasks.workunit.client.0.smithi043.stdout:3/881: read d7/d26/d27/d34/d1a/d40/d8f/d51/de1/ffa [309866,112604] 0 2024-04-25T23:01:09.539 INFO:tasks.workunit.client.0.smithi043.stdout:3/882: rename d7/d26/d59 to d7/d26/d2d/dce/d13b 0 2024-04-25T23:01:09.541 INFO:tasks.workunit.client.0.smithi043.stdout:4/843: dwrite d3/de/d27/ff9 [0,4194304] 0 2024-04-25T23:01:09.544 INFO:tasks.workunit.client.0.smithi043.stdout:4/844: read d3/d21/d6b/d87/f8b [1997373,10123] 0 2024-04-25T23:01:09.545 INFO:tasks.workunit.client.0.smithi043.stdout:4/845: creat d3/d21/d84/f12c x:0 0 0 2024-04-25T23:01:09.545 INFO:tasks.workunit.client.0.smithi043.stdout:3/883: dwrite d7/d26/d2d/dce/d13b/d7c/f12c [0,4194304] 0 2024-04-25T23:01:09.546 INFO:tasks.workunit.client.0.smithi043.stdout:4/846: mkdir d3/d37/d12d 0 2024-04-25T23:01:09.546 INFO:tasks.workunit.client.0.smithi043.stdout:3/884: stat d7/d26/d2d/dce/d13b/d7c/db2/d87/l100 0 2024-04-25T23:01:09.547 INFO:tasks.workunit.client.0.smithi043.stdout:4/847: chown d3/de/d27/d5c/db9/lef 0 1 2024-04-25T23:01:09.547 INFO:tasks.workunit.client.0.smithi043.stdout:3/885: write d7/f65 [3879435,107398] 0 2024-04-25T23:01:09.548 INFO:tasks.workunit.client.0.smithi043.stdout:3/886: fsync d7/d26/d2d/dce/d13b/d7c/db2/f11e 0 2024-04-25T23:01:09.548 INFO:tasks.workunit.client.0.smithi043.stdout:4/848: getdents d3/d19/d34/dea/dc8 0 2024-04-25T23:01:09.550 INFO:tasks.workunit.client.0.smithi043.stdout:3/887: rename d7/d26/d2d/dce/d13b/f139 to d7/d26/d27/d34/d1a/d40/d8f/d51/de1/f13c 0 2024-04-25T23:01:09.550 INFO:tasks.workunit.client.0.smithi043.stdout:3/888: dread - d7/d26/fbc zero size 2024-04-25T23:01:09.551 INFO:tasks.workunit.client.0.smithi043.stdout:3/889: symlink d7/d26/d2d/dce/d13b/d7c/l13d 0 2024-04-25T23:01:09.552 INFO:tasks.workunit.client.0.smithi043.stdout:3/890: creat d7/d26/d27/d34/d1a/d28/d9e/f13e x:0 0 0 2024-04-25T23:01:09.553 INFO:tasks.workunit.client.0.smithi043.stdout:4/849: dwrite d3/d19/d10b/f127 [0,4194304] 0 2024-04-25T23:01:09.554 INFO:tasks.workunit.client.0.smithi043.stdout:4/850: dread - d3/de/d46/d6a/f10a zero size 2024-04-25T23:01:09.555 INFO:tasks.workunit.client.0.smithi043.stdout:4/851: chown d3/de/d46/d6a/d8f/d8e/db5/dda 2 1 2024-04-25T23:01:09.560 INFO:tasks.workunit.client.0.smithi043.stdout:3/891: dwrite d7/d26/d88/f110 [0,4194304] 0 2024-04-25T23:01:09.561 INFO:tasks.workunit.client.0.smithi043.stdout:3/892: truncate d7/d26/d27/d34/f104 663084 0 2024-04-25T23:01:09.562 INFO:tasks.workunit.client.0.smithi043.stdout:3/893: fsync d7/d26/d27/d34/d1a/d40/d8f/dd0/f108 0 2024-04-25T23:01:09.594 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.590+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.635 INFO:tasks.workunit.client.0.smithi043.stdout:6/776: sync 2024-04-25T23:01:09.636 INFO:tasks.workunit.client.0.smithi043.stdout:6/777: read - d1/d5/d3b/d4c/d21/d55/fba zero size 2024-04-25T23:01:09.645 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:09.645 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:09.645 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:09.645 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:09.645 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:09.649 INFO:tasks.workunit.client.0.smithi043.stdout:6/778: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/fd6 [0,4194304] 0 2024-04-25T23:01:09.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/779: dread d1/d5/d3b/d4c/d21/f7d [0,4194304] 0 2024-04-25T23:01:09.660 INFO:tasks.workunit.client.0.smithi043.stdout:6/780: link d1/d5/d3b/d4c/f15 d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/dc3/de3/f106 0 2024-04-25T23:01:09.664 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:09.667 INFO:tasks.workunit.client.0.smithi043.stdout:6/781: write d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fc0 [3055229,101233] 0 2024-04-25T23:01:09.674 INFO:tasks.workunit.client.0.smithi043.stdout:2/720: sync 2024-04-25T23:01:09.675 INFO:tasks.workunit.client.0.smithi043.stdout:8/597: sync 2024-04-25T23:01:09.675 INFO:tasks.workunit.client.0.smithi043.stdout:5/820: sync 2024-04-25T23:01:09.675 INFO:tasks.workunit.client.0.smithi043.stdout:7/879: sync 2024-04-25T23:01:09.675 INFO:tasks.workunit.client.0.smithi043.stdout:1/788: sync 2024-04-25T23:01:09.679 INFO:tasks.workunit.client.0.smithi043.stdout:6/782: dwrite d1/d5/d3b/f85 [0,4194304] 0 2024-04-25T23:01:09.679 INFO:tasks.workunit.client.0.smithi043.stdout:5/821: symlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/l10e 0 2024-04-25T23:01:09.679 INFO:tasks.workunit.client.0.smithi043.stdout:8/598: mkdir d3/d4/db/d4e/d5c/d59/d61/d97/dc3 0 2024-04-25T23:01:09.686 INFO:tasks.workunit.client.0.smithi043.stdout:7/880: link d3/da/df/d11/d8d/d9f/fa2 d3/d1e/f11d 0 2024-04-25T23:01:09.687 INFO:tasks.workunit.client.0.smithi043.stdout:6/783: write d1/d5/d3b/d4c/d21/d55/fa6 [169556,25222] 0 2024-04-25T23:01:09.688 INFO:tasks.workunit.client.0.smithi043.stdout:7/881: write d3/da/df/f8c [1252076,51166] 0 2024-04-25T23:01:09.689 INFO:tasks.workunit.client.0.smithi043.stdout:8/599: mknod d3/d4/db/d4e/cc4 0 2024-04-25T23:01:09.691 INFO:tasks.workunit.client.0.smithi043.stdout:4/852: sync 2024-04-25T23:01:09.691 INFO:tasks.workunit.client.0.smithi043.stdout:3/894: sync 2024-04-25T23:01:09.691 INFO:tasks.workunit.client.0.smithi043.stdout:0/754: sync 2024-04-25T23:01:09.691 INFO:tasks.workunit.client.0.smithi043.stdout:9/851: sync 2024-04-25T23:01:09.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/784: fdatasync d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fb1 0 2024-04-25T23:01:09.693 INFO:tasks.workunit.client.0.smithi043.stdout:4/853: write d3/d21/f2e [4409408,49487] 0 2024-04-25T23:01:09.694 INFO:tasks.workunit.client.0.smithi043.stdout:8/600: fdatasync d3/d4/db/d4e/d8b/d9f/f15 0 2024-04-25T23:01:09.694 INFO:tasks.workunit.client.0.smithi043.stdout:2/721: dwrite d2/d66/d85/d43/d67/db3/d13/d40/f6b [0,4194304] 0 2024-04-25T23:01:09.694 INFO:tasks.workunit.client.0.smithi043.stdout:3/895: readlink d7/d26/d27/d34/d1a/lc2 0 2024-04-25T23:01:09.695 INFO:tasks.workunit.client.0.smithi043.stdout:6/785: chown d1/d5/d3b/d4c/d21/d55/d68/d30/dbf 7474 1 2024-04-25T23:01:09.695 INFO:tasks.workunit.client.0.smithi043.stdout:9/852: stat d8/de/d12/d16/d24/dbe/dc6/d68 0 2024-04-25T23:01:09.695 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:09.692+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:09.696 INFO:tasks.workunit.client.0.smithi043.stdout:8/601: write d3/d4/db/d14/f54 [1327659,95018] 0 2024-04-25T23:01:09.697 INFO:tasks.workunit.client.0.smithi043.stdout:5/822: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d4a/fa4 [0,4194304] 0 2024-04-25T23:01:09.697 INFO:tasks.workunit.client.0.smithi043.stdout:2/722: mknod d2/d66/d85/d76/d97/d77/d9a/cef 0 2024-04-25T23:01:09.697 INFO:tasks.workunit.client.0.smithi043.stdout:9/853: fdatasync d8/de/d44/d5d/d4f/f95 0 2024-04-25T23:01:09.697 INFO:tasks.workunit.client.0.smithi043.stdout:0/755: chown d1b/d23/d39/f4b 116602 1 2024-04-25T23:01:09.697 INFO:tasks.workunit.client.0.smithi043.stdout:3/896: mkdir d7/d26/d13f 0 2024-04-25T23:01:09.698 INFO:tasks.workunit.client.0.smithi043.stdout:6/786: mkdir d1/d5/d3b/d4c/d21/d38/de6/d107 0 2024-04-25T23:01:09.699 INFO:tasks.workunit.client.0.smithi043.stdout:2/723: creat d2/d66/d85/d76/ff0 x:0 0 0 2024-04-25T23:01:09.699 INFO:tasks.workunit.client.0.smithi043.stdout:3/897: fsync d7/fb 0 2024-04-25T23:01:09.699 INFO:tasks.workunit.client.0.smithi043.stdout:8/602: symlink d3/d4/db/d14/d4c/d68/lc5 0 2024-04-25T23:01:09.699 INFO:tasks.workunit.client.0.smithi043.stdout:0/756: creat d1b/d55/ff0 x:0 0 0 2024-04-25T23:01:09.700 INFO:tasks.workunit.client.0.smithi043.stdout:3/898: write d7/dac/f114 [1791115,22014] 0 2024-04-25T23:01:09.700 INFO:tasks.workunit.client.0.smithi043.stdout:8/603: rmdir d3/d4/db/d4e/d8b/d91 39 2024-04-25T23:01:09.701 INFO:tasks.workunit.client.0.smithi043.stdout:6/787: fdatasync d1/d5/d3b/d62/f69 0 2024-04-25T23:01:09.701 INFO:tasks.workunit.client.0.smithi043.stdout:9/854: creat d8/de/d44/d47/d6a/f127 x:0 0 0 2024-04-25T23:01:09.702 INFO:tasks.workunit.client.0.smithi043.stdout:3/899: fsync d7/d26/d27/d34/fb6 0 2024-04-25T23:01:09.702 INFO:tasks.workunit.client.0.smithi043.stdout:8/604: creat d3/d4/d7c/fc6 x:0 0 0 2024-04-25T23:01:09.703 INFO:tasks.workunit.client.0.smithi043.stdout:4/854: dwrite d3/d37/d7a/f12b [0,4194304] 0 2024-04-25T23:01:09.704 INFO:tasks.workunit.client.0.smithi043.stdout:6/788: rename d1/d5/d3b/d4c/d1a/l4b to d1/d5/d3b/d4c/d21/d55/d6d/d96/l108 0 2024-04-25T23:01:09.704 INFO:tasks.workunit.client.0.smithi043.stdout:0/757: fsync d1b/d55/ff0 0 2024-04-25T23:01:09.705 INFO:tasks.workunit.client.0.smithi043.stdout:9/855: link d8/de/d12/d16/d24/l113 d8/de/d44/d5d/l128 0 2024-04-25T23:01:09.705 INFO:tasks.workunit.client.0.smithi043.stdout:3/900: read d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/f11b [378583,13415] 0 2024-04-25T23:01:09.705 INFO:tasks.workunit.client.0.smithi043.stdout:8/605: getdents d3/d4/db/d4e/d5c/d2e/d5e 0 2024-04-25T23:01:09.706 INFO:tasks.workunit.client.0.smithi043.stdout:4/855: unlink d3/d37/d4d/f10d 0 2024-04-25T23:01:09.707 INFO:tasks.workunit.client.0.smithi043.stdout:9/856: mknod d8/de/d12/d16/d24/dbe/dc6/d68/c129 0 2024-04-25T23:01:09.707 INFO:tasks.workunit.client.0.smithi043.stdout:0/758: rename d1b/d8b/c9e to d1b/d31/d3c/d72/cf1 0 2024-04-25T23:01:09.709 INFO:tasks.workunit.client.0.smithi043.stdout:3/901: write d7/d26/d2d/dce/d13b/d7c/db2/d87/fec [654084,21229] 0 2024-04-25T23:01:09.709 INFO:tasks.workunit.client.0.smithi043.stdout:4/856: truncate d3/d19/f105 261643 0 2024-04-25T23:01:09.709 INFO:tasks.workunit.client.0.smithi043.stdout:2/724: dwrite d2/d66/d85/d43/d5d/da9/fda [0,4194304] 0 2024-04-25T23:01:09.709 INFO:tasks.workunit.client.0.smithi043.stdout:3/902: chown d7/d26/d2d/fff 5571 1 2024-04-25T23:01:09.712 INFO:tasks.workunit.client.0.smithi043.stdout:9/857: unlink d8/de/d44/d5d/l128 0 2024-04-25T23:01:09.712 INFO:tasks.workunit.client.0.smithi043.stdout:3/903: mkdir d7/d26/d27/d34/d1a/d28/d9e/dcc/d140 0 2024-04-25T23:01:09.712 INFO:tasks.workunit.client.0.smithi043.stdout:3/904: write d7/dac/f114 [836924,17331] 0 2024-04-25T23:01:09.715 INFO:tasks.workunit.client.0.smithi043.stdout:8/606: dwrite d3/d4/d7d/fbd [0,4194304] 0 2024-04-25T23:01:09.715 INFO:tasks.workunit.client.0.smithi043.stdout:9/858: fsync d8/de/d44/d5d/fc7 0 2024-04-25T23:01:09.717 INFO:tasks.workunit.client.0.smithi043.stdout:8/607: fdatasync d3/d4/db/d4e/d8b/d9f/d33/f1f 0 2024-04-25T23:01:09.717 INFO:tasks.workunit.client.0.smithi043.stdout:1/789: dread d0/d2f/d4b/fa2 [0,4194304] 0 2024-04-25T23:01:09.718 INFO:tasks.workunit.client.0.smithi043.stdout:1/790: chown d0/d2f/f116 0 1 2024-04-25T23:01:09.718 INFO:tasks.workunit.client.0.smithi043.stdout:8/608: truncate d3/d4/d36/f82 194357 0 2024-04-25T23:01:09.718 INFO:tasks.workunit.client.0.smithi043.stdout:1/791: stat d0/f5 0 2024-04-25T23:01:09.719 INFO:tasks.workunit.client.0.smithi043.stdout:4/857: dwrite d3/de/fd [0,4194304] 0 2024-04-25T23:01:09.721 INFO:tasks.workunit.client.0.smithi043.stdout:8/609: unlink d3/d4/d7c/d92/f58 0 2024-04-25T23:01:09.723 INFO:tasks.workunit.client.0.smithi043.stdout:8/610: creat d3/d4/d7c/d92/fc7 x:0 0 0 2024-04-25T23:01:09.725 INFO:tasks.workunit.client.0.smithi043.stdout:9/859: dwrite d8/de/d12/d16/d24/dbe/dc6/d6c/f70 [0,4194304] 0 2024-04-25T23:01:09.725 INFO:tasks.workunit.client.0.smithi043.stdout:3/905: dwrite d7/d26/d2d/dce/d13b/d7c/db2/f4a [4194304,4194304] 0 2024-04-25T23:01:09.726 INFO:tasks.workunit.client.0.smithi043.stdout:9/860: stat d8/de/d12/d16/l1d 0 2024-04-25T23:01:09.727 INFO:tasks.workunit.client.0.smithi043.stdout:8/611: getdents d3/d4/db/d4e/d8b/d9f 0 2024-04-25T23:01:09.727 INFO:tasks.workunit.client.0.smithi043.stdout:9/861: unlink d8/de/d12/d16/l4e 0 2024-04-25T23:01:09.727 INFO:tasks.workunit.client.0.smithi043.stdout:3/906: mknod d7/d26/d27/d34/d1a/d28/d9e/dcc/c141 0 2024-04-25T23:01:09.727 INFO:tasks.workunit.client.0.smithi043.stdout:1/792: dwrite d0/d3c/f62 [0,4194304] 0 2024-04-25T23:01:09.727 INFO:tasks.workunit.client.0.smithi043.stdout:8/612: fsync d3/f48 0 2024-04-25T23:01:09.728 INFO:tasks.workunit.client.0.smithi043.stdout:9/862: write d8/de/f42 [4505388,2137] 0 2024-04-25T23:01:09.729 INFO:tasks.workunit.client.0.smithi043.stdout:6/789: truncate d1/d5/d3b/d4c/d21/d55/d68/f42 4357085 0 2024-04-25T23:01:09.729 INFO:tasks.workunit.client.0.smithi043.stdout:8/613: symlink d3/d4/db/d4e/d5c/d59/lc8 0 2024-04-25T23:01:09.731 INFO:tasks.workunit.client.0.smithi043.stdout:9/863: mknod d8/de/d12/d16/d11b/c12a 0 2024-04-25T23:01:09.731 INFO:tasks.workunit.client.0.smithi043.stdout:1/793: creat d0/d2f/deb/f11c x:0 0 0 2024-04-25T23:01:09.731 INFO:tasks.workunit.client.0.smithi043.stdout:3/907: getdents d7/d26/d27/d34/d1a/d40/d8f/d51/de1 0 2024-04-25T23:01:09.732 INFO:tasks.workunit.client.0.smithi043.stdout:1/794: stat d0/d86/d10d/d117/c28 0 2024-04-25T23:01:09.733 INFO:tasks.workunit.client.0.smithi043.stdout:8/614: mknod d3/d4/db/d4e/d5c/d59/cc9 0 2024-04-25T23:01:09.734 INFO:tasks.workunit.client.0.smithi043.stdout:6/790: creat d1/d5/d3b/d4c/d21/d38/d60/f109 x:0 0 0 2024-04-25T23:01:09.734 INFO:tasks.workunit.client.0.smithi043.stdout:9/864: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/f12b x:0 0 0 2024-04-25T23:01:09.735 INFO:tasks.workunit.client.0.smithi043.stdout:1/795: unlink d0/d16/df7/ldd 0 2024-04-25T23:01:09.735 INFO:tasks.workunit.client.0.smithi043.stdout:8/615: mknod d3/d4/db/d14/d56/cca 0 2024-04-25T23:01:09.736 INFO:tasks.workunit.client.0.smithi043.stdout:2/725: dwrite d2/d66/d85/d43/d67/db3/d13/f1e [0,4194304] 0 2024-04-25T23:01:09.736 INFO:tasks.workunit.client.0.smithi043.stdout:0/759: dwrite d1b/d8b/f85 [0,4194304] 0 2024-04-25T23:01:09.736 INFO:tasks.workunit.client.0.smithi043.stdout:3/908: chown d7/d26/d2d/dce/d13b/d7c/db2/d52/fc9 2 1 2024-04-25T23:01:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:1/796: mkdir d0/d2f/d4b/d8f/d11d 0 2024-04-25T23:01:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:2/726: mknod d2/d66/d85/d43/d5d/da9/dd7/da3/cf1 0 2024-04-25T23:01:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:4/858: truncate d3/d21/d6b/d87/f8b 1448397 0 2024-04-25T23:01:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:8/616: link d3/d4/d7c/d92/d62/fa9 d3/d4/d7c/d92/d62/fcb 0 2024-04-25T23:01:09.739 INFO:tasks.workunit.client.0.smithi043.stdout:1/797: rmdir d0/d2f/d4b 39 2024-04-25T23:01:09.739 INFO:tasks.workunit.client.0.smithi043.stdout:3/909: link d7/d26/d2d/dce/d13b/l124 d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/l142 0 2024-04-25T23:01:09.739 INFO:tasks.workunit.client.0.smithi043.stdout:2/727: mknod d2/d66/d85/d76/d97/d77/d9a/cf2 0 2024-04-25T23:01:09.740 INFO:tasks.workunit.client.0.smithi043.stdout:3/910: read d7/d26/f7e [423763,123503] 0 2024-04-25T23:01:09.740 INFO:tasks.workunit.client.0.smithi043.stdout:1/798: write d0/d9/f44 [3691488,77342] 0 2024-04-25T23:01:09.741 INFO:tasks.workunit.client.0.smithi043.stdout:2/728: mknod d2/d66/cf3 0 2024-04-25T23:01:09.741 INFO:tasks.workunit.client.0.smithi043.stdout:2/729: fsync d2/d66/fea 0 2024-04-25T23:01:09.741 INFO:tasks.workunit.client.0.smithi043.stdout:1/799: mknod d0/d3c/c11e 0 2024-04-25T23:01:09.742 INFO:tasks.workunit.client.0.smithi043.stdout:8/617: write d3/d4/db/d4e/d8b/d9f/f15 [2674203,83845] 0 2024-04-25T23:01:09.742 INFO:tasks.workunit.client.0.smithi043.stdout:1/800: chown d0/d86/daa/lcb 4 1 2024-04-25T23:01:09.743 INFO:tasks.workunit.client.0.smithi043.stdout:2/730: symlink d2/d66/d85/d76/d97/lf4 0 2024-04-25T23:01:09.744 INFO:tasks.workunit.client.0.smithi043.stdout:1/801: chown d0/d16/d5a/d5b/l85 4 1 2024-04-25T23:01:09.745 INFO:tasks.workunit.client.0.smithi043.stdout:1/802: read - d0/d16/fe4 zero size 2024-04-25T23:01:09.745 INFO:tasks.workunit.client.0.smithi043.stdout:4/859: dwrite d3/f3c [0,4194304] 0 2024-04-25T23:01:09.746 INFO:tasks.workunit.client.0.smithi043.stdout:1/803: mknod d0/d16/dd1/c11f 0 2024-04-25T23:01:09.747 INFO:tasks.workunit.client.0.smithi043.stdout:4/860: write d3/de/d46/d95/f99 [662626,3400] 0 2024-04-25T23:01:09.748 INFO:tasks.workunit.client.0.smithi043.stdout:3/911: dwrite d7/d26/d2d/dce/d13b/d7c/db2/d87/f9d [0,4194304] 0 2024-04-25T23:01:09.751 INFO:tasks.workunit.client.0.smithi043.stdout:3/912: write d7/d26/d27/fde [334301,43485] 0 2024-04-25T23:01:09.751 INFO:tasks.workunit.client.0.smithi043.stdout:7/882: sync 2024-04-25T23:01:09.753 INFO:tasks.workunit.client.0.smithi043.stdout:7/883: write d3/fad [241482,84693] 0 2024-04-25T23:01:09.754 INFO:tasks.workunit.client.0.smithi043.stdout:7/884: chown d3/d9b/ddc 1022 1 2024-04-25T23:01:09.754 INFO:tasks.workunit.client.0.smithi043.stdout:9/865: dwrite d8/de/d44/f45 [0,4194304] 0 2024-04-25T23:01:09.755 INFO:tasks.workunit.client.0.smithi043.stdout:2/731: dwrite d2/d66/d85/d43/d5d/da9/dd7/fb2 [0,4194304] 0 2024-04-25T23:01:09.756 INFO:tasks.workunit.client.0.smithi043.stdout:7/885: mkdir d3/da/d78/d11e 0 2024-04-25T23:01:09.757 INFO:tasks.workunit.client.0.smithi043.stdout:2/732: mknod d2/d66/d85/d43/d67/d8d/cf5 0 2024-04-25T23:01:09.757 INFO:tasks.workunit.client.0.smithi043.stdout:7/886: mknod d3/da/df/d11/d8d/dba/c11f 0 2024-04-25T23:01:09.758 INFO:tasks.workunit.client.0.smithi043.stdout:7/887: creat d3/dc1/f120 x:0 0 0 2024-04-25T23:01:09.759 INFO:tasks.workunit.client.0.smithi043.stdout:3/913: dwrite d7/d26/fdc [4194304,4194304] 0 2024-04-25T23:01:09.760 INFO:tasks.workunit.client.0.smithi043.stdout:7/888: creat d3/da/df/d11/d8d/dba/f121 x:0 0 0 2024-04-25T23:01:09.761 INFO:tasks.workunit.client.0.smithi043.stdout:2/733: rename d2/d66/d85/d43/d67/db3/d13/d40/f6b to d2/d66/d85/d43/d5d/da9/dd7/da0/ff6 0 2024-04-25T23:01:09.762 INFO:tasks.workunit.client.0.smithi043.stdout:2/734: write d2/f98 [4770699,63640] 0 2024-04-25T23:01:09.764 INFO:tasks.workunit.client.0.smithi043.stdout:2/735: rename d2/d66/d85/d76/d97/d48 to d2/d66/d85/d43/d5d/da9/dd7/df7 0 2024-04-25T23:01:09.766 INFO:tasks.workunit.client.0.smithi043.stdout:2/736: mknod d2/d66/d85/d43/d5d/da9/cf8 0 2024-04-25T23:01:09.774 INFO:tasks.workunit.client.0.smithi043.stdout:5/823: sync 2024-04-25T23:01:09.776 INFO:tasks.workunit.client.0.smithi043.stdout:7/889: dread d3/dc1/fc3 [0,4194304] 0 2024-04-25T23:01:09.776 INFO:tasks.workunit.client.0.smithi043.stdout:5/824: getdents d0/d2c/d39/d1c/d25/d7a/d2d/dc9 0 2024-04-25T23:01:09.777 INFO:tasks.workunit.client.0.smithi043.stdout:5/825: dread - d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/f82 zero size 2024-04-25T23:01:09.777 INFO:tasks.workunit.client.0.smithi043.stdout:7/890: rename d3/da/df/d11/f20 to d3/da/d64/dee/f122 0 2024-04-25T23:01:09.778 INFO:tasks.workunit.client.0.smithi043.stdout:5/826: creat d0/d2c/d39/d1c/d25/d4e/f10f x:0 0 0 2024-04-25T23:01:09.779 INFO:tasks.workunit.client.0.smithi043.stdout:5/827: mknod d0/d2c/d39/d1c/d25/d7a/c110 0 2024-04-25T23:01:09.781 INFO:tasks.workunit.client.0.smithi043.stdout:5/828: truncate d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fd7 709156 0 2024-04-25T23:01:09.783 INFO:tasks.workunit.client.0.smithi043.stdout:6/791: dread d1/d5/d3b/fda [0,4194304] 0 2024-04-25T23:01:09.784 INFO:tasks.workunit.client.0.smithi043.stdout:8/618: dread d3/d4/db/d14/f19 [0,4194304] 0 2024-04-25T23:01:09.784 INFO:tasks.workunit.client.0.smithi043.stdout:6/792: symlink d1/d5/d3b/d4c/d21/d38/de6/d107/l10a 0 2024-04-25T23:01:09.785 INFO:tasks.workunit.client.0.smithi043.stdout:8/619: truncate d3/d4/db/d4e/d8b/d9f/d33/f9a 347858 0 2024-04-25T23:01:09.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/620: dread - d3/d4/db/d4e/d5c/d59/d61/fa0 zero size 2024-04-25T23:01:09.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/760: dread f8 [0,4194304] 0 2024-04-25T23:01:09.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/761: dread - d1b/d23/d91/fe7 zero size 2024-04-25T23:01:09.793 INFO:tasks.workunit.client.0.smithi043.stdout:5/829: dread d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ff1 [0,4194304] 0 2024-04-25T23:01:09.793 INFO:tasks.workunit.client.0.smithi043.stdout:7/891: rename d3/dc1 to d3/da/df/d11/d8d/d123 0 2024-04-25T23:01:09.793 INFO:tasks.workunit.client.0.smithi043.stdout:3/914: truncate d7/d26/d27/d34/d1a/fb3 977279 0 2024-04-25T23:01:09.794 INFO:tasks.workunit.client.0.smithi043.stdout:7/892: dread - d3/d9b/d63/d98/fe6 zero size 2024-04-25T23:01:09.794 INFO:tasks.workunit.client.0.smithi043.stdout:3/915: symlink d7/dac/l143 0 2024-04-25T23:01:09.794 INFO:tasks.workunit.client.0.smithi043.stdout:9/866: dread d8/de/d12/d16/f1f [0,4194304] 0 2024-04-25T23:01:09.795 INFO:tasks.workunit.client.0.smithi043.stdout:7/893: chown d3/da/la5 241622 1 2024-04-25T23:01:09.797 INFO:tasks.workunit.client.0.smithi043.stdout:3/916: fdatasync d7/f18 0 2024-04-25T23:01:09.797 INFO:tasks.workunit.client.0.smithi043.stdout:5/830: write d0/d2c/d39/d1c/d25/d7a/d41/d47/f54 [2820197,130729] 0 2024-04-25T23:01:09.797 INFO:tasks.workunit.client.0.smithi043.stdout:0/762: read d1b/d31/fec [2191705,86640] 0 2024-04-25T23:01:09.800 INFO:tasks.workunit.client.0.smithi043.stdout:9/867: creat d8/de/d12/f12c x:0 0 0 2024-04-25T23:01:09.800 INFO:tasks.workunit.client.0.smithi043.stdout:7/894: mkdir d3/da/df/d11/d8d/d9f/d124 0 2024-04-25T23:01:09.800 INFO:tasks.workunit.client.0.smithi043.stdout:5/831: truncate d0/d6a/fb4 959103 0 2024-04-25T23:01:09.800 INFO:tasks.workunit.client.0.smithi043.stdout:3/917: mkdir d7/d26/d27/d34/d1a/d40/d8f/d51/de1/d144 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/763: creat d1b/d23/dab/dbd/dcc/ff2 x:0 0 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:1/804: dread d0/f26 [0,4194304] 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/764: readlink d1b/d23/l71 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:5/832: symlink d0/d2c/d39/d1c/d25/d4e/l111 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:9/868: readlink d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/l11c 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:1/805: creat d0/d16/dd1/f120 x:0 0 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/918: read - d7/d26/d2d/dce/d13b/d7c/db2/d87/fe8 zero size 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:7/895: rename d3/d9b/f92 to d3/d1e/d1f/dc5/d110/f125 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/765: creat d1b/d31/d3c/d50/ff3 x:0 0 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:2/737: truncate d2/d66/d85/d43/d5d/f84 190474 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/766: chown d1b/d23/d91 227259480 1 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/919: stat d7/d26/d2d/dab/fe5 0 2024-04-25T23:01:09.801 INFO:tasks.workunit.client.0.smithi043.stdout:1/806: mknod d0/d2f/d4b/d8f/c121 0 2024-04-25T23:01:09.802 INFO:tasks.workunit.client.0.smithi043.stdout:7/896: mknod d3/da/d78/dd4/d107/c126 0 2024-04-25T23:01:09.802 INFO:tasks.workunit.client.0.smithi043.stdout:2/738: write d2/fc [1506654,28573] 0 2024-04-25T23:01:09.802 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.798+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.803 INFO:tasks.workunit.client.0.smithi043.stdout:5/833: mknod d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/d105/c112 0 2024-04-25T23:01:09.803 INFO:tasks.workunit.client.0.smithi043.stdout:1/807: mknod d0/d9/dc0/c122 0 2024-04-25T23:01:09.803 INFO:tasks.workunit.client.0.smithi043.stdout:0/767: rename d1b/d23/d39/db3 to d1b/d23/d39/d90/df4 0 2024-04-25T23:01:09.803 INFO:tasks.workunit.client.0.smithi043.stdout:2/739: creat d2/d66/d85/d43/d5d/dee/ff9 x:0 0 0 2024-04-25T23:01:09.803 INFO:tasks.workunit.client.0.smithi043.stdout:3/920: read d7/d26/d27/d34/d1a/d28/f46 [3286314,117613] 0 2024-04-25T23:01:09.804 INFO:tasks.workunit.client.0.smithi043.stdout:1/808: rmdir d0/d86/d10d 39 2024-04-25T23:01:09.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/768: write d1b/fa4 [1275370,71492] 0 2024-04-25T23:01:09.804 INFO:tasks.workunit.client.0.smithi043.stdout:1/809: fdatasync d0/d2f/d4b/d8f/fb8 0 2024-04-25T23:01:09.805 INFO:tasks.workunit.client.0.smithi043.stdout:7/897: mkdir d3/da/d78/dd4/d127 0 2024-04-25T23:01:09.805 INFO:tasks.workunit.client.0.smithi043.stdout:1/810: chown d0/f1a 778323 1 2024-04-25T23:01:09.806 INFO:tasks.workunit.client.0.smithi043.stdout:6/793: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/dc3/de3/f106 [0,4194304] 0 2024-04-25T23:01:09.806 INFO:tasks.workunit.client.0.smithi043.stdout:5/834: getdents d0/d2c/d39/d1c/d25/d7a/d41/d47 0 2024-04-25T23:01:09.807 INFO:tasks.workunit.client.0.smithi043.stdout:7/898: readlink d3/d9b/d63/lbf 0 2024-04-25T23:01:09.808 INFO:tasks.workunit.client.0.smithi043.stdout:3/921: chown d7/d26/d2d/dce/d13b/d7c/db2/d87/c133 0 1 2024-04-25T23:01:09.808 INFO:tasks.workunit.client.0.smithi043.stdout:1/811: readlink d0/d86/d10d/d117/d4f/l82 0 2024-04-25T23:01:09.809 INFO:tasks.workunit.client.0.smithi043.stdout:6/794: mkdir d1/d2a/db5/dc4/dc9/d10b 0 2024-04-25T23:01:09.810 INFO:tasks.workunit.client.0.smithi043.stdout:4/861: dwrite d3/d21/d6b/d87/f8b [0,4194304] 0 2024-04-25T23:01:09.810 INFO:tasks.workunit.client.0.smithi043.stdout:9/869: dread d8/de/d12/d16/d11b/fcd [0,4194304] 0 2024-04-25T23:01:09.811 INFO:tasks.workunit.client.0.smithi043.stdout:6/795: chown d1/d2a/db5/dcb/fd9 124671349 1 2024-04-25T23:01:09.812 INFO:tasks.workunit.client.0.smithi043.stdout:1/812: stat d0/d86/daa 0 2024-04-25T23:01:09.813 INFO:tasks.workunit.client.0.smithi043.stdout:1/813: fsync d0/d16/df7/f81 0 2024-04-25T23:01:09.814 INFO:tasks.workunit.client.0.smithi043.stdout:9/870: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/f12d x:0 0 0 2024-04-25T23:01:09.814 INFO:tasks.workunit.client.0.smithi043.stdout:0/769: dwrite d1b/d23/d7a/fa3 [0,4194304] 0 2024-04-25T23:01:09.815 INFO:tasks.workunit.client.0.smithi043.stdout:2/740: truncate d2/d66/d85/d43/d67/f86 3619300 0 2024-04-25T23:01:09.816 INFO:tasks.workunit.client.0.smithi043.stdout:8/621: dread d3/d4/db/d4e/d5c/d59/d61/d66/f6f [0,4194304] 0 2024-04-25T23:01:09.816 INFO:tasks.workunit.client.0.smithi043.stdout:9/871: readlink d8/de/d12/d16/l1d 0 2024-04-25T23:01:09.818 INFO:tasks.workunit.client.0.smithi043.stdout:2/741: chown d2/d66/d85/d43/d67/d8d 15996646 1 2024-04-25T23:01:09.818 INFO:tasks.workunit.client.0.smithi043.stdout:3/922: fdatasync d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f10f 0 2024-04-25T23:01:09.818 INFO:tasks.workunit.client.0.smithi043.stdout:1/814: mkdir d0/d2f/d4b/da6/d123 0 2024-04-25T23:01:09.819 INFO:tasks.workunit.client.0.smithi043.stdout:0/770: mkdir d1b/d23/d7a/dad/df5 0 2024-04-25T23:01:09.819 INFO:tasks.workunit.client.0.smithi043.stdout:7/899: dwrite d3/d1e/d1f/dc5/d110/f125 [0,4194304] 0 2024-04-25T23:01:09.819 INFO:tasks.workunit.client.0.smithi043.stdout:5/835: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/fcc [0,4194304] 0 2024-04-25T23:01:09.822 INFO:tasks.workunit.client.0.smithi043.stdout:6/796: dwrite d1/d5/d3b/d62/f90 [0,4194304] 0 2024-04-25T23:01:09.825 INFO:tasks.workunit.client.0.smithi043.stdout:8/622: write d3/d4/db/d14/d56/d5d/f63 [152728,96465] 0 2024-04-25T23:01:09.825 INFO:tasks.workunit.client.0.smithi043.stdout:6/797: creat d1/d5/d3b/d4c/d21/d38/d60/f10c x:0 0 0 2024-04-25T23:01:09.826 INFO:tasks.workunit.client.0.smithi043.stdout:7/900: truncate d3/d1e/f11d 428461 0 2024-04-25T23:01:09.826 INFO:tasks.workunit.client.0.smithi043.stdout:9/872: write d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/fd3 [5140870,25777] 0 2024-04-25T23:01:09.826 INFO:tasks.workunit.client.0.smithi043.stdout:0/771: mkdir d1b/dcf/dd7/df6 0 2024-04-25T23:01:09.827 INFO:tasks.workunit.client.0.smithi043.stdout:1/815: getdents d0/d16/df7/dbf 0 2024-04-25T23:01:09.830 INFO:tasks.workunit.client.0.smithi043.stdout:9/873: stat d8/de/d12/de4 0 2024-04-25T23:01:09.831 INFO:tasks.workunit.client.0.smithi043.stdout:8/623: mkdir d3/d4/db/d14/dcc 0 2024-04-25T23:01:09.831 INFO:tasks.workunit.client.0.smithi043.stdout:3/923: dwrite d7/d26/d88/ff7 [0,4194304] 0 2024-04-25T23:01:09.831 INFO:tasks.workunit.client.0.smithi043.stdout:2/742: dwrite d2/d66/d85/d43/d5d/da9/dd7/df7/f5a [0,4194304] 0 2024-04-25T23:01:09.831 INFO:tasks.workunit.client.0.smithi043.stdout:6/798: readlink d1/d5/d3b/d4c/d21/d38/d99/ld4 0 2024-04-25T23:01:09.831 INFO:tasks.workunit.client.0.smithi043.stdout:4/862: write d3/d19/f5a [3071852,37323] 0 2024-04-25T23:01:09.831 INFO:tasks.workunit.client.0.smithi043.stdout:5/836: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ffa [0,4194304] 0 2024-04-25T23:01:09.832 INFO:tasks.workunit.client.0.smithi043.stdout:1/816: creat d0/d86/d10d/d117/d105/f124 x:0 0 0 2024-04-25T23:01:09.833 INFO:tasks.workunit.client.0.smithi043.stdout:3/924: fdatasync d7/dac/f137 0 2024-04-25T23:01:09.833 INFO:tasks.workunit.client.0.smithi043.stdout:8/624: chown d3/d4/d36/f82 4 1 2024-04-25T23:01:09.834 INFO:tasks.workunit.client.0.smithi043.stdout:3/925: chown d7/d26/d88/d121 313689736 1 2024-04-25T23:01:09.835 INFO:tasks.workunit.client.0.smithi043.stdout:4/863: write d3/d37/d4d/f52 [229943,10103] 0 2024-04-25T23:01:09.836 INFO:tasks.workunit.client.0.smithi043.stdout:1/817: unlink d0/d2f/d4b/d8f/fd8 0 2024-04-25T23:01:09.836 INFO:tasks.workunit.client.0.smithi043.stdout:3/926: read - d7/d26/d88/db0/f135 zero size 2024-04-25T23:01:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:9/874: truncate d8/de/d44/d65/fae 1418149 0 2024-04-25T23:01:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:7/901: dwrite d3/d9b/f4a [0,4194304] 0 2024-04-25T23:01:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:8/625: rmdir d3/d4/db/d4e/d5c/d59/d61/d66 39 2024-04-25T23:01:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:4/864: rmdir d3/d21/da5 39 2024-04-25T23:01:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:1/818: rmdir d0/dce 39 2024-04-25T23:01:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:2/743: rmdir d2/d66/d85/d43/d67/db3/dcb 0 2024-04-25T23:01:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:7/902: chown d3/d1e/f69 2 1 2024-04-25T23:01:09.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/626: mkdir d3/d4/db/d4e/d5c/d59/d61/d97/dcd 0 2024-04-25T23:01:09.839 INFO:tasks.workunit.client.0.smithi043.stdout:7/903: creat d3/d1e/d1f/dc5/f128 x:0 0 0 2024-04-25T23:01:09.839 INFO:tasks.workunit.client.0.smithi043.stdout:2/744: creat d2/d66/d85/d76/d97/d77/da2/ffa x:0 0 0 2024-04-25T23:01:09.839 INFO:tasks.workunit.client.0.smithi043.stdout:1/819: rename d0/dce/f110 to d0/d86/d10d/d117/d105/f125 0 2024-04-25T23:01:09.840 INFO:tasks.workunit.client.0.smithi043.stdout:4/865: getdents d3/de/d46/d6a/d8f 0 2024-04-25T23:01:09.841 INFO:tasks.workunit.client.0.smithi043.stdout:1/820: write d0/d16/d5a/d5b/fff [1512037,98969] 0 2024-04-25T23:01:09.842 INFO:tasks.workunit.client.0.smithi043.stdout:1/821: chown d0/d86/d10d/d117/f50 11 1 2024-04-25T23:01:09.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/904: symlink d3/d9b/l129 0 2024-04-25T23:01:09.843 INFO:tasks.workunit.client.0.smithi043.stdout:1/822: read - d0/d86/d10d/d117/d4f/f115 zero size 2024-04-25T23:01:09.846 INFO:tasks.workunit.client.0.smithi043.stdout:7/905: write d3/d1e/d1f/dc5/d110/f125 [2613485,28710] 0 2024-04-25T23:01:09.848 INFO:tasks.workunit.client.0.smithi043.stdout:9/875: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/f3f [0,4194304] 0 2024-04-25T23:01:09.850 INFO:tasks.workunit.client.0.smithi043.stdout:1/823: truncate d0/d86/d10d/d117/d105/f124 140928 0 2024-04-25T23:01:09.851 INFO:tasks.workunit.client.0.smithi043.stdout:2/745: dwrite d2/d66/d85/d43/d67/db3/d13/d40/f51 [0,4194304] 0 2024-04-25T23:01:09.851 INFO:tasks.workunit.client.0.smithi043.stdout:1/824: chown d0/d16/cc6 1 1 2024-04-25T23:01:09.851 INFO:tasks.workunit.client.0.smithi043.stdout:4/866: dwrite d3/de/d46/f107 [0,4194304] 0 2024-04-25T23:01:09.851 INFO:tasks.workunit.client.0.smithi043.stdout:6/799: dwrite d1/d5/d3b/d4c/ff0 [4194304,4194304] 0 2024-04-25T23:01:09.854 INFO:tasks.workunit.client.0.smithi043.stdout:4/867: mkdir d3/d19/d34/d76/d102/d12e 0 2024-04-25T23:01:09.855 INFO:tasks.workunit.client.0.smithi043.stdout:5/837: dwrite d0/d2c/d39/d1c/d25/d7a/f10a [0,4194304] 0 2024-04-25T23:01:09.855 INFO:tasks.workunit.client.0.smithi043.stdout:1/825: creat d0/f126 x:0 0 0 2024-04-25T23:01:09.856 INFO:tasks.workunit.client.0.smithi043.stdout:1/826: write d0/d86/d10d/d117/dd7/fe3 [783992,58759] 0 2024-04-25T23:01:09.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/868: rename d3/de/d27/d45/fbd to d3/de/d27/d45/f12f 0 2024-04-25T23:01:09.857 INFO:tasks.workunit.client.0.smithi043.stdout:1/827: readlink d0/d86/daa/ld3 0 2024-04-25T23:01:09.858 INFO:tasks.workunit.client.0.smithi043.stdout:8/627: sync 2024-04-25T23:01:09.858 INFO:tasks.workunit.client.0.smithi043.stdout:2/746: sync 2024-04-25T23:01:09.858 INFO:tasks.workunit.client.0.smithi043.stdout:9/876: sync 2024-04-25T23:01:09.859 INFO:tasks.workunit.client.0.smithi043.stdout:1/828: chown d0/d2f/fb0 4 1 2024-04-25T23:01:09.859 INFO:tasks.workunit.client.0.smithi043.stdout:8/628: dread - d3/faf zero size 2024-04-25T23:01:09.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/869: truncate d3/de/d27/d5c/d67/f128 681991 0 2024-04-25T23:01:09.861 INFO:tasks.workunit.client.0.smithi043.stdout:1/829: creat d0/d86/d10d/d117/d4f/f127 x:0 0 0 2024-04-25T23:01:09.861 INFO:tasks.workunit.client.0.smithi043.stdout:4/870: stat d3/d21/d6b/d87/d8a/f9e 0 2024-04-25T23:01:09.862 INFO:tasks.workunit.client.0.smithi043.stdout:6/800: dwrite d1/fe [0,4194304] 0 2024-04-25T23:01:09.863 INFO:tasks.workunit.client.0.smithi043.stdout:7/906: dwrite d3/da/d64/dee/f122 [0,4194304] 0 2024-04-25T23:01:09.863 INFO:tasks.workunit.client.0.smithi043.stdout:7/907: chown d3/da/df/d11/d8d/d123 2 1 2024-04-25T23:01:09.863 INFO:tasks.workunit.client.0.smithi043.stdout:8/629: rename d3/d4/db/d4e/d8b/d9f/d33/c26 to d3/d4/d7c/cce 0 2024-04-25T23:01:09.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/830: mkdir d0/d16/d5a/d128 0 2024-04-25T23:01:09.864 INFO:tasks.workunit.client.0.smithi043.stdout:7/908: fdatasync d3/da/df/f8c 0 2024-04-25T23:01:09.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/831: unlink d0/f2 0 2024-04-25T23:01:09.865 INFO:tasks.workunit.client.0.smithi043.stdout:4/871: rename d3/de/d27/d5c/d67/f128 to d3/d19/d34/d76/f130 0 2024-04-25T23:01:09.865 INFO:tasks.workunit.client.0.smithi043.stdout:7/909: chown d3/d9b/ddc/l10f 49 1 2024-04-25T23:01:09.866 INFO:tasks.workunit.client.0.smithi043.stdout:4/872: mkdir d3/d37/d12d/d131 0 2024-04-25T23:01:09.867 INFO:tasks.workunit.client.0.smithi043.stdout:4/873: creat d3/d19/d34/d76/d102/d12e/f132 x:0 0 0 2024-04-25T23:01:09.867 INFO:tasks.workunit.client.0.smithi043.stdout:2/747: sync 2024-04-25T23:01:09.867 INFO:tasks.workunit.client.0.smithi043.stdout:6/801: sync 2024-04-25T23:01:09.868 INFO:tasks.workunit.client.0.smithi043.stdout:4/874: readlink d3/d37/d7a/lb3 0 2024-04-25T23:01:09.868 INFO:tasks.workunit.client.0.smithi043.stdout:4/875: fsync d3/d19/f22 0 2024-04-25T23:01:09.868 INFO:tasks.workunit.client.0.smithi043.stdout:8/630: truncate d3/d4/db/d4e/d8b/d9f/d33/f9a 476479 0 2024-04-25T23:01:09.870 INFO:tasks.workunit.client.0.smithi043.stdout:4/876: readlink d3/de/d46/l6e 0 2024-04-25T23:01:09.871 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:09.871 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016845435, 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:09.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:09.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:09.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016771095999999, 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.877 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.882 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016737722999999, 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:09.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:09.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:09.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:09.887 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016659820000001, 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016608534, 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.893 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:09.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:09.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016578501000001, 2024-04-25T23:01:09.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:09.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016538927999999, 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:09.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:09.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016509235000001, 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:09.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:09.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016437349, 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:09.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:09.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:09.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016402969000001, 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:09.919 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:09.924 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.016373212000001, 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.929 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.009106528, 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:09.930 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.999179182999999, 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:09.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.995859202999998, 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.940 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.995711141000001, 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.99516831, 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.950 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:09.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.989176659999998, 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.955 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:09.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:09.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.959 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 5.1810720000000003, 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:09.960 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.964 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.5659910500000001, 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:09.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:09.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.5637619900000002, 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:09.969 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:09.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:09.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:09.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:09.973 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:09.976 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:09.970+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:09.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:09.995 INFO:tasks.workunit.client.0.smithi043.stdout:7/910: dwrite d3/da/df/d11/f93 [0,4194304] 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:8/631: symlink d3/d4/d98/lcf 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/832: link d0/d3c/f6c d0/d2f/d4b/da6/f129 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/911: write d3/d9b/d63/d98/fd1 [899553,121293] 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:2/748: dwrite d2/d66/d85/d76/d97/d77/da2/fa4 [4194304,4194304] 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:4/877: rename d3/d19/l114 to d3/d37/d7a/l133 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:8/632: creat d3/d4/d98/fd0 x:0 0 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/833: creat d0/d86/d10d/d117/d4f/f12a x:0 0 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/912: dread - d3/da/df/d11/d8d/dba/f119 zero size 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/913: fdatasync d3/d9b/f7a 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/834: symlink d0/dce/l12b 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:2/749: write d2/d66/d85/d43/d67/db3/d13/f6e [3325962,35091] 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/914: fsync d3/d1e/d1f/dc5/fec 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/835: symlink d0/d86/d10b/d10e/l12c 0 2024-04-25T23:01:09.996 INFO:tasks.workunit.client.0.smithi043.stdout:2/750: creat d2/d66/dc5/ffb x:0 0 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:2/751: sync 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/915: write d3/d1e/d1f/f7c [128699,86497] 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/836: stat d0/d2f 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/837: write d0/d16/f5e [4006334,130501] 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:2/752: creat d2/d66/d85/d43/d67/d8d/ffc x:0 0 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/838: truncate d0/d86/d10d/d117/f30 772530 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/839: creat d0/d86/f12d x:0 0 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/916: dwrite d3/d9b/f80 [0,4194304] 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/840: mkdir d0/d9/d63/d12e 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/917: creat d3/d9b/ddc/f12a x:0 0 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/841: chown d0/d9/d63/d12e 44339115 1 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/918: readlink d3/da/df/l2b 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/842: mknod d0/d16/dd1/c12f 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/919: mknod d3/d96/c12b 0 2024-04-25T23:01:09.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/920: write d3/d9b/f4a [1052309,43101] 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/921: chown d3/da/d78/dd4 1501 1 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/922: stat d3/da/df/d11/d8d/f113 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/923: symlink d3/d96/l12c 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:6/802: dwrite d1/d5/d3b/d4c/d21/d38/f45 [0,4194304] 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/924: fsync d3/da/fcd 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/925: rename d3/d1e/d1f/dc5/fec to d3/d1e/d1f/dc5/d99/f12d 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/926: write d3/d1e/d1f/f7c [4894495,66750] 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/927: fdatasync d3/d1e/fb8 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:8/633: truncate d3/d4/f8 4907065 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/928: link d3/da/d78/lb6 d3/l12e 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:8/634: dread - d3/d4/d7c/d92/fc7 zero size 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/929: chown d3/d9b/ddc/f10b 0 1 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:6/803: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/fc0 [0,4194304] 0 2024-04-25T23:01:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:8/635: write d3/faf [172458,95651] 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:8/636: creat d3/d4/db/d4e/d5c/d59/d61/d97/fd1 x:0 0 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:6/804: creat d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e/d9c/dc3/f10d x:0 0 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:8/637: unlink d3/d4/db/d4e/d5c/d2e/f46 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/878: dread d3/d37/d7a/fa1 [0,4194304] 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/879: chown d3/de/ld6 28198103 1 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:8/638: chown d3/d4/db/d14/d4c/d68/lc5 15224940 1 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/880: unlink d3/d37/f11d 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:8/639: mkdir d3/d4/db/d14/dcc/dd2 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/881: creat d3/d21/d6b/d87/d8a/f134 x:0 0 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:7/930: dwrite d3/d9b/d63/fe0 [0,4194304] 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:7/931: stat d3/d96/l12c 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:7/932: fsync d3/da/d64/fd0 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/882: dread d3/d37/d7a/fa1 [0,4194304] 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:2/753: truncate d2/d66/d85/d43/f8e 2543467 0 2024-04-25T23:01:09.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/883: truncate d3/d37/d4d/f8c 688906 0 2024-04-25T23:01:10.000 INFO:tasks.workunit.client.0.smithi043.stdout:7/933: rmdir d3/da/df/d11/d8d 39 2024-04-25T23:01:10.000 INFO:tasks.workunit.client.0.smithi043.stdout:9/877: dread d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/fe1 [0,4194304] 0 2024-04-25T23:01:10.000 INFO:tasks.workunit.client.0.smithi043.stdout:8/640: write d3/d4/db/d4e/d5c/d2e/f72 [4227341,74468] 0 2024-04-25T23:01:10.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/772: dread d1b/d23/f2a [0,4194304] 0 2024-04-25T23:01:10.001 INFO:tasks.workunit.client.0.smithi043.stdout:7/934: unlink d3/d1e/d1f/f7c 0 2024-04-25T23:01:10.001 INFO:tasks.workunit.client.0.smithi043.stdout:6/805: read d1/d5/f22 [1041178,6031] 0 2024-04-25T23:01:10.001 INFO:tasks.workunit.client.0.smithi043.stdout:9/878: rename d8/de/d44/d47/d6a/l90 to d8/de/d12/d16/d24/dbe/dc6/d2f/d84/l12e 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/773: write d1b/d31/f81 [831520,71559] 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/774: fsync f8 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:6/806: write d1/d5/d3b/fda [878133,77398] 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/843: read d0/d86/d10d/d117/f50 [3483921,109432] 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/935: rename d3/da/fcd to d3/da/d78/f12f 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:5/838: dread d0/d2c/d39/d1c/d25/fa2 [0,4194304] 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:3/927: dread d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f10f [0,4194304] 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:8/641: rename d3/d4/db/d14/f2c to d3/d4/d36/fd3 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/775: creat d1b/dea/ff7 x:0 0 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:6/807: rmdir d1/d5/d3b/d62 39 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/844: mkdir d0/d16/df7/dbf/d130 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/776: creat d1b/d23/d7b/da6/ff8 x:0 0 0 2024-04-25T23:01:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:4/884: dread d3/de/d27/d5c/d67/fe4 [0,4194304] 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:2/754: dwrite d2/d66/d85/d43/d5d/da9/fc3 [0,4194304] 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:0/777: write d1b/d23/d7b/da6/fb8 [4464836,56279] 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/879: rename d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/l117 to d8/de/d44/de8/l12f 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:4/885: mkdir d3/d37/d12d/d135 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:6/808: creat d1/d5/d3b/d4c/d21/d38/d99/f10e x:0 0 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:8/642: symlink d3/d4/db/d4e/d8b/d9f/d33/db0/ld4 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:0/778: creat d1b/d31/d3c/d50/ff9 x:0 0 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/845: rename d0/d9/d63/ffe to d0/dce/f131 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:4/886: truncate d3/d19/ff4 281117 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:6/809: write d1/d2a/dd5/fed [838351,90661] 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/880: write d8/de/d12/d16/d24/dbe/dc6/d2f/da6/fe7 [817949,120787] 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:0/779: mknod d1b/d31/db1/cfa 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/846: creat d0/d16/df7/f132 x:0 0 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:8/643: mkdir d3/d4/db/d4e/d8b/d9f/dd5 0 2024-04-25T23:01:10.003 INFO:tasks.workunit.client.0.smithi043.stdout:5/839: link d0/d2c/d39/d1c/d25/d7a/c59 d0/d2c/d39/d1c/d25/d7a/d2d/df0/d10b/c113 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:4/887: creat d3/de/d46/d6a/d8f/d8e/db5/dda/df0/f136 x:0 0 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:3/928: getdents d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/d10b 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:1/847: fdatasync d0/f1a 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:7/936: truncate d3/d1e/d1f/dc5/fdb 1863519 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:6/810: mknod d1/d5/d3b/db6/c10f 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:2/755: rename d2/d66/d85/d43/d67/db3/d13/l5c to d2/d66/d85/d43/d67/db3/lfd 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:9/881: write d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/f5b [137394,124562] 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:8/644: symlink d3/d4/db/d14/ld6 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:7/937: symlink d3/d9b/d63/l130 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:6/811: fsync d1/d2a/db5/dc4/dc9/fd8 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:4/888: getdents d3 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:2/756: chown d2/d66/d85/d43/d5d/da9/dd7/da3/le4 2 1 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:3/929: creat d7/d26/d27/d34/d1a/d40/d8f/d51/de1/d144/f145 x:0 0 0 2024-04-25T23:01:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:8/645: symlink d3/d4/db/d4e/d8b/d91/ld7 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:9/882: truncate d8/de/d44/d5d/f10f 856203 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:8/646: stat d3/d4/d7c/lac 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:3/930: creat d7/d26/f146 x:0 0 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:9/883: creat d8/de/d44/d5d/d4f/f130 x:0 0 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/780: dwrite f11 [0,4194304] 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:7/938: link d3/da/df/f8c d3/da/df/d11/d8d/f131 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:4/889: link d3/de/d46/d6a/d8f/d8e/db5/ff5 d3/d21/d6b/d87/d8a/f137 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:2/757: link d2/d66/dc5/fec d2/d66/d85/d43/d5d/da9/dd7/df7/ffe 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:3/931: creat d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f147 x:0 0 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:1/848: dwrite d0/d16/d5a/d5b/f118 [0,4194304] 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/781: stat d1b/d31/l94 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:6/812: dwrite d1/d5/f95 [4194304,4194304] 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:1/849: dread - d0/d2f/d4b/d8f/ff8 zero size 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:9/884: unlink d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/f12b 0 2024-04-25T23:01:10.005 INFO:tasks.workunit.client.0.smithi043.stdout:2/758: mkdir d2/d66/d85/d43/d5d/da9/dd7/db9/dff 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:3/932: symlink d7/d26/d27/d34/d1a/d28/d9e/dcc/l148 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:1/850: creat d0/d16/d5a/f133 x:0 0 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:9/885: chown d8/de/d44/d65/ldf 15449983 1 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:2/759: mknod d2/d66/d85/d76/d97/c100 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:7/939: dwrite d3/d1e/d1f/dc5/f82 [0,4194304] 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:4/890: dwrite d3/d21/d84/f12c [0,4194304] 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:7/940: dread - d3/d1e/d1f/dc5/d99/f12d zero size 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:3/933: unlink d7/d26/d2d/dce/d13b/f69 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:1/851: dread d0/d86/fa0 [0,4194304] 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:0/782: dwrite d1b/d23/f53 [0,4194304] 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:6/813: dwrite d1/d5/d3b/d4c/d21/d38/d99/feb [0,4194304] 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:4/891: mknod d3/de/d46/c138 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:3/934: write d7/d26/d2d/dce/d13b/d7c/db2/f11e [890806,28043] 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:0/783: rename d1b/d8b/da2/le9 to d1b/d8b/lfb 0 2024-04-25T23:01:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:2/760: mknod d2/d66/d85/d43/d67/ddd/c101 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:3/935: dread - d7/d26/d27/fd4 zero size 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:6/814: chown d1/d5/d3b/d4c/cf4 0 1 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/784: symlink d1b/d23/dab/dbd/lfc 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:6/815: creat d1/d2a/db5/dc4/dc9/d10b/f110 x:0 0 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/785: mknod d1b/d23/d7a/dad/df5/cfd 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/886: dwrite d8/de/d12/fa2 [4194304,4194304] 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:6/816: creat d1/d5/d3b/d4c/d21/d55/d6d/d96/f111 x:0 0 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/786: chown d1b/d8b/c68 25861976 1 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/887: write d8/de/d8c/fb2 [163574,3920] 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/787: readlink d1b/d23/d39/d90/df4/l75 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/888: chown d8/de/f42 12 1 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/889: unlink d8/de/f10 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/890: chown d8/de/d44/d5d/d4f/d110/d11f 223957194 1 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/788: truncate d1b/d23/dab/fc2 661176 0 2024-04-25T23:01:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:4/892: dwrite d3/d19/fab [4194304,4194304] 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:0/789: readlink d1b/d31/d3c/d50/l76 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:8/647: sync 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:7/941: sync 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:0/790: write d1b/d23/f3d [2952137,5991] 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:9/891: unlink d8/de/d12/d16/d24/dbe/dc6/f118 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:4/893: creat d3/d19/d34/d76/d102/f139 x:0 0 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:3/936: write d7/d26/d27/d34/f106 [1008180,18324] 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:9/892: chown d8/de/d8c/cb6 549372530 1 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:6/817: dwrite d1/dc8/fd2 [0,4194304] 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:8/648: rename d3/d4/db/d14/d56/d5d/f81 to d3/d4/d7c/d92/fd8 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:4/894: symlink d3/d19/d34/d76/d102/d12e/l13a 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:0/791: creat d1b/d23/d7a/dc8/ffe x:0 0 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:6/818: chown d1/d5/f1d 259465 1 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:9/893: getdents d8/de/d44/d65/d103 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:3/937: creat d7/d26/f149 x:0 0 0 2024-04-25T23:01:10.008 INFO:tasks.workunit.client.0.smithi043.stdout:4/895: creat d3/de/d46/d95/f13b x:0 0 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:8/649: mknod d3/d4/d7c/d92/d62/cd9 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:1/852: dread d0/d86/d10d/d117/d105/f124 [0,4194304] 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:6/819: write d1/d2a/db5/dc4/f103 [588103,119877] 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:2/761: truncate d2/d66/d85/d43/d5d/f4d 2766093 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/942: dread d3/d9b/f4a [0,4194304] 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:1/853: chown d0/lac 95698 1 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:5/840: dread d0/f17 [0,4194304] 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:4/896: rmdir d3/d21/da5/dff 39 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:3/938: chown d7/d26/d27/d34/d1a/f50 797955 1 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:1/854: fdatasync d0/d2f/d4b/d8f/fe1 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:2/762: fsync d2/d66/d85/d76/d97/f52 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/943: write d3/d1e/f50 [18121,4327] 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:3/939: chown d7/d26/d2d/l79 408 1 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:5/841: write d0/d2c/f9a [2467346,97568] 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:4/897: mkdir d3/de/d46/d6a/d13c 0 2024-04-25T23:01:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/944: write d3/d1e/f50 [2858025,126007] 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:8/650: creat d3/d4/db/d4e/d5c/d59/d61/d97/dcd/fda x:0 0 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:3/940: stat d7/d26/d2d/dce/d13b/d7c/db2/d52/l9b 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:6/820: link d1/d5/d3b/d4c/d21/d55/fa6 d1/d5/d3b/d4c/d21/d38/de6/f112 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:3/941: symlink d7/d26/d88/db8/d101/l14a 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/792: dwrite d1b/d31/d3c/d50/ff3 [0,4194304] 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:5/842: fdatasync d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f96 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/793: truncate d1b/d8b/dc0/fc9 4258489 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/794: stat d1b/d23/d39/d90/l99 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/795: creat d1b/d8b/da2/fff x:0 0 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/796: write d1b/d23/f3e [2409075,23195] 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:4/898: dwrite d3/de/d46/d6a/d8f/d8e/fae [0,4194304] 0 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/797: sync 2024-04-25T23:01:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:1/855: truncate d0/d86/d10d/d117/d105/f125 879451 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/843: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/ff9 [0,4194304] 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:3/942: unlink d7/d26/d27/d34/d1a/d40/d8f/f3e 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/798: mkdir d1b/d23/d91/ddd/d100 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/799: creat d1b/d7f/f101 x:0 0 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/844: link d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/da9/fc7 d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2/f114 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/800: truncate d1b/d23/d39/d90/df4/fe5 647071 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/801: mkdir d1b/d31/d102 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:2/763: write d2/d66/d85/d43/d5d/f4d [568211,102966] 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:4/899: dwrite d3/d19/d34/f68 [0,4194304] 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:2/764: write d2/fac [3121731,50000] 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/802: rename d1b/d8b/da2 to d1b/d8b/d103 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/803: write d1b/d23/d39/f4b [3966740,120785] 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:2/765: write d2/d66/d85/f36 [61839,120791] 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:7/945: fdatasync d3/d1e/f50 0 2024-04-25T23:01:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/845: rename d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/lac to d0/d2c/d39/d1c/d25/d7a/d41/d4a/l115 0 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:8/651: dread d3/d4/db/d14/d4c/d77/f27 [8388608,4194304] 0 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:8/652: dread - d3/d4/d98/fd0 zero size 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:0/804: chown d1b/d8b/d103/fa8 14 1 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:2/766: dread - d2/d66/d85/d76/faf zero size 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:5/846: truncate d0/d2c/f6b 1316941 0 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:0/805: mknod d1b/d23/dab/c104 0 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:7/946: write d3/d9b/d63/f95 [1477934,94015] 0 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:8/653: chown d3/d4/db/d4e/d8b/d9f/d8d 73423980 1 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:0/806: chown d1b/d8b/d103 40 1 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:7/947: unlink d3/d1e/f50 0 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:2/767: truncate d2/d66/d85/d43/d5d/f84 824184 0 2024-04-25T23:01:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:7/948: mkdir d3/da/d78/d132 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:2/768: stat d2/d66/d85/d76/d97 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:4/900: dwrite d3/d19/d34/d76/f109 [0,4194304] 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:0/807: write d1b/d31/d3c/d50/f9b [2239428,82949] 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/856: write d0/d9/f21 [1185917,109887] 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:5/847: dread d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f96 [0,4194304] 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:4/901: symlink d3/db6/l13d 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:7/949: mkdir d3/da/df/d11/d8d/dba/d133 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:2/769: truncate d2/d66/d85/d76/d97/f39 2588204 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:7/950: readlink d3/d96/l12c 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/857: creat d0/d2f/d4b/f134 x:0 0 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:8/654: dwrite d3/d4/db/d14/d56/d5d/d9c/da7/fb6 [0,4194304] 0 2024-04-25T23:01:10.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/858: mkdir d0/d16/d135 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:7/951: getdents d3/da/d64 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:5/848: getdents d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:8/655: write d3/d4/db/d14/f19 [88802,69054] 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:9/894: dread d8/de/d44/d5d/d4f/f73 [0,4194304] 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:4/902: dwrite d3/d19/f5a [0,4194304] 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:8/656: chown d3/d4/db/d4e/c5a 132377 1 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:7/952: mkdir d3/d9b/d63/dc9/d115/d134 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:1/859: write d0/d9/fb4 [1666344,18411] 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:9/895: write d8/de/d44/d5d/fdb [881218,81458] 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:7/953: write d3/d9b/f7a [1614322,111223] 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:1/860: chown d0/d9/ddc/de6/f109 11 1 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:9/896: write d8/de/d8c/fb2 [396657,33765] 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:8/657: creat d3/d4/d98/fdb x:0 0 0 2024-04-25T23:01:10.017 INFO:tasks.workunit.client.0.smithi043.stdout:1/861: mknod d0/d2f/d4b/c136 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/897: chown d8/de/d44/d5d/c122 12 1 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:7/954: symlink d3/da/d78/dd4/d127/l135 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/862: rename d0/d86/fa0 to d0/d86/d10d/d117/d105/f137 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:7/955: rmdir d3/da/d78/dd4/d107 39 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/863: write d0/d2f/f61 [4757208,71526] 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/898: link d8/de/d44/c8e d8/de/d12/d16/d24/dbe/dc6/d2f/dad/c131 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/864: fsync d0/d3c/ffc 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/899: fdatasync d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fbd 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:0/808: write d1b/d31/d3c/d50/f5d [2628332,41464] 0 2024-04-25T23:01:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/900: symlink d8/de/d12/d16/d24/l132 0 2024-04-25T23:01:10.019 INFO:tasks.workunit.client.0.smithi043.stdout:0/809: chown d1b/d23/dab/dbd/dcc/ff2 26653393 1 2024-04-25T23:01:10.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/901: dread - d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f121 zero size 2024-04-25T23:01:10.020 INFO:tasks.workunit.client.0.smithi043.stdout:7/956: dwrite d3/da/df/d11/d26/f8e [0,4194304] 0 2024-04-25T23:01:10.020 INFO:tasks.workunit.client.0.smithi043.stdout:2/770: dwrite d2/d66/dc5/fec [0,4194304] 0 2024-04-25T23:01:10.020 INFO:tasks.workunit.client.0.smithi043.stdout:7/957: chown d3/d52/l85 2701 1 2024-04-25T23:01:10.023 INFO:tasks.workunit.client.0.smithi043.stdout:9/902: creat d8/de/d44/d65/d103/f133 x:0 0 0 2024-04-25T23:01:10.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/865: write d0/d16/df7/f7e [757767,35035] 0 2024-04-25T23:01:10.024 INFO:tasks.workunit.client.0.smithi043.stdout:2/771: rename d2/d66/d85/d43/d5d/da9/dd7/db9/fd6 to d2/d66/d85/d43/d5d/dee/f102 0 2024-04-25T23:01:10.025 INFO:tasks.workunit.client.0.smithi043.stdout:0/810: dread d1b/db0/fd5 [0,4194304] 0 2024-04-25T23:01:10.026 INFO:tasks.workunit.client.0.smithi043.stdout:9/903: symlink d8/de/d12/l134 0 2024-04-25T23:01:10.026 INFO:tasks.workunit.client.0.smithi043.stdout:1/866: mknod d0/d16/df7/dbf/c138 0 2024-04-25T23:01:10.026 INFO:tasks.workunit.client.0.smithi043.stdout:2/772: creat d2/d66/d85/d76/d97/d77/d9a/f103 x:0 0 0 2024-04-25T23:01:10.026 INFO:tasks.workunit.client.0.smithi043.stdout:0/811: creat d1b/d23/f105 x:0 0 0 2024-04-25T23:01:10.027 INFO:tasks.workunit.client.0.smithi043.stdout:0/812: chown d1b 532 1 2024-04-25T23:01:10.027 INFO:tasks.workunit.client.0.smithi043.stdout:1/867: mknod d0/d2f/d4b/d8f/c139 0 2024-04-25T23:01:10.029 INFO:tasks.workunit.client.0.smithi043.stdout:9/904: chown d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/fd3 63 1 2024-04-25T23:01:10.029 INFO:tasks.workunit.client.0.smithi043.stdout:7/958: dwrite d3/d9b/d63/f10e [0,4194304] 0 2024-04-25T23:01:10.029 INFO:tasks.workunit.client.0.smithi043.stdout:1/868: fdatasync d0/d86/d10d/d117/d105/f125 0 2024-04-25T23:01:10.030 INFO:tasks.workunit.client.0.smithi043.stdout:2/773: truncate d2/d66/d85/d43/d5d/da9/dd7/fed 5064388 0 2024-04-25T23:01:10.030 INFO:tasks.workunit.client.0.smithi043.stdout:3/943: dread d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/ff3 [0,4194304] 0 2024-04-25T23:01:10.031 INFO:tasks.workunit.client.0.smithi043.stdout:7/959: creat d3/d9b/da8/f136 x:0 0 0 2024-04-25T23:01:10.031 INFO:tasks.workunit.client.0.smithi043.stdout:1/869: symlink d0/d16/df7/dbf/l13a 0 2024-04-25T23:01:10.031 INFO:tasks.workunit.client.0.smithi043.stdout:0/813: truncate d1b/f40 1385957 0 2024-04-25T23:01:10.032 INFO:tasks.workunit.client.0.smithi043.stdout:1/870: symlink d0/d2f/d4b/d8f/l13b 0 2024-04-25T23:01:10.033 INFO:tasks.workunit.client.0.smithi043.stdout:2/774: rename d2/d66/d85/d43/d5d/da9/dd7/fed to d2/d66/d85/d76/d97/d77/f104 0 2024-04-25T23:01:10.034 INFO:tasks.workunit.client.0.smithi043.stdout:6/821: dread d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/f75 [4194304,4194304] 0 2024-04-25T23:01:10.036 INFO:tasks.workunit.client.0.smithi043.stdout:0/814: link d1b/d23/d7b/le1 d1b/d23/d39/d90/l106 0 2024-04-25T23:01:10.036 INFO:tasks.workunit.client.0.smithi043.stdout:6/822: mknod d1/d5/d3b/d4c/d21/c113 0 2024-04-25T23:01:10.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/905: dwrite d8/de/d12/d16/f1f [0,4194304] 0 2024-04-25T23:01:10.038 INFO:tasks.workunit.client.0.smithi043.stdout:0/815: creat d1b/db0/f107 x:0 0 0 2024-04-25T23:01:10.039 INFO:tasks.workunit.client.0.smithi043.stdout:4/903: dread d3/de/d46/d6a/fd0 [0,4194304] 0 2024-04-25T23:01:10.041 INFO:tasks.workunit.client.0.smithi043.stdout:2/775: dwrite d2/f98 [4194304,4194304] 0 2024-04-25T23:01:10.041 INFO:tasks.workunit.client.0.smithi043.stdout:1/871: dwrite d0/d9/ddc/de6/f109 [0,4194304] 0 2024-04-25T23:01:10.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/904: getdents d3/d37/d12d/d131 0 2024-04-25T23:01:10.043 INFO:tasks.workunit.client.0.smithi043.stdout:4/905: dread - d3/d21/d6b/d87/d8a/f117 zero size 2024-04-25T23:01:10.044 INFO:tasks.workunit.client.0.smithi043.stdout:1/872: link d0/d2f/ff3 d0/d9/d63/d12e/f13c 0 2024-04-25T23:01:10.045 INFO:tasks.workunit.client.0.smithi043.stdout:4/906: mkdir d3/d19/d13e 0 2024-04-25T23:01:10.046 INFO:tasks.workunit.client.0.smithi043.stdout:4/907: chown d3/d19/f5a 39640 1 2024-04-25T23:01:10.046 INFO:tasks.workunit.client.0.smithi043.stdout:1/873: rename d0/d2f/d4b/d8f/c139 to d0/d16/df7/dbf/c13d 0 2024-04-25T23:01:10.047 INFO:tasks.workunit.client.0.smithi043.stdout:1/874: fsync d0/d9/d63/fba 0 2024-04-25T23:01:10.048 INFO:tasks.workunit.client.0.smithi043.stdout:4/908: mkdir d3/d21/d6b/d87/d13f 0 2024-04-25T23:01:10.049 INFO:tasks.workunit.client.0.smithi043.stdout:1/875: mkdir d0/d86/d10d/d117/d13e 0 2024-04-25T23:01:10.050 INFO:tasks.workunit.client.0.smithi043.stdout:1/876: chown d0/d9/ddc/de6 24913 1 2024-04-25T23:01:10.052 INFO:tasks.workunit.client.0.smithi043.stdout:2/776: dwrite d2/d66/d85/d43/d5d/da9/dd7/df7/f64 [4194304,4194304] 0 2024-04-25T23:01:10.052 INFO:tasks.workunit.client.0.smithi043.stdout:0/816: dwrite d1b/f40 [0,4194304] 0 2024-04-25T23:01:10.056 INFO:tasks.workunit.client.0.smithi043.stdout:0/817: chown d1b/d23/dab/ce2 232367 1 2024-04-25T23:01:10.057 INFO:tasks.workunit.client.0.smithi043.stdout:4/909: dwrite d3/d37/d7a/fdd [0,4194304] 0 2024-04-25T23:01:10.059 INFO:tasks.workunit.client.0.smithi043.stdout:1/877: dwrite d0/d9/f44 [0,4194304] 0 2024-04-25T23:01:10.060 INFO:tasks.workunit.client.0.smithi043.stdout:2/777: dwrite d2/d66/d85/d76/d97/d77/da2/db7/fe6 [0,4194304] 0 2024-04-25T23:01:10.060 INFO:tasks.workunit.client.0.smithi043.stdout:1/878: mknod d0/d9/c13f 0 2024-04-25T23:01:10.061 INFO:tasks.workunit.client.0.smithi043.stdout:2/778: mkdir d2/d66/d85/d43/d5d/da9/dd7/da3/d105 0 2024-04-25T23:01:10.061 INFO:tasks.workunit.client.0.smithi043.stdout:4/910: truncate d3/d21/f64 1303715 0 2024-04-25T23:01:10.062 INFO:tasks.workunit.client.0.smithi043.stdout:2/779: read - d2/d66/d85/d43/d5d/dee/ff9 zero size 2024-04-25T23:01:10.062 INFO:tasks.workunit.client.0.smithi043.stdout:4/911: mkdir d3/d37/d12d/d140 0 2024-04-25T23:01:10.062 INFO:tasks.workunit.client.0.smithi043.stdout:4/912: chown d3/d21/l56 169 1 2024-04-25T23:01:10.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/913: sync 2024-04-25T23:01:10.063 INFO:tasks.workunit.client.0.smithi043.stdout:2/780: creat d2/f106 x:0 0 0 2024-04-25T23:01:10.064 INFO:tasks.workunit.client.0.smithi043.stdout:2/781: rmdir d2/d66/d85/d43/d5d/da9/dd7/da3 39 2024-04-25T23:01:10.065 INFO:tasks.workunit.client.0.smithi043.stdout:4/914: rename d3/d21/d6b/d87/d8a/de1/lf2 to d3/d19/d34/l141 0 2024-04-25T23:01:10.065 INFO:tasks.workunit.client.0.smithi043.stdout:5/849: dread d0/d2c/d39/d1c/d25/d7a/f1e [0,4194304] 0 2024-04-25T23:01:10.067 INFO:tasks.workunit.client.0.smithi043.stdout:4/915: truncate d3/de/d46/d6a/d8f/d8e/db5/ff5 1272340 0 2024-04-25T23:01:10.067 INFO:tasks.workunit.client.0.smithi043.stdout:5/850: unlink d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fb3 0 2024-04-25T23:01:10.068 INFO:tasks.workunit.client.0.smithi043.stdout:4/916: chown d3/de/d46/d6a/d8f/cdf 36465 1 2024-04-25T23:01:10.070 INFO:tasks.workunit.client.0.smithi043.stdout:8/658: dread d3/d4/f71 [0,4194304] 0 2024-04-25T23:01:10.071 INFO:tasks.workunit.client.0.smithi043.stdout:2/782: dread d2/d66/d85/d43/d67/db3/f47 [0,4194304] 0 2024-04-25T23:01:10.073 INFO:tasks.workunit.client.0.smithi043.stdout:0/818: dread d1b/d23/d7a/f98 [0,4194304] 0 2024-04-25T23:01:10.074 INFO:tasks.workunit.client.0.smithi043.stdout:0/819: dread - d1b/dea/fef zero size 2024-04-25T23:01:10.075 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:10.074+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:10.081 INFO:tasks.workunit.client.0.smithi043.stdout:7/960: dread d3/f19 [0,4194304] 0 2024-04-25T23:01:10.082 INFO:tasks.workunit.client.0.smithi043.stdout:0/820: dwrite d1b/f45 [0,4194304] 0 2024-04-25T23:01:10.082 INFO:tasks.workunit.client.0.smithi043.stdout:2/783: dwrite d2/d66/d85/d43/f8e [0,4194304] 0 2024-04-25T23:01:10.083 INFO:tasks.workunit.client.0.smithi043.stdout:7/961: write d3/d1e/d1f/d6b/d72/f97 [928483,117420] 0 2024-04-25T23:01:10.083 INFO:tasks.workunit.client.0.smithi043.stdout:5/851: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/fdd [0,4194304] 0 2024-04-25T23:01:10.084 INFO:tasks.workunit.client.0.smithi043.stdout:0/821: mknod d1b/d31/c108 0 2024-04-25T23:01:10.085 INFO:tasks.workunit.client.0.smithi043.stdout:2/784: creat d2/d66/d85/d76/d97/d77/f107 x:0 0 0 2024-04-25T23:01:10.086 INFO:tasks.workunit.client.0.smithi043.stdout:2/785: read d2/d66/d85/d43/f8e [3386775,57462] 0 2024-04-25T23:01:10.087 INFO:tasks.workunit.client.0.smithi043.stdout:1/879: dread d0/d9/f80 [0,4194304] 0 2024-04-25T23:01:10.088 INFO:tasks.workunit.client.0.smithi043.stdout:2/786: fsync d2/d66/dc5/ffb 0 2024-04-25T23:01:10.090 INFO:tasks.workunit.client.0.smithi043.stdout:1/880: symlink d0/d16/df7/dbf/d130/l140 0 2024-04-25T23:01:10.092 INFO:tasks.workunit.client.0.smithi043.stdout:2/787: link d2/d7f/f81 d2/d66/d85/d43/d5d/f108 0 2024-04-25T23:01:10.092 INFO:tasks.workunit.client.0.smithi043.stdout:5/852: dwrite d0/d2c/d39/d63/f93 [4194304,4194304] 0 2024-04-25T23:01:10.092 INFO:tasks.workunit.client.0.smithi043.stdout:2/788: fdatasync d2/fb0 0 2024-04-25T23:01:10.093 INFO:tasks.workunit.client.0.smithi043.stdout:5/853: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d116 0 2024-04-25T23:01:10.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/789: getdents d2/d66/d85/d43/d5d/dee 0 2024-04-25T23:01:10.095 INFO:tasks.workunit.client.0.smithi043.stdout:0/822: dwrite d1b/d23/d7a/f98 [0,4194304] 0 2024-04-25T23:01:10.095 INFO:tasks.workunit.client.0.smithi043.stdout:2/790: readlink d2/d66/d85/d76/d97/lf4 0 2024-04-25T23:01:10.095 INFO:tasks.workunit.client.0.smithi043.stdout:5/854: write d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/fdc [563109,69736] 0 2024-04-25T23:01:10.097 INFO:tasks.workunit.client.0.smithi043.stdout:2/791: rename d2/d66/d85/d76/d97/d77/da2/db7/dbf/le9 to d2/d66/d85/d76/d97/d77/da2/db5/l109 0 2024-04-25T23:01:10.098 INFO:tasks.workunit.client.0.smithi043.stdout:2/792: write d2/d66/d85/d43/d67/db3/d13/d40/f51 [1122120,111306] 0 2024-04-25T23:01:10.099 INFO:tasks.workunit.client.0.smithi043.stdout:5/855: chown d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1/fdc 34050 1 2024-04-25T23:01:10.099 INFO:tasks.workunit.client.0.smithi043.stdout:2/793: mknod d2/d66/d85/d43/c10a 0 2024-04-25T23:01:10.099 INFO:tasks.workunit.client.0.smithi043.stdout:7/962: truncate d3/da/d64/fd0 3924913 0 2024-04-25T23:01:10.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/856: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b/daf/d117 0 2024-04-25T23:01:10.101 INFO:tasks.workunit.client.0.smithi043.stdout:2/794: creat d2/d66/d85/d76/d97/f10b x:0 0 0 2024-04-25T23:01:10.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/857: chown d0/d2c/d39/d1c/d25/d7a/f10a 0 1 2024-04-25T23:01:10.103 INFO:tasks.workunit.client.0.smithi043.stdout:5/858: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62 39 2024-04-25T23:01:10.103 INFO:tasks.workunit.client.0.smithi043.stdout:5/859: sync 2024-04-25T23:01:10.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/860: unlink d0/d2c/d39/d1c/d25/d7a/d92/cbc 0 2024-04-25T23:01:10.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/861: fdatasync d0/d2c/d39/d1c/d25/d7a/d2d/fdd 0 2024-04-25T23:01:10.108 INFO:tasks.workunit.client.0.smithi043.stdout:7/963: dread d3/d1e/d1f/f51 [0,4194304] 0 2024-04-25T23:01:10.109 INFO:tasks.workunit.client.0.smithi043.stdout:9/906: dread d8/de/d44/d5d/dd2/fff [4194304,4194304] 0 2024-04-25T23:01:10.110 INFO:tasks.workunit.client.0.smithi043.stdout:5/862: mknod d0/d2c/d39/d1c/d25/d7a/d41/c118 0 2024-04-25T23:01:10.110 INFO:tasks.workunit.client.0.smithi043.stdout:7/964: rename d3/da/d64/dee/d10d to d3/d1e/d1f/dc5/d99/d137 0 2024-04-25T23:01:10.113 INFO:tasks.workunit.client.0.smithi043.stdout:9/907: truncate d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/ff7 854142 0 2024-04-25T23:01:10.113 INFO:tasks.workunit.client.0.smithi043.stdout:3/944: dread d7/f2a [4194304,4194304] 0 2024-04-25T23:01:10.113 INFO:tasks.workunit.client.0.smithi043.stdout:9/908: stat d8/de/d12 0 2024-04-25T23:01:10.114 INFO:tasks.workunit.client.0.smithi043.stdout:5/863: truncate d0/d2c/d39/d1c/f55 3325716 0 2024-04-25T23:01:10.114 INFO:tasks.workunit.client.0.smithi043.stdout:9/909: mknod d8/de/d44/d5d/c135 0 2024-04-25T23:01:10.114 INFO:tasks.workunit.client.0.smithi043.stdout:3/945: fdatasync d7/d26/d2d/dce/d13b/d7c/db2/d52/f58 0 2024-04-25T23:01:10.115 INFO:tasks.workunit.client.0.smithi043.stdout:9/910: mkdir d8/d136 0 2024-04-25T23:01:10.116 INFO:tasks.workunit.client.0.smithi043.stdout:3/946: creat d7/d26/d88/d121/f14b x:0 0 0 2024-04-25T23:01:10.116 INFO:tasks.workunit.client.0.smithi043.stdout:4/917: dread d3/d21/f63 [0,4194304] 0 2024-04-25T23:01:10.116 INFO:tasks.workunit.client.0.smithi043.stdout:8/659: dread d3/d4/db/d14/d4c/d77/f27 [4194304,4194304] 0 2024-04-25T23:01:10.117 INFO:tasks.workunit.client.0.smithi043.stdout:2/795: dread d2/d66/d85/f37 [0,4194304] 0 2024-04-25T23:01:10.117 INFO:tasks.workunit.client.0.smithi043.stdout:9/911: mkdir d8/de/d44/d5d/d4f/d110/d137 0 2024-04-25T23:01:10.119 INFO:tasks.workunit.client.0.smithi043.stdout:4/918: unlink d3/d21/d6b/d87/d8a/f137 0 2024-04-25T23:01:10.119 INFO:tasks.workunit.client.0.smithi043.stdout:5/864: rename d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/dd1 to d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/d119 0 2024-04-25T23:01:10.119 INFO:tasks.workunit.client.0.smithi043.stdout:1/881: dread d0/f26 [0,4194304] 0 2024-04-25T23:01:10.120 INFO:tasks.workunit.client.0.smithi043.stdout:1/882: chown d0/d3c 1 1 2024-04-25T23:01:10.120 INFO:tasks.workunit.client.0.smithi043.stdout:8/660: rename d3/d4/db/d4e/d5c/d2e/f72 to d3/d4/d7c/d92/fdc 0 2024-04-25T23:01:10.120 INFO:tasks.workunit.client.0.smithi043.stdout:1/883: fdatasync d0/fbd 0 2024-04-25T23:01:10.120 INFO:tasks.workunit.client.0.smithi043.stdout:2/796: rename d2/d66/dc5 to d2/d66/d85/d43/d67/d10c 0 2024-04-25T23:01:10.120 INFO:tasks.workunit.client.0.smithi043.stdout:3/947: getdents d7/d26/d2d/dce/d13b/d7c/db2/d87 0 2024-04-25T23:01:10.120 INFO:tasks.workunit.client.0.smithi043.stdout:9/912: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/f138 x:0 0 0 2024-04-25T23:01:10.121 INFO:tasks.workunit.client.0.smithi043.stdout:4/919: rename d3/d21/d6b/d87/d8a/f134 to d3/de/d27/d5c/d67/f142 0 2024-04-25T23:01:10.121 INFO:tasks.workunit.client.0.smithi043.stdout:8/661: write d3/d4/d7c/d92/fa4 [723915,45715] 0 2024-04-25T23:01:10.121 INFO:tasks.workunit.client.0.smithi043.stdout:1/884: mknod d0/d86/daa/c141 0 2024-04-25T23:01:10.122 INFO:tasks.workunit.client.0.smithi043.stdout:4/920: readlink d3/d37/l2d 0 2024-04-25T23:01:10.122 INFO:tasks.workunit.client.0.smithi043.stdout:3/948: creat d7/d26/d88/d121/f14c x:0 0 0 2024-04-25T23:01:10.122 INFO:tasks.workunit.client.0.smithi043.stdout:2/797: symlink d2/d66/d85/d43/d5d/dee/l10d 0 2024-04-25T23:01:10.123 INFO:tasks.workunit.client.0.smithi043.stdout:1/885: readlink d0/d86/d10d/d117/d4f/lfb 0 2024-04-25T23:01:10.123 INFO:tasks.workunit.client.0.smithi043.stdout:7/965: dread d3/f7b [0,4194304] 0 2024-04-25T23:01:10.123 INFO:tasks.workunit.client.0.smithi043.stdout:9/913: mkdir d8/de/d44/d5d/d4f/d110/d11f/d139 0 2024-04-25T23:01:10.123 INFO:tasks.workunit.client.0.smithi043.stdout:4/921: symlink d3/d21/d120/l143 0 2024-04-25T23:01:10.123 INFO:tasks.workunit.client.0.smithi043.stdout:5/865: link d0/d2c/d39/d1c/d25/d7a/d41/l8d d0/d2c/d39/d1c/d25/d7a/d2d/d8b/l11a 0 2024-04-25T23:01:10.124 INFO:tasks.workunit.client.0.smithi043.stdout:8/662: creat d3/d4/db/d4e/d5c/d59/d61/d97/dcd/fdd x:0 0 0 2024-04-25T23:01:10.124 INFO:tasks.workunit.client.0.smithi043.stdout:2/798: symlink d2/d66/d85/d76/d97/d77/da2/db7/l10e 0 2024-04-25T23:01:10.125 INFO:tasks.workunit.client.0.smithi043.stdout:1/886: creat d0/d86/d10d/d117/d4f/f142 x:0 0 0 2024-04-25T23:01:10.125 INFO:tasks.workunit.client.0.smithi043.stdout:4/922: dread - d3/d19/d34/d76/d102/f139 zero size 2024-04-25T23:01:10.126 INFO:tasks.workunit.client.0.smithi043.stdout:7/966: creat d3/d1e/d1f/d6b/f138 x:0 0 0 2024-04-25T23:01:10.127 INFO:tasks.workunit.client.0.smithi043.stdout:8/663: creat d3/d4/d36/fde x:0 0 0 2024-04-25T23:01:10.127 INFO:tasks.workunit.client.0.smithi043.stdout:6/823: dread d1/d5/d3b/d62/f73 [0,4194304] 0 2024-04-25T23:01:10.127 INFO:tasks.workunit.client.0.smithi043.stdout:3/949: rename d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/d10b to d7/d26/d2d/dce/d13b/d7c/db2/d52/d14d 0 2024-04-25T23:01:10.127 INFO:tasks.workunit.client.0.smithi043.stdout:4/923: mknod d3/de/d46/d6a/d8f/d8e/db5/dda/c144 0 2024-04-25T23:01:10.128 INFO:tasks.workunit.client.0.smithi043.stdout:8/664: chown d3/d4/db/d14/d56/lae 4 1 2024-04-25T23:01:10.128 INFO:tasks.workunit.client.0.smithi043.stdout:6/824: readlink d1/d5/d3b/d4c/d21/d55/d68/d30/l40 0 2024-04-25T23:01:10.128 INFO:tasks.workunit.client.0.smithi043.stdout:7/967: mkdir d3/da/d78/dd4/d139 0 2024-04-25T23:01:10.128 INFO:tasks.workunit.client.0.smithi043.stdout:0/823: dread d1b/f4a [0,4194304] 0 2024-04-25T23:01:10.129 INFO:tasks.workunit.client.0.smithi043.stdout:1/887: write d0/d3c/ffc [576801,33930] 0 2024-04-25T23:01:10.129 INFO:tasks.workunit.client.0.smithi043.stdout:4/924: creat d3/de/d27/d5c/f145 x:0 0 0 2024-04-25T23:01:10.129 INFO:tasks.workunit.client.0.smithi043.stdout:6/825: fsync d1/d5/d3b/d4c/f58 0 2024-04-25T23:01:10.130 INFO:tasks.workunit.client.0.smithi043.stdout:5/866: rename d0/d6a/fb4 to d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d102/f11b 0 2024-04-25T23:01:10.130 INFO:tasks.workunit.client.0.smithi043.stdout:4/925: chown d3/de/f13 13756 1 2024-04-25T23:01:10.130 INFO:tasks.workunit.client.0.smithi043.stdout:7/968: chown d3/da/df/d11/d8d/d9f/fe8 2271 1 2024-04-25T23:01:10.131 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:10.131 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:10.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.131 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4556.0:14639 4.16 e55/17 4:6a97a210:::100000037e1.00000000:head v 55'208, mlcod=55'206)", 2024-04-25T23:01:10.131 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:10.130550+0000", 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.000330272, 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035345500000000002, 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130550+0000", 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130550+0000", 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130551+0000", 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4600000000000003e-07 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130585+0000", 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3603000000000003e-05 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130594+0000", 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2119999999999992e-06 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130599+0000", 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9840000000000001e-06 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130655+0000", 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5451000000000002e-05 2024-04-25T23:01:10.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130679+0000", 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4465999999999999e-05 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:2524 4.1a 4:585586a2:::10000003271.00000000:head [trimtrunc 2@3325716] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:10.129441+0000", 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0014398169999999999, 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015445999999999999, 2024-04-25T23:01:10.135 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129441+0000", 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129441+0000", 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129442+0000", 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-07 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129445+0000", 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1990000000000002e-06 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129453+0000", 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4710000000000007e-06 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129458+0000", 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1440000000000002e-06 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129503+0000", 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4654999999999999e-05 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129558+0000", 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4805999999999997e-05 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.129639+0000", 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1426000000000003e-05 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:10.130915+0000", 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001276038 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 2 2024-04-25T23:01:10.139 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:10.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/665: getdents d3/d4/db/d4e/d5c/d2e/d5e 0 2024-04-25T23:01:10.141 INFO:tasks.workunit.client.0.smithi043.stdout:4/926: stat d3/c33 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:0/824: creat d1b/d23/d91/ddd/f109 x:0 0 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/888: mknod d0/d2f/d4b/da6/c143 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/826: rename d1/d5/d3b/d4c/d21/d55/l92 to d1/d2a/db5/l114 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:9/914: dwrite d8/de/d44/d47/d6a/f127 [0,4194304] 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/889: mkdir d0/d2f/d11a/d144 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/799: write d2/d66/d85/d43/d67/db3/d13/f32 [5088825,29860] 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/827: stat d1/d5/d3b/d4c/d21/d38/d99 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:7/969: truncate d3/d1e/d1f/d6b/d72/f97 1641296 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/890: symlink d0/d16/d135/l145 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:5/867: dread - d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/fb0 zero size 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:7/970: chown d3/da/df/d11/d8d/d123/f120 17307 1 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/800: creat d2/d66/d85/d76/d97/d77/da2/db7/f10f x:0 0 0 2024-04-25T23:01:10.142 INFO:tasks.workunit.client.0.smithi043.stdout:8/666: link d3/d4/db/d14/cb2 d3/d4/db/d14/cdf 0 2024-04-25T23:01:10.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/891: write d0/d16/d5a/d5b/f10f [129890,94288] 0 2024-04-25T23:01:10.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/971: write d3/d1e/fb8 [208609,92393] 0 2024-04-25T23:01:10.143 INFO:tasks.workunit.client.0.smithi043.stdout:2/801: rmdir d2/d66/d85/d76/d97/d77/da2/db7 39 2024-04-25T23:01:10.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/972: fdatasync d3/da/d64/fa3 0 2024-04-25T23:01:10.143 INFO:tasks.workunit.client.0.smithi043.stdout:3/950: dread d7/d26/d27/d34/d1a/f50 [0,4194304] 0 2024-04-25T23:01:10.144 INFO:tasks.workunit.client.0.smithi043.stdout:7/973: stat d3/d9b/l129 0 2024-04-25T23:01:10.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/927: dwrite d3/de/d46/d95/f13b [0,4194304] 0 2024-04-25T23:01:10.144 INFO:tasks.workunit.client.0.smithi043.stdout:1/892: truncate d0/d2f/d4b/d8f/ffd 559246 0 2024-04-25T23:01:10.145 INFO:tasks.workunit.client.0.smithi043.stdout:0/825: dwrite d1b/d31/f81 [0,4194304] 0 2024-04-25T23:01:10.145 INFO:tasks.workunit.client.0.smithi043.stdout:8/667: getdents d3/d4/db/d14 0 2024-04-25T23:01:10.145 INFO:tasks.workunit.client.0.smithi043.stdout:3/951: mkdir d7/d26/d88/d14e 0 2024-04-25T23:01:10.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/802: mkdir d2/d66/d85/d43/d67/db3/d110 0 2024-04-25T23:01:10.148 INFO:tasks.workunit.client.0.smithi043.stdout:6/828: dwrite d1/d5/d3b/d4c/d21/d55/d68/d7f/fdd [0,4194304] 0 2024-04-25T23:01:10.148 INFO:tasks.workunit.client.0.smithi043.stdout:1/893: write d0/d86/f12d [632904,56714] 0 2024-04-25T23:01:10.148 INFO:tasks.workunit.client.0.smithi043.stdout:1/894: chown d0/d2f/d4b/l9d 128 1 2024-04-25T23:01:10.149 INFO:tasks.workunit.client.0.smithi043.stdout:7/974: creat d3/da/d78/dd4/d127/f13a x:0 0 0 2024-04-25T23:01:10.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/952: symlink d7/d26/d88/d121/l14f 0 2024-04-25T23:01:10.150 INFO:tasks.workunit.client.0.smithi043.stdout:1/895: mknod d0/d9/d63/d12e/c146 0 2024-04-25T23:01:10.151 INFO:tasks.workunit.client.0.smithi043.stdout:0/826: symlink d1b/d23/d7a/l10a 0 2024-04-25T23:01:10.151 INFO:tasks.workunit.client.0.smithi043.stdout:8/668: link d3/d4/d7c/d92/d62/d6e/f74 d3/d4/db/d4e/d5c/d59/fe0 0 2024-04-25T23:01:10.151 INFO:tasks.workunit.client.0.smithi043.stdout:2/803: chown d2/d66/d85/d76/d97/d77/da2/db7/f10f 57 1 2024-04-25T23:01:10.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:10.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/975: creat d3/d1e/d1f/d6b/d72/f13b x:0 0 0 2024-04-25T23:01:10.152 INFO:tasks.workunit.client.0.smithi043.stdout:3/953: rename d7/d26/d88/db8/d101 to d7/d26/d27/d150 0 2024-04-25T23:01:10.153 INFO:tasks.workunit.client.0.smithi043.stdout:5/868: truncate d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ff1 659819 0 2024-04-25T23:01:10.153 INFO:tasks.workunit.client.0.smithi043.stdout:2/804: write d2/fc [721609,79820] 0 2024-04-25T23:01:10.154 INFO:tasks.workunit.client.0.smithi043.stdout:3/954: readlink d7/dac/l12e 0 2024-04-25T23:01:10.154 INFO:tasks.workunit.client.0.smithi043.stdout:7/976: write d3/da/df/d11/d8d/d9f/fe8 [191254,65544] 0 2024-04-25T23:01:10.154 INFO:tasks.workunit.client.0.smithi043.stdout:8/669: fsync d3/d4/d7c/d92/d62/fa9 0 2024-04-25T23:01:10.155 INFO:tasks.workunit.client.0.smithi043.stdout:4/928: dwrite d3/de/d46/f107 [4194304,4194304] 0 2024-04-25T23:01:10.155 INFO:tasks.workunit.client.0.smithi043.stdout:0/827: read d1b/fa4 [3095654,54232] 0 2024-04-25T23:01:10.155 INFO:tasks.workunit.client.0.smithi043.stdout:1/896: link d0/d9/d63/d12e/c146 d0/d86/d10d/c147 0 2024-04-25T23:01:10.157 INFO:tasks.workunit.client.0.smithi043.stdout:8/670: chown d3/d4/db/d14/d4c/d77/c31 97153 1 2024-04-25T23:01:10.157 INFO:tasks.workunit.client.0.smithi043.stdout:6/829: dwrite d1/dc8/fd2 [0,4194304] 0 2024-04-25T23:01:10.158 INFO:tasks.workunit.client.0.smithi043.stdout:9/915: sync 2024-04-25T23:01:10.158 INFO:tasks.workunit.client.0.smithi043.stdout:6/830: fsync d1/d5/d3b/d4c/d21/d55/d6d/d96/f71 0 2024-04-25T23:01:10.160 INFO:tasks.workunit.client.0.smithi043.stdout:1/897: creat d0/d3c/f148 x:0 0 0 2024-04-25T23:01:10.160 INFO:tasks.workunit.client.0.smithi043.stdout:4/929: unlink d3/d21/d6b/d87/d8a/l9f 0 2024-04-25T23:01:10.160 INFO:tasks.workunit.client.0.smithi043.stdout:8/671: creat d3/d4/d6d/fe1 x:0 0 0 2024-04-25T23:01:10.161 INFO:tasks.workunit.client.0.smithi043.stdout:1/898: write d0/d86/d10d/d117/d4f/f115 [641844,61249] 0 2024-04-25T23:01:10.161 INFO:tasks.workunit.client.0.smithi043.stdout:8/672: fdatasync d3/d4/db/d14/d56/d5d/d9c/da7/fb6 0 2024-04-25T23:01:10.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/673: stat d3/d4/db/d14/d4c/d68/l6c 0 2024-04-25T23:01:10.162 INFO:tasks.workunit.client.0.smithi043.stdout:2/805: creat d2/d66/d85/d43/d67/d8d/f111 x:0 0 0 2024-04-25T23:01:10.163 INFO:tasks.workunit.client.0.smithi043.stdout:5/869: creat d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f11c x:0 0 0 2024-04-25T23:01:10.163 INFO:tasks.workunit.client.0.smithi043.stdout:4/930: mknod d3/de/d46/d6a/d8f/d8e/c146 0 2024-04-25T23:01:10.163 INFO:tasks.workunit.client.0.smithi043.stdout:1/899: creat d0/d86/d10b/f149 x:0 0 0 2024-04-25T23:01:10.164 INFO:tasks.workunit.client.0.smithi043.stdout:4/931: read - d3/d21/d6b/d87/d8a/fe0 zero size 2024-04-25T23:01:10.165 INFO:tasks.workunit.client.0.smithi043.stdout:5/870: chown d0/d2c/d39/d1c/d25/d7a/d2d/f74 94122 1 2024-04-25T23:01:10.165 INFO:tasks.workunit.client.0.smithi043.stdout:2/806: creat d2/d66/d85/d43/d5d/da9/dd7/db9/f112 x:0 0 0 2024-04-25T23:01:10.165 INFO:tasks.workunit.client.0.smithi043.stdout:9/916: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fd5 [0,4194304] 0 2024-04-25T23:01:10.167 INFO:tasks.workunit.client.0.smithi043.stdout:8/674: rename d3/d4/db/d4e/d8b/d9f/d33/cc2 to d3/d4/db/d4e/d5c/d59/d61/d66/ce2 0 2024-04-25T23:01:10.169 INFO:tasks.workunit.client.0.smithi043.stdout:2/807: unlink d2/d66/d85/d43/d67/f86 0 2024-04-25T23:01:10.169 INFO:tasks.workunit.client.0.smithi043.stdout:7/977: write d3/d1e/d1f/f5f [12313,36088] 0 2024-04-25T23:01:10.170 INFO:tasks.workunit.client.0.smithi043.stdout:0/828: truncate d1b/d23/d39/f46 1043654 0 2024-04-25T23:01:10.170 INFO:tasks.workunit.client.0.smithi043.stdout:5/871: mknod d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2/def/c11d 0 2024-04-25T23:01:10.173 INFO:tasks.workunit.client.0.smithi043.stdout:1/900: dwrite d0/d2f/d4b/d8f/fe1 [0,4194304] 0 2024-04-25T23:01:10.173 INFO:tasks.workunit.client.0.smithi043.stdout:0/829: write d1b/d31/db1/fca [593443,109699] 0 2024-04-25T23:01:10.173 INFO:tasks.workunit.client.0.smithi043.stdout:2/808: write d2/d66/d85/d43/d67/d10c/ffb [188350,13522] 0 2024-04-25T23:01:10.176 INFO:tasks.workunit.client.0.smithi043.stdout:8/675: link d3/d4/d98/fdb d3/d4/db/d14/fe3 0 2024-04-25T23:01:10.176 INFO:tasks.workunit.client.0.smithi043.stdout:7/978: mknod d3/da/df/d11/d8d/dba/d133/c13c 0 2024-04-25T23:01:10.176 INFO:tasks.workunit.client.0.smithi043.stdout:6/831: dwrite d1/d5/d3b/d4c/d21/f24 [4194304,4194304] 0 2024-04-25T23:01:10.176 INFO:tasks.workunit.client.0.smithi043.stdout:0/830: creat d1b/d23/d91/f10b x:0 0 0 2024-04-25T23:01:10.176 INFO:tasks.workunit.client.0.smithi043.stdout:9/917: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fbd [0,4194304] 0 2024-04-25T23:01:10.176 INFO:tasks.workunit.client.0.smithi043.stdout:1/901: mknod d0/d16/df7/dbf/c14a 0 2024-04-25T23:01:10.177 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:10.174+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:10.177 INFO:tasks.workunit.client.0.smithi043.stdout:1/902: readlink d0/d9/dc0/lc8 0 2024-04-25T23:01:10.179 INFO:tasks.workunit.client.0.smithi043.stdout:0/831: mknod d1b/dcf/c10c 0 2024-04-25T23:01:10.179 INFO:tasks.workunit.client.0.smithi043.stdout:5/872: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f96 [833673,99626] 0 2024-04-25T23:01:10.180 INFO:tasks.workunit.client.0.smithi043.stdout:9/918: mknod d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/c13a 0 2024-04-25T23:01:10.180 INFO:tasks.workunit.client.0.smithi043.stdout:7/979: getdents d3/da/df/d11/d8d/d9f/d124 0 2024-04-25T23:01:10.180 INFO:tasks.workunit.client.0.smithi043.stdout:8/676: truncate d3/d4/d7c/d92/fd8 4676828 0 2024-04-25T23:01:10.181 INFO:tasks.workunit.client.0.smithi043.stdout:6/832: rename d1/d5/d3b/d4c/d21/d55/d68/l100 to d1/d5/d3b/d4c/d21/d55/da2/ddb/l115 0 2024-04-25T23:01:10.181 INFO:tasks.workunit.client.0.smithi043.stdout:7/980: mknod d3/da/df/d11/d8d/dba/c13d 0 2024-04-25T23:01:10.182 INFO:tasks.workunit.client.0.smithi043.stdout:6/833: rmdir d1/d2a/db5 39 2024-04-25T23:01:10.183 INFO:tasks.workunit.client.0.smithi043.stdout:9/919: fsync d8/de/d12/d16/f1f 0 2024-04-25T23:01:10.183 INFO:tasks.workunit.client.0.smithi043.stdout:6/834: creat d1/d2a/dd5/f116 x:0 0 0 2024-04-25T23:01:10.184 INFO:tasks.workunit.client.0.smithi043.stdout:9/920: write d8/de/d44/d65/d103/f133 [489719,36638] 0 2024-04-25T23:01:10.184 INFO:tasks.workunit.client.0.smithi043.stdout:2/809: dwrite d2/d66/d85/d43/d67/d8d/fcc [0,4194304] 0 2024-04-25T23:01:10.185 INFO:tasks.workunit.client.0.smithi043.stdout:0/832: write d1b/d8b/fc4 [1221383,58575] 0 2024-04-25T23:01:10.187 INFO:tasks.workunit.client.0.smithi043.stdout:6/835: rename d1/d5/d3b/fda to d1/d5/d3b/d4c/d21/d38/de6/d107/f117 0 2024-04-25T23:01:10.188 INFO:tasks.workunit.client.0.smithi043.stdout:9/921: creat d8/de/d44/deb/f13b x:0 0 0 2024-04-25T23:01:10.188 INFO:tasks.workunit.client.0.smithi043.stdout:2/810: mkdir d2/d66/d85/d76/d97/d77/da2/db7/dbf/d113 0 2024-04-25T23:01:10.190 INFO:tasks.workunit.client.0.smithi043.stdout:5/873: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fd7 [0,4194304] 0 2024-04-25T23:01:10.191 INFO:tasks.workunit.client.0.smithi043.stdout:7/981: dwrite d3/d9b/f66 [4194304,4194304] 0 2024-04-25T23:01:10.193 INFO:tasks.workunit.client.0.smithi043.stdout:5/874: mknod d0/d22/d95/ded/c11e 0 2024-04-25T23:01:10.193 INFO:tasks.workunit.client.0.smithi043.stdout:7/982: rmdir d3/da 39 2024-04-25T23:01:10.194 INFO:tasks.workunit.client.0.smithi043.stdout:7/983: truncate d3/d1e/f47 1793261 0 2024-04-25T23:01:10.195 INFO:tasks.workunit.client.0.smithi043.stdout:2/811: dwrite d2/f98 [4194304,4194304] 0 2024-04-25T23:01:10.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/812: unlink d2/fb0 0 2024-04-25T23:01:10.199 INFO:tasks.workunit.client.0.smithi043.stdout:6/836: truncate d1/d5/f7 2827315 0 2024-04-25T23:01:10.199 INFO:tasks.workunit.client.0.smithi043.stdout:2/813: getdents d2/d66/d85/d43/d5d/da9/dd7/db9/dff 0 2024-04-25T23:01:10.202 INFO:tasks.workunit.client.0.smithi043.stdout:2/814: rmdir d2/d66/d85/d43/d67 39 2024-04-25T23:01:10.203 INFO:tasks.workunit.client.0.smithi043.stdout:0/833: read d1b/d23/f3e [2697079,80695] 0 2024-04-25T23:01:10.203 INFO:tasks.workunit.client.0.smithi043.stdout:2/815: stat d2/d66/d85/d43/d67/db3/d13/fa6 0 2024-04-25T23:01:10.204 INFO:tasks.workunit.client.0.smithi043.stdout:0/834: write d1b/d8b/f85 [96393,39502] 0 2024-04-25T23:01:10.205 INFO:tasks.workunit.client.0.smithi043.stdout:2/816: read d2/d66/d85/d43/d5d/f4d [1609681,97460] 0 2024-04-25T23:01:10.205 INFO:tasks.workunit.client.0.smithi043.stdout:0/835: fsync d1b/db0/fc5 0 2024-04-25T23:01:10.205 INFO:tasks.workunit.client.0.smithi043.stdout:2/817: dread - d2/d66/d85/d76/d97/d77/da2/ffa zero size 2024-04-25T23:01:10.206 INFO:tasks.workunit.client.0.smithi043.stdout:0/836: dread - d1b/d8b/d103/fff zero size 2024-04-25T23:01:10.207 INFO:tasks.workunit.client.0.smithi043.stdout:2/818: dread - d2/d66/d85/d76/d97/d77/da2/db7/f10f zero size 2024-04-25T23:01:10.208 INFO:tasks.workunit.client.0.smithi043.stdout:3/955: dread d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/faa [0,4194304] 0 2024-04-25T23:01:10.209 INFO:tasks.workunit.client.0.smithi043.stdout:2/819: creat d2/d66/d85/d43/d67/ddd/f114 x:0 0 0 2024-04-25T23:01:10.209 INFO:tasks.workunit.client.0.smithi043.stdout:1/903: dread d0/d2f/fb0 [0,4194304] 0 2024-04-25T23:01:10.209 INFO:tasks.workunit.client.0.smithi043.stdout:3/956: rmdir d7/d26/d13f 0 2024-04-25T23:01:10.210 INFO:tasks.workunit.client.0.smithi043.stdout:2/820: readlink d2/d66/d85/d43/d5d/da9/dd7/db9/lcf 0 2024-04-25T23:01:10.210 INFO:tasks.workunit.client.0.smithi043.stdout:3/957: getdents d7/dac 0 2024-04-25T23:01:10.211 INFO:tasks.workunit.client.0.smithi043.stdout:2/821: mkdir d2/d66/d85/d76/d97/d77/d115 0 2024-04-25T23:01:10.211 INFO:tasks.workunit.client.0.smithi043.stdout:5/875: dread d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/d119/fdc [0,4194304] 0 2024-04-25T23:01:10.212 INFO:tasks.workunit.client.0.smithi043.stdout:3/958: chown d7/d26/d2d/dce/d13b/d7c/db2/d87/l100 59 1 2024-04-25T23:01:10.212 INFO:tasks.workunit.client.0.smithi043.stdout:2/822: creat d2/d66/d85/d43/d67/d10c/f116 x:0 0 0 2024-04-25T23:01:10.212 INFO:tasks.workunit.client.0.smithi043.stdout:8/677: dread d3/d4/d36/f64 [0,4194304] 0 2024-04-25T23:01:10.214 INFO:tasks.workunit.client.0.smithi043.stdout:8/678: truncate d3/d4/f25 3300507 0 2024-04-25T23:01:10.214 INFO:tasks.workunit.client.0.smithi043.stdout:5/876: read d0/f17 [3576177,45712] 0 2024-04-25T23:01:10.215 INFO:tasks.workunit.client.0.smithi043.stdout:8/679: truncate d3/d4/d36/f76 1389140 0 2024-04-25T23:01:10.216 INFO:tasks.workunit.client.0.smithi043.stdout:4/932: dread d3/d21/da5/fba [0,4194304] 0 2024-04-25T23:01:10.217 INFO:tasks.workunit.client.0.smithi043.stdout:6/837: write d1/d5/f1b [448670,72259] 0 2024-04-25T23:01:10.217 INFO:tasks.workunit.client.0.smithi043.stdout:1/904: truncate d0/d86/fb7 1896390 0 2024-04-25T23:01:10.218 INFO:tasks.workunit.client.0.smithi043.stdout:4/933: stat d3/db6/f119 0 2024-04-25T23:01:10.218 INFO:tasks.workunit.client.0.smithi043.stdout:2/823: truncate d2/fac 2179285 0 2024-04-25T23:01:10.218 INFO:tasks.workunit.client.0.smithi043.stdout:9/922: dread d8/fd [0,4194304] 0 2024-04-25T23:01:10.219 INFO:tasks.workunit.client.0.smithi043.stdout:8/680: creat d3/d4/db/d4e/d5c/fe4 x:0 0 0 2024-04-25T23:01:10.220 INFO:tasks.workunit.client.0.smithi043.stdout:3/959: dwrite d7/d26/d2d/dce/d13b/f129 [0,4194304] 0 2024-04-25T23:01:10.222 INFO:tasks.workunit.client.0.smithi043.stdout:9/923: rmdir d8/de/d44/d65 39 2024-04-25T23:01:10.222 INFO:tasks.workunit.client.0.smithi043.stdout:0/837: dwrite f1a [4194304,4194304] 0 2024-04-25T23:01:10.223 INFO:tasks.workunit.client.0.smithi043.stdout:5/877: truncate d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d102/f11b 636737 0 2024-04-25T23:01:10.223 INFO:tasks.workunit.client.0.smithi043.stdout:9/924: write d8/de/f78 [7260171,34448] 0 2024-04-25T23:01:10.224 INFO:tasks.workunit.client.0.smithi043.stdout:0/838: mkdir d1b/db0/d10d 0 2024-04-25T23:01:10.224 INFO:tasks.workunit.client.0.smithi043.stdout:3/960: symlink d7/d26/d27/d34/d1a/d40/d8f/d122/l151 0 2024-04-25T23:01:10.224 INFO:tasks.workunit.client.0.smithi043.stdout:8/681: getdents d3/d4/d6d 0 2024-04-25T23:01:10.225 INFO:tasks.workunit.client.0.smithi043.stdout:7/984: sync 2024-04-25T23:01:10.225 INFO:tasks.workunit.client.0.smithi043.stdout:1/905: sync 2024-04-25T23:01:10.225 INFO:tasks.workunit.client.0.smithi043.stdout:8/682: rmdir d3/d4 39 2024-04-25T23:01:10.226 INFO:tasks.workunit.client.0.smithi043.stdout:0/839: write d1b/d23/d39/f44 [2826351,30867] 0 2024-04-25T23:01:10.226 INFO:tasks.workunit.client.0.smithi043.stdout:5/878: link d0/d2c/d39/d1c/d25/d7a/d41/l8d d0/d22/l11f 0 2024-04-25T23:01:10.226 INFO:tasks.workunit.client.0.smithi043.stdout:3/961: chown d7/d26/d2d/dce/d13b/d7c/db2/d87/ced 22456 1 2024-04-25T23:01:10.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/840: fdatasync d1b/d23/dab/dbd/dcc/ff2 0 2024-04-25T23:01:10.228 INFO:tasks.workunit.client.0.smithi043.stdout:5/879: stat d0/d2c/d39/d1c/d25/d7a/d41/f86 0 2024-04-25T23:01:10.228 INFO:tasks.workunit.client.0.smithi043.stdout:3/962: truncate d7/f20 370868 0 2024-04-25T23:01:10.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/683: rename d3/d4/db/d14/d4c/d68/l6c to d3/d4/d7c/le5 0 2024-04-25T23:01:10.230 INFO:tasks.workunit.client.0.smithi043.stdout:5/880: chown d0/d2c/d39/d1c/d25/d4e/l111 120 1 2024-04-25T23:01:10.230 INFO:tasks.workunit.client.0.smithi043.stdout:2/824: dwrite d2/d66/d85/d43/f8a [4194304,4194304] 0 2024-04-25T23:01:10.230 INFO:tasks.workunit.client.0.smithi043.stdout:0/841: read d1b/d31/fb5 [39841,49546] 0 2024-04-25T23:01:10.231 INFO:tasks.workunit.client.0.smithi043.stdout:0/842: write f3 [3621473,128505] 0 2024-04-25T23:01:10.232 INFO:tasks.workunit.client.0.smithi043.stdout:0/843: rmdir d1b 39 2024-04-25T23:01:10.232 INFO:tasks.workunit.client.0.smithi043.stdout:5/881: fdatasync d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62/fd6 0 2024-04-25T23:01:10.232 INFO:tasks.workunit.client.0.smithi043.stdout:2/825: chown d2/d66/d85/d43/d5d/da9/dd7/db9/f112 74792198 1 2024-04-25T23:01:10.232 INFO:tasks.workunit.client.0.smithi043.stdout:0/844: readlink d1b/d31/d3c/d50/l51 0 2024-04-25T23:01:10.234 INFO:tasks.workunit.client.0.smithi043.stdout:2/826: chown d2/d66/d85/d43/d5d/da9/cc1 1 1 2024-04-25T23:01:10.234 INFO:tasks.workunit.client.0.smithi043.stdout:5/882: write d0/d2c/d39/d1c/d25/d7a/d41/d4a/d78/f82 [540441,24582] 0 2024-04-25T23:01:10.234 INFO:tasks.workunit.client.0.smithi043.stdout:1/906: truncate d0/d2f/d4b/d8f/fe1 2426191 0 2024-04-25T23:01:10.235 INFO:tasks.workunit.client.0.smithi043.stdout:0/845: truncate d1b/d23/d7a/f98 4409208 0 2024-04-25T23:01:10.237 INFO:tasks.workunit.client.0.smithi043.stdout:3/963: dwrite d7/d26/d88/db0/f105 [0,4194304] 0 2024-04-25T23:01:10.237 INFO:tasks.workunit.client.0.smithi043.stdout:0/846: read d1b/d55/f6d [15240,38512] 0 2024-04-25T23:01:10.238 INFO:tasks.workunit.client.0.smithi043.stdout:2/827: rename d2/d66/d85/d43/d5d/da9/dd7/lb4 to d2/d66/d85/d43/d5d/da9/dd7/da3/l117 0 2024-04-25T23:01:10.238 INFO:tasks.workunit.client.0.smithi043.stdout:3/964: symlink d7/dac/l152 0 2024-04-25T23:01:10.238 INFO:tasks.workunit.client.0.smithi043.stdout:8/684: dwrite d3/d4/db/d4e/d8b/d9f/f65 [0,4194304] 0 2024-04-25T23:01:10.240 INFO:tasks.workunit.client.0.smithi043.stdout:2/828: fsync d2/d66/d85/d43/d67/d10c/fec 0 2024-04-25T23:01:10.240 INFO:tasks.workunit.client.0.smithi043.stdout:7/985: truncate d3/da/df/d11/d8d/f113 42308 0 2024-04-25T23:01:10.242 INFO:tasks.workunit.client.0.smithi043.stdout:2/829: symlink d2/d66/d85/d43/d5d/da9/l118 0 2024-04-25T23:01:10.242 INFO:tasks.workunit.client.0.smithi043.stdout:3/965: creat d7/d26/d27/d34/d1a/d40/d8f/d51/f153 x:0 0 0 2024-04-25T23:01:10.242 INFO:tasks.workunit.client.0.smithi043.stdout:7/986: creat d3/d1e/d1f/dc5/d99/d137/f13e x:0 0 0 2024-04-25T23:01:10.243 INFO:tasks.workunit.client.0.smithi043.stdout:0/847: link d1b/d23/d39/d90/df4/f63 d1b/d23/d7b/da6/f10e 0 2024-04-25T23:01:10.243 INFO:tasks.workunit.client.0.smithi043.stdout:2/830: fsync d2/f98 0 2024-04-25T23:01:10.244 INFO:tasks.workunit.client.0.smithi043.stdout:8/685: rename d3/d4/d6d/fe1 to d3/d4/db/d14/d56/d5d/d9c/da7/fe6 0 2024-04-25T23:01:10.244 INFO:tasks.workunit.client.0.smithi043.stdout:7/987: readlink d3/da/df/d11/l14 0 2024-04-25T23:01:10.244 INFO:tasks.workunit.client.0.smithi043.stdout:5/883: dwrite d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/fb0 [0,4194304] 0 2024-04-25T23:01:10.245 INFO:tasks.workunit.client.0.smithi043.stdout:0/848: dread - d1b/db0/f107 zero size 2024-04-25T23:01:10.245 INFO:tasks.workunit.client.0.smithi043.stdout:9/925: sync 2024-04-25T23:01:10.245 INFO:tasks.workunit.client.0.smithi043.stdout:0/849: write d1b/d31/db1/fca [1561887,18004] 0 2024-04-25T23:01:10.247 INFO:tasks.workunit.client.0.smithi043.stdout:2/831: creat d2/d66/d85/d43/d67/d8d/f119 x:0 0 0 2024-04-25T23:01:10.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/686: rename d3/d4/db/d4e/d8b/d9f/d33/db0/ld4 to d3/d4/d7c/d92/d62/le7 0 2024-04-25T23:01:10.247 INFO:tasks.workunit.client.0.smithi043.stdout:7/988: write d3/d52/fb2 [148720,33241] 0 2024-04-25T23:01:10.248 INFO:tasks.workunit.client.0.smithi043.stdout:7/989: chown d3/da/df/fe4 14 1 2024-04-25T23:01:10.248 INFO:tasks.workunit.client.0.smithi043.stdout:5/884: truncate d0/d2c/d39/d1c/d5e/ffc 4441008 0 2024-04-25T23:01:10.249 INFO:tasks.workunit.client.0.smithi043.stdout:8/687: unlink d3/d4/db/d4e/d8b/d9f/d33/l39 0 2024-04-25T23:01:10.249 INFO:tasks.workunit.client.0.smithi043.stdout:7/990: mknod d3/d1e/d1f/dc5/d99/c13f 0 2024-04-25T23:01:10.250 INFO:tasks.workunit.client.0.smithi043.stdout:2/832: rename d2/d66/d85/d43/d5d/da9/dd7/da3/cf1 to d2/d66/d85/d43/d67/db3/d13/d40/c11a 0 2024-04-25T23:01:10.251 INFO:tasks.workunit.client.0.smithi043.stdout:7/991: write d3/d9b/f7a [41276,92066] 0 2024-04-25T23:01:10.251 INFO:tasks.workunit.client.0.smithi043.stdout:3/966: dwrite d7/d26/d27/d34/d1a/d40/d8f/d51/de1/fee [0,4194304] 0 2024-04-25T23:01:10.251 INFO:tasks.workunit.client.0.smithi043.stdout:8/688: creat d3/d4/db/d4e/d5c/d59/d61/d97/fe8 x:0 0 0 2024-04-25T23:01:10.252 INFO:tasks.workunit.client.0.smithi043.stdout:2/833: symlink d2/d66/d85/d43/d67/db3/d13/d40/l11b 0 2024-04-25T23:01:10.252 INFO:tasks.workunit.client.0.smithi043.stdout:3/967: dread - d7/d26/d2d/f99 zero size 2024-04-25T23:01:10.253 INFO:tasks.workunit.client.0.smithi043.stdout:2/834: creat d2/d66/dc6/f11c x:0 0 0 2024-04-25T23:01:10.254 INFO:tasks.workunit.client.0.smithi043.stdout:8/689: mknod d3/d4/db/d4e/d5c/d59/d61/d97/dc3/ce9 0 2024-04-25T23:01:10.254 INFO:tasks.workunit.client.0.smithi043.stdout:2/835: fdatasync d2/fac 0 2024-04-25T23:01:10.256 INFO:tasks.workunit.client.0.smithi043.stdout:8/690: mkdir d3/d4/db/d14/da5/dea 0 2024-04-25T23:01:10.256 INFO:tasks.workunit.client.0.smithi043.stdout:2/836: readlink d2/d66/d85/d76/d97/d77/l93 0 2024-04-25T23:01:10.256 INFO:tasks.workunit.client.0.smithi043.stdout:9/926: dread d8/de/d12/d16/d24/dbe/dc6/d2f/dad/ff9 [0,4194304] 0 2024-04-25T23:01:10.256 INFO:tasks.workunit.client.0.smithi043.stdout:4/934: dread d3/d21/d6b/d87/d9a/ff7 [4194304,4194304] 0 2024-04-25T23:01:10.256 INFO:tasks.workunit.client.0.smithi043.stdout:2/837: mkdir d2/d66/d85/d43/d11d 0 2024-04-25T23:01:10.257 INFO:tasks.workunit.client.0.smithi043.stdout:2/838: write d2/d66/d85/d43/d67/ddd/f114 [748652,54502] 0 2024-04-25T23:01:10.258 INFO:tasks.workunit.client.0.smithi043.stdout:8/691: write d3/d4/d7c/f9e [3207096,60186] 0 2024-04-25T23:01:10.259 INFO:tasks.workunit.client.0.smithi043.stdout:9/927: link d8/de/d44/d65/c102 d8/de/d12/d7a/c13c 0 2024-04-25T23:01:10.259 INFO:tasks.workunit.client.0.smithi043.stdout:2/839: write d2/d66/d85/d43/d67/db3/d13/d40/f7b [393931,96954] 0 2024-04-25T23:01:10.259 INFO:tasks.workunit.client.0.smithi043.stdout:9/928: readlink d8/de/d44/d65/ldf 0 2024-04-25T23:01:10.260 INFO:tasks.workunit.client.0.smithi043.stdout:8/692: write d3/d4/db/d14/d4c/d68/f9b [923313,6912] 0 2024-04-25T23:01:10.261 INFO:tasks.workunit.client.0.smithi043.stdout:9/929: symlink d8/de/d12/d16/d24/dbe/d10d/l13d 0 2024-04-25T23:01:10.261 INFO:tasks.workunit.client.0.smithi043.stdout:2/840: mkdir d2/d66/d85/d43/d5d/da9/dd7/db9/dff/d11e 0 2024-04-25T23:01:10.261 INFO:tasks.workunit.client.0.smithi043.stdout:2/841: sync 2024-04-25T23:01:10.261 INFO:tasks.workunit.client.0.smithi043.stdout:8/693: creat d3/d4/db/d4e/d8b/d9f/d33/db0/feb x:0 0 0 2024-04-25T23:01:10.261 INFO:tasks.workunit.client.0.smithi043.stdout:1/907: truncate d0/d86/fb6 1838451 0 2024-04-25T23:01:10.262 INFO:tasks.workunit.client.0.smithi043.stdout:9/930: getdents d8/de/d44/deb 0 2024-04-25T23:01:10.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/908: unlink d0/d86/d10d/d117/l35 0 2024-04-25T23:01:10.263 INFO:tasks.workunit.client.0.smithi043.stdout:1/909: symlink d0/d9/d63/l14b 0 2024-04-25T23:01:10.263 INFO:tasks.workunit.client.0.smithi043.stdout:8/694: link d3/d4/db/f4a d3/d4/db/d4e/d5c/d2e/d5e/fec 0 2024-04-25T23:01:10.264 INFO:tasks.workunit.client.0.smithi043.stdout:2/842: rename d2/d66/d85/d43/d67/db3/lfd to d2/d66/d85/d76/d97/d77/d115/l11f 0 2024-04-25T23:01:10.264 INFO:tasks.workunit.client.0.smithi043.stdout:1/910: fdatasync d0/d3c/f79 0 2024-04-25T23:01:10.264 INFO:tasks.workunit.client.0.smithi043.stdout:9/931: mknod d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/c13e 0 2024-04-25T23:01:10.265 INFO:tasks.workunit.client.0.smithi043.stdout:7/992: write d3/da/df/d11/d8d/d9f/ffa [4619458,125880] 0 2024-04-25T23:01:10.265 INFO:tasks.workunit.client.0.smithi043.stdout:8/695: truncate d3/d4/d98/fdb 495671 0 2024-04-25T23:01:10.265 INFO:tasks.workunit.client.0.smithi043.stdout:1/911: creat d0/d86/f14c x:0 0 0 2024-04-25T23:01:10.265 INFO:tasks.workunit.client.0.smithi043.stdout:9/932: chown d8/de/d12/d16/f1f 3 1 2024-04-25T23:01:10.266 INFO:tasks.workunit.client.0.smithi043.stdout:2/843: chown d2/d66/d85/d43/d67/db3/d13/d40/l50 937473 1 2024-04-25T23:01:10.267 INFO:tasks.workunit.client.0.smithi043.stdout:1/912: rename d0/d86/d10b/f149 to d0/d16/df7/dbf/f14d 0 2024-04-25T23:01:10.267 INFO:tasks.workunit.client.0.smithi043.stdout:2/844: write d2/d66/d85/d43/d67/db3/d13/f6e [1766864,21149] 0 2024-04-25T23:01:10.267 INFO:tasks.workunit.client.0.smithi043.stdout:9/933: read - d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3/f123 zero size 2024-04-25T23:01:10.267 INFO:tasks.workunit.client.0.smithi043.stdout:8/696: link d3/d4/ca3 d3/d4/db/d4e/d8b/d9f/ced 0 2024-04-25T23:01:10.267 INFO:tasks.workunit.client.0.smithi043.stdout:5/885: truncate d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/fb0 3374217 0 2024-04-25T23:01:10.268 INFO:tasks.workunit.client.0.smithi043.stdout:9/934: dread - d8/de/d44/d47/f10c zero size 2024-04-25T23:01:10.268 INFO:tasks.workunit.client.0.smithi043.stdout:1/913: truncate d0/d16/d5a/f6e 412455 0 2024-04-25T23:01:10.269 INFO:tasks.workunit.client.0.smithi043.stdout:5/886: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d120 0 2024-04-25T23:01:10.269 INFO:tasks.workunit.client.0.smithi043.stdout:8/697: rename d3/d4/d7c/cce to d3/d4/db/d4e/d8b/d9f/d8d/cee 0 2024-04-25T23:01:10.269 INFO:tasks.workunit.client.0.smithi043.stdout:1/914: symlink d0/d86/d10d/d117/dd7/l14e 0 2024-04-25T23:01:10.270 INFO:tasks.workunit.client.0.smithi043.stdout:8/698: mkdir d3/d4/db/def 0 2024-04-25T23:01:10.271 INFO:tasks.workunit.client.0.smithi043.stdout:1/915: write d0/d86/d10d/d117/d105/f112 [395001,96127] 0 2024-04-25T23:01:10.271 INFO:tasks.workunit.client.0.smithi043.stdout:5/887: creat d0/d2c/d39/d1c/d25/d7a/d2d/df0/df3/f121 x:0 0 0 2024-04-25T23:01:10.272 INFO:tasks.workunit.client.0.smithi043.stdout:8/699: rmdir d3/d4/db/d4e/d5c/d2e 39 2024-04-25T23:01:10.272 INFO:tasks.workunit.client.0.smithi043.stdout:5/888: unlink d0/d22/c42 0 2024-04-25T23:01:10.272 INFO:tasks.workunit.client.0.smithi043.stdout:1/916: creat d0/d9/f14f x:0 0 0 2024-04-25T23:01:10.273 INFO:tasks.workunit.client.0.smithi043.stdout:1/917: readlink d0/d9/dc0/lc8 0 2024-04-25T23:01:10.274 INFO:tasks.workunit.client.0.smithi043.stdout:4/935: fsync d3/de/d46/d6a/d8f/d8e/db5/ff5 0 2024-04-25T23:01:10.275 INFO:tasks.workunit.client.0.smithi043.stdout:8/700: creat d3/d4/db/d4e/d5c/ff0 x:0 0 0 2024-04-25T23:01:10.276 INFO:tasks.workunit.client.0.smithi043.stdout:1/918: chown d0/d9/d63/f97 490 1 2024-04-25T23:01:10.276 INFO:tasks.workunit.client.0.smithi043.stdout:5/889: write d0/d2c/d39/d1c/d25/d7a/d41/d47/f54 [4304884,79074] 0 2024-04-25T23:01:10.276 INFO:tasks.workunit.client.0.smithi043.stdout:7/993: truncate d3/d9b/d63/d98/fd1 637497 0 2024-04-25T23:01:10.276 INFO:tasks.workunit.client.0.smithi043.stdout:9/935: dwrite d8/de/d44/f45 [0,4194304] 0 2024-04-25T23:01:10.276 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:10.272+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:10.278 INFO:tasks.workunit.client.0.smithi043.stdout:7/994: dread - d3/da/df/d11/d8d/dba/f121 zero size 2024-04-25T23:01:10.278 INFO:tasks.workunit.client.0.smithi043.stdout:6/838: dread d1/f78 [0,4194304] 0 2024-04-25T23:01:10.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/919: truncate d0/d2f/d4b/d8f/ff8 340636 0 2024-04-25T23:01:10.279 INFO:tasks.workunit.client.0.smithi043.stdout:3/968: write d7/f20 [1288724,102943] 0 2024-04-25T23:01:10.279 INFO:tasks.workunit.client.0.smithi043.stdout:4/936: truncate d3/d21/f64 560936 0 2024-04-25T23:01:10.280 INFO:tasks.workunit.client.0.smithi043.stdout:8/701: creat d3/d4/db/d4e/d8b/d9f/d33/db0/ff1 x:0 0 0 2024-04-25T23:01:10.280 INFO:tasks.workunit.client.0.smithi043.stdout:0/850: dread d1b/d23/d39/d90/f92 [0,4194304] 0 2024-04-25T23:01:10.281 INFO:tasks.workunit.client.0.smithi043.stdout:0/851: chown d1b/d31/d3c 1031689 1 2024-04-25T23:01:10.281 INFO:tasks.workunit.client.0.smithi043.stdout:5/890: mknod d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2/def/c122 0 2024-04-25T23:01:10.281 INFO:tasks.workunit.client.0.smithi043.stdout:8/702: symlink d3/d4/db/d14/d4c/d77/lf2 0 2024-04-25T23:01:10.282 INFO:tasks.workunit.client.0.smithi043.stdout:1/920: truncate d0/d16/f2d 3514643 0 2024-04-25T23:01:10.283 INFO:tasks.workunit.client.0.smithi043.stdout:0/852: dread - d1b/d23/dab/dbd/dcc/ff2 zero size 2024-04-25T23:01:10.283 INFO:tasks.workunit.client.0.smithi043.stdout:6/839: creat d1/d2a/db5/dcb/f118 x:0 0 0 2024-04-25T23:01:10.283 INFO:tasks.workunit.client.0.smithi043.stdout:5/891: stat d0/d2c/d39/dc4/lc8 0 2024-04-25T23:01:10.283 INFO:tasks.workunit.client.0.smithi043.stdout:3/969: link d7/d26/d88/d121/c125 d7/d26/d27/d34/d1a/d40/d8f/d51/de1/db7/c154 0 2024-04-25T23:01:10.283 INFO:tasks.workunit.client.0.smithi043.stdout:7/995: getdents d3/da 0 2024-04-25T23:01:10.284 INFO:tasks.workunit.client.0.smithi043.stdout:8/703: fsync d3/d4/d7c/d92/d62/fcb 0 2024-04-25T23:01:10.284 INFO:tasks.workunit.client.0.smithi043.stdout:0/853: mkdir d1b/d23/dab/d10f 0 2024-04-25T23:01:10.284 INFO:tasks.workunit.client.0.smithi043.stdout:3/970: mkdir d7/d26/d155 0 2024-04-25T23:01:10.285 INFO:tasks.workunit.client.0.smithi043.stdout:0/854: readlink d1b/d23/l80 0 2024-04-25T23:01:10.285 INFO:tasks.workunit.client.0.smithi043.stdout:7/996: chown d3/da/d78/fbe 9169186 1 2024-04-25T23:01:10.285 INFO:tasks.workunit.client.0.smithi043.stdout:6/840: chown d1/d5/d3b/d4c/d21/d38/d99/fcf 2 1 2024-04-25T23:01:10.286 INFO:tasks.workunit.client.0.smithi043.stdout:0/855: unlink d1b/d23/c66 0 2024-04-25T23:01:10.286 INFO:tasks.workunit.client.0.smithi043.stdout:9/936: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f66 [0,4194304] 0 2024-04-25T23:01:10.287 INFO:tasks.workunit.client.0.smithi043.stdout:6/841: write d1/d5/d3b/d4c/d21/d55/d6d/fa1 [3940022,25100] 0 2024-04-25T23:01:10.288 INFO:tasks.workunit.client.0.smithi043.stdout:8/704: creat d3/d4/db/d4e/d5c/d59/db7/ff3 x:0 0 0 2024-04-25T23:01:10.288 INFO:tasks.workunit.client.0.smithi043.stdout:7/997: symlink d3/da/d78/dd4/l140 0 2024-04-25T23:01:10.290 INFO:tasks.workunit.client.0.smithi043.stdout:0/856: getdents d1b/d23/d91/ddd 0 2024-04-25T23:01:10.290 INFO:tasks.workunit.client.0.smithi043.stdout:1/921: dwrite d0/d2f/f61 [0,4194304] 0 2024-04-25T23:01:10.290 INFO:tasks.workunit.client.0.smithi043.stdout:6/842: fdatasync d1/d5/d3b/d4c/d21/d55/d68/f42 0 2024-04-25T23:01:10.290 INFO:tasks.workunit.client.0.smithi043.stdout:8/705: write d3/d4/db/d4e/d8b/d9f/f15 [2277995,128920] 0 2024-04-25T23:01:10.291 INFO:tasks.workunit.client.0.smithi043.stdout:8/706: dread - d3/d4/d98/fd0 zero size 2024-04-25T23:01:10.292 INFO:tasks.workunit.client.0.smithi043.stdout:4/937: read d3/d21/f64 [378961,24743] 0 2024-04-25T23:01:10.294 INFO:tasks.workunit.client.0.smithi043.stdout:7/998: symlink d3/da/df/d11/d8d/dba/l141 0 2024-04-25T23:01:10.294 INFO:tasks.workunit.client.0.smithi043.stdout:0/857: write d1b/d23/f3e [4631508,65181] 0 2024-04-25T23:01:10.295 INFO:tasks.workunit.client.0.smithi043.stdout:9/937: dwrite d8/de/d44/d47/d6a/f127 [0,4194304] 0 2024-04-25T23:01:10.296 INFO:tasks.workunit.client.0.smithi043.stdout:1/922: link d0/d9/d63/d12e/c146 d0/d16/dd1/c150 0 2024-04-25T23:01:10.296 INFO:tasks.workunit.client.0.smithi043.stdout:7/999: chown d3/da/df/d11/l14 6 1 2024-04-25T23:01:10.296 INFO:tasks.workunit.client.0.smithi043.stdout:4/938: creat d3/d37/d7a/f147 x:0 0 0 2024-04-25T23:01:10.297 INFO:tasks.workunit.client.0.smithi043.stdout:0/858: truncate d1b/d55/f8d 704129 0 2024-04-25T23:01:10.298 INFO:tasks.workunit.client.0.smithi043.stdout:4/939: mkdir d3/d148 0 2024-04-25T23:01:10.300 INFO:tasks.workunit.client.0.smithi043.stdout:1/923: write d0/d86/d10d/d117/d4f/f12a [726980,39382] 0 2024-04-25T23:01:10.300 INFO:tasks.workunit.client.0.smithi043.stdout:9/938: dread - d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/f138 zero size 2024-04-25T23:01:10.300 INFO:tasks.workunit.client.0.smithi043.stdout:4/940: dread - d3/d21/d6b/d87/d8a/f10e zero size 2024-04-25T23:01:10.301 INFO:tasks.workunit.client.0.smithi043.stdout:8/707: dwrite d3/d4/db/f2d [0,4194304] 0 2024-04-25T23:01:10.301 INFO:tasks.workunit.client.0.smithi043.stdout:6/843: dwrite d1/d2a/db5/dc4/f103 [0,4194304] 0 2024-04-25T23:01:10.301 INFO:tasks.workunit.client.0.smithi043.stdout:1/924: truncate d0/fa 1526734 0 2024-04-25T23:01:10.301 INFO:tasks.workunit.client.0.smithi043.stdout:4/941: fdatasync d3/d21/d6b/f7f 0 2024-04-25T23:01:10.301 INFO:tasks.workunit.client.0.smithi043.stdout:9/939: creat d8/de/d44/d5d/d4f/f13f x:0 0 0 2024-04-25T23:01:10.302 INFO:tasks.workunit.client.0.smithi043.stdout:8/708: readlink d3/d4/db/d14/d4c/d68/lc5 0 2024-04-25T23:01:10.302 INFO:tasks.workunit.client.0.smithi043.stdout:8/709: sync 2024-04-25T23:01:10.303 INFO:tasks.workunit.client.0.smithi043.stdout:9/940: fdatasync d8/de/d12/d16/f30 0 2024-04-25T23:01:10.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/942: mkdir d3/de/d46/d6a/d8f/d8e/db5/dda/d149 0 2024-04-25T23:01:10.303 INFO:tasks.workunit.client.0.smithi043.stdout:8/710: rmdir d3/d4/d7c 39 2024-04-25T23:01:10.304 INFO:tasks.workunit.client.0.smithi043.stdout:1/925: creat d0/d2f/d4b/da6/d123/f151 x:0 0 0 2024-04-25T23:01:10.304 INFO:tasks.workunit.client.0.smithi043.stdout:1/926: sync 2024-04-25T23:01:10.304 INFO:tasks.workunit.client.0.smithi043.stdout:0/859: write d1b/d31/d3c/f48 [1206755,10599] 0 2024-04-25T23:01:10.304 INFO:tasks.workunit.client.0.smithi043.stdout:6/844: getdents d1/d5/d3b/d62 0 2024-04-25T23:01:10.305 INFO:tasks.workunit.client.0.smithi043.stdout:8/711: creat d3/d4/db/def/ff4 x:0 0 0 2024-04-25T23:01:10.305 INFO:tasks.workunit.client.0.smithi043.stdout:2/845: dread d2/d66/d85/d76/d97/fe [0,4194304] 0 2024-04-25T23:01:10.305 INFO:tasks.workunit.client.0.smithi043.stdout:4/943: getdents d3/de/d27/d5c/de2 0 2024-04-25T23:01:10.306 INFO:tasks.workunit.client.0.smithi043.stdout:1/927: truncate d0/d86/fb7 1751871 0 2024-04-25T23:01:10.306 INFO:tasks.workunit.client.0.smithi043.stdout:2/846: chown d2/d66/d85/d76/d97/f52 8835 1 2024-04-25T23:01:10.307 INFO:tasks.workunit.client.0.smithi043.stdout:1/928: write d0/d86/d10d/d117/d4f/f64 [889699,75950] 0 2024-04-25T23:01:10.307 INFO:tasks.workunit.client.0.smithi043.stdout:8/712: getdents d3/d4/d7c/d92 0 2024-04-25T23:01:10.309 INFO:tasks.workunit.client.0.smithi043.stdout:1/929: creat d0/d2f/d11a/d144/f152 x:0 0 0 2024-04-25T23:01:10.309 INFO:tasks.workunit.client.0.smithi043.stdout:8/713: chown d3/d4/db/d4e/d5c/d59/d61/d97/dc3/ce9 1203085 1 2024-04-25T23:01:10.310 INFO:tasks.workunit.client.0.smithi043.stdout:1/930: unlink d0/d16/df7/f93 0 2024-04-25T23:01:10.312 INFO:tasks.workunit.client.0.smithi043.stdout:1/931: unlink d0/d2f/l34 0 2024-04-25T23:01:10.312 INFO:tasks.workunit.client.0.smithi043.stdout:0/860: dwrite d1b/d23/dab/fc2 [0,4194304] 0 2024-04-25T23:01:10.312 INFO:tasks.workunit.client.0.smithi043.stdout:1/932: fsync d0/d3c/f62 0 2024-04-25T23:01:10.313 INFO:tasks.workunit.client.0.smithi043.stdout:6/845: dwrite d1/d5/d3b/d4c/d21/d55/d6d/ffe [0,4194304] 0 2024-04-25T23:01:10.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/941: truncate d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f11e 1977469 0 2024-04-25T23:01:10.314 INFO:tasks.workunit.client.0.smithi043.stdout:0/861: dread - d1b/fb2 zero size 2024-04-25T23:01:10.315 INFO:tasks.workunit.client.0.smithi043.stdout:0/862: stat d1b/d8b/lfb 0 2024-04-25T23:01:10.315 INFO:tasks.workunit.client.0.smithi043.stdout:0/863: chown d1b/d8b/fc4 2695 1 2024-04-25T23:01:10.318 INFO:tasks.workunit.client.0.smithi043.stdout:9/942: mknod d8/de/d44/d5d/c140 0 2024-04-25T23:01:10.319 INFO:tasks.workunit.client.0.smithi043.stdout:9/943: chown d8/de/d44/c8d 0 1 2024-04-25T23:01:10.319 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:10.319 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:10.320 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:10.320 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:10.320 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:10.320 INFO:tasks.workunit.client.0.smithi043.stdout:9/944: symlink d8/de/d12/d16/d24/dbe/d10d/l141 0 2024-04-25T23:01:10.323 INFO:tasks.workunit.client.0.smithi043.stdout:0/864: dwrite d1b/d31/f8a [0,4194304] 0 2024-04-25T23:01:10.329 INFO:tasks.workunit.client.0.smithi043.stdout:0/865: dwrite d1b/d31/f33 [0,4194304] 0 2024-04-25T23:01:10.331 INFO:tasks.workunit.client.0.smithi043.stdout:9/945: dread d8/de/d44/d5d/d4f/f73 [0,4194304] 0 2024-04-25T23:01:10.331 INFO:tasks.workunit.client.0.smithi043.stdout:1/933: dwrite d0/d86/ff5 [4194304,4194304] 0 2024-04-25T23:01:10.333 INFO:tasks.workunit.client.0.smithi043.stdout:8/714: dread d3/d4/d7c/d92/fa4 [0,4194304] 0 2024-04-25T23:01:10.334 INFO:tasks.workunit.client.0.smithi043.stdout:0/866: getdents d1b/d23/d39/d90 0 2024-04-25T23:01:10.335 INFO:tasks.workunit.client.0.smithi043.stdout:0/867: creat d1b/d23/d7a/dad/f110 x:0 0 0 2024-04-25T23:01:10.336 INFO:tasks.workunit.client.0.smithi043.stdout:0/868: stat d1b/d8b/d103/fe8 0 2024-04-25T23:01:10.337 INFO:tasks.workunit.client.0.smithi043.stdout:0/869: chown d1b/d31/d3c/d50/f5d 355145 1 2024-04-25T23:01:10.337 INFO:tasks.workunit.client.0.smithi043.stdout:0/870: chown d1b/d31 35561 1 2024-04-25T23:01:10.338 INFO:tasks.workunit.client.0.smithi043.stdout:0/871: link d1b/fa4 d1b/d23/d91/ddd/d100/f111 0 2024-04-25T23:01:10.339 INFO:tasks.workunit.client.0.smithi043.stdout:0/872: mkdir d1b/dcf/dd7/d112 0 2024-04-25T23:01:10.339 INFO:tasks.workunit.client.0.smithi043.stdout:0/873: creat d1b/db0/f113 x:0 0 0 2024-04-25T23:01:10.340 INFO:tasks.workunit.client.0.smithi043.stdout:6/846: dread d1/d5/d3b/d4c/d21/d38/f59 [0,4194304] 0 2024-04-25T23:01:10.343 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:10.345 INFO:tasks.workunit.client.0.smithi043.stdout:0/874: dwrite d1b/d8b/fc4 [0,4194304] 0 2024-04-25T23:01:10.346 INFO:tasks.workunit.client.0.smithi043.stdout:4/944: dread d3/d21/d6b/f75 [0,4194304] 0 2024-04-25T23:01:10.348 INFO:tasks.workunit.client.0.smithi043.stdout:6/847: dwrite d1/d5/d3b/d4c/ff0 [4194304,4194304] 0 2024-04-25T23:01:10.348 INFO:tasks.workunit.client.0.smithi043.stdout:3/971: dread d7/f65 [0,4194304] 0 2024-04-25T23:01:10.348 INFO:tasks.workunit.client.0.smithi043.stdout:6/848: dread - d1/dc8/ff2 zero size 2024-04-25T23:01:10.350 INFO:tasks.workunit.client.0.smithi043.stdout:0/875: getdents d1b/d23/d7b/da6/dcb 0 2024-04-25T23:01:10.351 INFO:tasks.workunit.client.0.smithi043.stdout:8/715: truncate d3/d4/db/d14/d56/d5d/f63 3551504 0 2024-04-25T23:01:10.352 INFO:tasks.workunit.client.0.smithi043.stdout:6/849: rename d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/d8e to d1/d5/d3b/d4c/d21/d55/d6d/d96/d119 0 2024-04-25T23:01:10.353 INFO:tasks.workunit.client.0.smithi043.stdout:1/934: write d0/d86/fb7 [2143172,55068] 0 2024-04-25T23:01:10.353 INFO:tasks.workunit.client.0.smithi043.stdout:4/945: dread d3/d21/da5/fba [0,4194304] 0 2024-04-25T23:01:10.354 INFO:tasks.workunit.client.0.smithi043.stdout:6/850: creat d1/d2a/db5/f11a x:0 0 0 2024-04-25T23:01:10.354 INFO:tasks.workunit.client.0.smithi043.stdout:8/716: write d3/d4/db/d4e/d5c/d59/fe0 [4979841,79162] 0 2024-04-25T23:01:10.355 INFO:tasks.workunit.client.0.smithi043.stdout:1/935: write d0/d2f/d4b/d8f/fb1 [1557509,44754] 0 2024-04-25T23:01:10.355 INFO:tasks.workunit.client.0.smithi043.stdout:4/946: mknod d3/d37/d7a/c14a 0 2024-04-25T23:01:10.355 INFO:tasks.workunit.client.0.smithi043.stdout:5/892: dread d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/f83 [4194304,4194304] 0 2024-04-25T23:01:10.356 INFO:tasks.workunit.client.0.smithi043.stdout:6/851: write d1/d5/d3b/f44 [3983389,51526] 0 2024-04-25T23:01:10.356 INFO:tasks.workunit.client.0.smithi043.stdout:8/717: unlink d3/d4/db/d4e/l88 0 2024-04-25T23:01:10.356 INFO:tasks.workunit.client.0.smithi043.stdout:2/847: dread d2/fac [0,4194304] 0 2024-04-25T23:01:10.357 INFO:tasks.workunit.client.0.smithi043.stdout:1/936: write d0/d2f/d4b/f103 [801548,108287] 0 2024-04-25T23:01:10.357 INFO:tasks.workunit.client.0.smithi043.stdout:5/893: creat d0/d2c/d39/d1c/f123 x:0 0 0 2024-04-25T23:01:10.358 INFO:tasks.workunit.client.0.smithi043.stdout:4/947: rename d3/de/d46/d6a/d8f/d8e/d101 to d3/d148/d14b 0 2024-04-25T23:01:10.359 INFO:tasks.workunit.client.0.smithi043.stdout:6/852: unlink d1/d5/d3b/d4c/d21/d38/d99/ld4 0 2024-04-25T23:01:10.359 INFO:tasks.workunit.client.0.smithi043.stdout:1/937: mkdir d0/d2f/d4b/da6/d123/d153 0 2024-04-25T23:01:10.359 INFO:tasks.workunit.client.0.smithi043.stdout:8/718: truncate d3/d4/d36/f76 595092 0 2024-04-25T23:01:10.360 INFO:tasks.workunit.client.0.smithi043.stdout:0/876: dwrite d1b/d23/d91/f10b [0,4194304] 0 2024-04-25T23:01:10.360 INFO:tasks.workunit.client.0.smithi043.stdout:2/848: rename d2/d66/d85/d43/d5d/da9/dd7/da0/feb to d2/d66/dc6/dc8/f120 0 2024-04-25T23:01:10.362 INFO:tasks.workunit.client.0.smithi043.stdout:4/948: symlink d3/de/d46/d6a/d8f/d8e/l14c 0 2024-04-25T23:01:10.362 INFO:tasks.workunit.client.0.smithi043.stdout:5/894: creat d0/d2c/d39/d1c/d25/f124 x:0 0 0 2024-04-25T23:01:10.362 INFO:tasks.workunit.client.0.smithi043.stdout:1/938: creat d0/d9/dc0/f154 x:0 0 0 2024-04-25T23:01:10.363 INFO:tasks.workunit.client.0.smithi043.stdout:4/949: fdatasync d3/d21/f63 0 2024-04-25T23:01:10.363 INFO:tasks.workunit.client.0.smithi043.stdout:2/849: mkdir d2/d66/d121 0 2024-04-25T23:01:10.363 INFO:tasks.workunit.client.0.smithi043.stdout:8/719: rename d3/d4/db/d14/d4c/d77 to d3/d4/db/d14/dcc/df5 0 2024-04-25T23:01:10.364 INFO:tasks.workunit.client.0.smithi043.stdout:1/939: write d0/d86/d10d/d117/d4f/f64 [1030985,18614] 0 2024-04-25T23:01:10.364 INFO:tasks.workunit.client.0.smithi043.stdout:5/895: symlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/d119/l125 0 2024-04-25T23:01:10.365 INFO:tasks.workunit.client.0.smithi043.stdout:1/940: symlink d0/d16/d5a/d5b/l155 0 2024-04-25T23:01:10.365 INFO:tasks.workunit.client.0.smithi043.stdout:2/850: creat d2/d66/d85/d43/d67/db3/d13/f122 x:0 0 0 2024-04-25T23:01:10.366 INFO:tasks.workunit.client.0.smithi043.stdout:8/720: truncate d3/d4/db/d14/d4c/d68/f9b 1828617 0 2024-04-25T23:01:10.366 INFO:tasks.workunit.client.0.smithi043.stdout:5/896: readlink d0/d2c/d39/d1c/d5e/lde 0 2024-04-25T23:01:10.368 INFO:tasks.workunit.client.0.smithi043.stdout:4/950: rename d3/d19/d34/d76/d102/d12e to d3/de/d27/d5c/d14d 0 2024-04-25T23:01:10.368 INFO:tasks.workunit.client.0.smithi043.stdout:2/851: symlink d2/d66/d85/d43/d67/l123 0 2024-04-25T23:01:10.368 INFO:tasks.workunit.client.0.smithi043.stdout:5/897: write d0/d2c/d39/f88 [1909387,88206] 0 2024-04-25T23:01:10.370 INFO:tasks.workunit.client.0.smithi043.stdout:8/721: getdents d3/d4/db/def 0 2024-04-25T23:01:10.370 INFO:tasks.workunit.client.0.smithi043.stdout:4/951: truncate d3/f100 511807 0 2024-04-25T23:01:10.371 INFO:tasks.workunit.client.0.smithi043.stdout:6/853: dwrite d1/d5/d3b/f7a [4194304,4194304] 0 2024-04-25T23:01:10.372 INFO:tasks.workunit.client.0.smithi043.stdout:0/877: dwrite d1b/db0/fd5 [0,4194304] 0 2024-04-25T23:01:10.375 INFO:tasks.workunit.client.0.smithi043.stdout:4/952: symlink d3/de/d46/d6a/l14e 0 2024-04-25T23:01:10.375 INFO:tasks.workunit.client.0.smithi043.stdout:0/878: creat d1b/d8b/d7d/f114 x:0 0 0 2024-04-25T23:01:10.376 INFO:tasks.workunit.client.0.smithi043.stdout:0/879: write d1b/d7f/f101 [285943,88023] 0 2024-04-25T23:01:10.377 INFO:tasks.workunit.client.0.smithi043.stdout:2/852: dwrite d2/d66/d85/f72 [4194304,4194304] 0 2024-04-25T23:01:10.378 INFO:tasks.workunit.client.0.smithi043.stdout:2/853: stat d2/d66/d85/d43/d67/db3/f47 0 2024-04-25T23:01:10.379 INFO:tasks.workunit.client.0.smithi043.stdout:9/946: dread d8/de/d12/d16/d24/dbe/dc6/d2f/dad/fe3 [0,4194304] 0 2024-04-25T23:01:10.379 INFO:tasks.workunit.client.0.smithi043.stdout:5/898: dwrite d0/d22/f7b [0,4194304] 0 2024-04-25T23:01:10.380 INFO:tasks.workunit.client.0.smithi043.stdout:2/854: read - d2/d66/d85/d43/d67/db3/d13/d40/fbd zero size 2024-04-25T23:01:10.380 INFO:tasks.workunit.client.0.smithi043.stdout:0/880: readlink d1b/l21 0 2024-04-25T23:01:10.382 INFO:tasks.workunit.client.0.smithi043.stdout:9/947: rename d8/de/d12/d16/d24/dbe/dc6/d2f/da6/dc3 to d8/de/d44/d65/d103/d142 0 2024-04-25T23:01:10.382 INFO:tasks.workunit.client.0.smithi043.stdout:0/881: truncate d1b/d23/d39/d90/fde 904219 0 2024-04-25T23:01:10.382 INFO:tasks.workunit.client.0.smithi043.stdout:6/854: read d1/d5/d3b/d4c/d21/d55/d6d/d96/fa7 [272464,88033] 0 2024-04-25T23:01:10.383 INFO:tasks.workunit.client.0.smithi043.stdout:3/972: dread d7/d26/d88/f110 [0,4194304] 0 2024-04-25T23:01:10.383 INFO:tasks.workunit.client.0.smithi043.stdout:0/882: stat d1b/d31/d3c 0 2024-04-25T23:01:10.384 INFO:tasks.workunit.client.0.smithi043.stdout:5/899: truncate d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f5c 1229174 0 2024-04-25T23:01:10.385 INFO:tasks.workunit.client.0.smithi043.stdout:6/855: link d1/d5/f7 d1/d5/d3b/d4c/d21/d38/de6/f11b 0 2024-04-25T23:01:10.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/953: dwrite d3/de/d46/d6a/fac [0,4194304] 0 2024-04-25T23:01:10.386 INFO:tasks.workunit.client.0.smithi043.stdout:3/973: truncate d7/d26/d2d/dce/d13b/d7c/fa1 5076179 0 2024-04-25T23:01:10.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/954: fsync d3/de/f49 0 2024-04-25T23:01:10.387 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:10.384+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:10.389 INFO:tasks.workunit.client.0.smithi043.stdout:4/955: mknod d3/de/c14f 0 2024-04-25T23:01:10.394 INFO:tasks.workunit.client.0.smithi043.stdout:9/948: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/fe1 [0,4194304] 0 2024-04-25T23:01:10.395 INFO:tasks.workunit.client.0.smithi043.stdout:0/883: dwrite d1b/d31/d3c/d50/f9b [0,4194304] 0 2024-04-25T23:01:10.395 INFO:tasks.workunit.client.0.smithi043.stdout:5/900: dwrite d0/d2c/d39/d1c/d25/d7a/f107 [0,4194304] 0 2024-04-25T23:01:10.396 INFO:tasks.workunit.client.0.smithi043.stdout:6/856: dwrite d1/d5/d3b/d4c/d21/d55/d68/f42 [4194304,4194304] 0 2024-04-25T23:01:10.397 INFO:tasks.workunit.client.0.smithi043.stdout:4/956: dread d3/d19/f105 [0,4194304] 0 2024-04-25T23:01:10.397 INFO:tasks.workunit.client.0.smithi043.stdout:9/949: rmdir d8/de/d44/d47/d6a 39 2024-04-25T23:01:10.397 INFO:tasks.workunit.client.0.smithi043.stdout:5/901: dread - d0/d2c/d39/d1c/f123 zero size 2024-04-25T23:01:10.398 INFO:tasks.workunit.client.0.smithi043.stdout:3/974: dwrite d7/d26/d2d/dce/d13b/f8e [4194304,4194304] 0 2024-04-25T23:01:10.398 INFO:tasks.workunit.client.0.smithi043.stdout:3/975: stat d7/d26/d27/d34/c3a 0 2024-04-25T23:01:10.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/902: chown d0/d2c/d39/d1c/d25/d7a/d2d/d8b 13923 1 2024-04-25T23:01:10.399 INFO:tasks.workunit.client.0.smithi043.stdout:9/950: write d8/de/d12/fa2 [8685730,114358] 0 2024-04-25T23:01:10.400 INFO:tasks.workunit.client.0.smithi043.stdout:6/857: link d1/d5/d3b/laf d1/d5/l11c 0 2024-04-25T23:01:10.400 INFO:tasks.workunit.client.0.smithi043.stdout:5/903: creat d0/d2c/d39/d63/de7/f126 x:0 0 0 2024-04-25T23:01:10.401 INFO:tasks.workunit.client.0.smithi043.stdout:6/858: chown d1/d5/d3b/d4c/d21/d55/d68/d7f/f102 877792028 1 2024-04-25T23:01:10.402 INFO:tasks.workunit.client.0.smithi043.stdout:5/904: write d0/d2c/d39/d1c/d25/d7a/fb5 [4549741,69828] 0 2024-04-25T23:01:10.405 INFO:tasks.workunit.client.0.smithi043.stdout:0/884: dwrite d1b/d55/d8f/fa1 [0,4194304] 0 2024-04-25T23:01:10.405 INFO:tasks.workunit.client.0.smithi043.stdout:9/951: link d8/de/d12/d16/d24/dbe/dc6/d6c/l77 d8/de/d44/d65/l143 0 2024-04-25T23:01:10.405 INFO:tasks.workunit.client.0.smithi043.stdout:0/885: chown d1b/d31/db1/cfa 3 1 2024-04-25T23:01:10.406 INFO:tasks.workunit.client.0.smithi043.stdout:9/952: write d8/f59 [8131389,30931] 0 2024-04-25T23:01:10.406 INFO:tasks.workunit.client.0.smithi043.stdout:9/953: write d8/de/d44/d65/d103/d142/fd3 [3037778,77885] 0 2024-04-25T23:01:10.407 INFO:tasks.workunit.client.0.smithi043.stdout:9/954: dread - d8/de/f79 zero size 2024-04-25T23:01:10.408 INFO:tasks.workunit.client.0.smithi043.stdout:0/886: creat d1b/d23/d7b/da6/dcb/f115 x:0 0 0 2024-04-25T23:01:10.409 INFO:tasks.workunit.client.0.smithi043.stdout:9/955: rename d8/de/d44/d47/fd7 to d8/de/d12/d16/d24/f144 0 2024-04-25T23:01:10.409 INFO:tasks.workunit.client.0.smithi043.stdout:5/905: dwrite d0/d22/d95/fea [0,4194304] 0 2024-04-25T23:01:10.409 INFO:tasks.workunit.client.0.smithi043.stdout:9/956: chown d8/d136 122 1 2024-04-25T23:01:10.409 INFO:tasks.workunit.client.0.smithi043.stdout:5/906: write d0/f5 [8143701,59599] 0 2024-04-25T23:01:10.410 INFO:tasks.workunit.client.0.smithi043.stdout:0/887: creat d1b/d55/d8f/f116 x:0 0 0 2024-04-25T23:01:10.410 INFO:tasks.workunit.client.0.smithi043.stdout:9/957: fdatasync d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fbd 0 2024-04-25T23:01:10.410 INFO:tasks.workunit.client.0.smithi043.stdout:0/888: write d1b/d23/f3d [1137812,121047] 0 2024-04-25T23:01:10.410 INFO:tasks.workunit.client.0.smithi043.stdout:9/958: read d8/de/fec [186853,42275] 0 2024-04-25T23:01:10.411 INFO:tasks.workunit.client.0.smithi043.stdout:5/907: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fd7 [1841784,37661] 0 2024-04-25T23:01:10.411 INFO:tasks.workunit.client.0.smithi043.stdout:9/959: chown d8/de/d44/d65/faf 268 1 2024-04-25T23:01:10.412 INFO:tasks.workunit.client.0.smithi043.stdout:0/889: mkdir d1b/d117 0 2024-04-25T23:01:10.412 INFO:tasks.workunit.client.0.smithi043.stdout:5/908: mknod d0/d2c/d39/dc4/c127 0 2024-04-25T23:01:10.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/960: symlink d8/de/d44/de8/l145 0 2024-04-25T23:01:10.413 INFO:tasks.workunit.client.0.smithi043.stdout:5/909: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/f50 [4106169,59335] 0 2024-04-25T23:01:10.414 INFO:tasks.workunit.client.0.smithi043.stdout:3/976: truncate d7/d26/d2d/dce/d13b/d7c/f12c 2516043 0 2024-04-25T23:01:10.414 INFO:tasks.workunit.client.0.smithi043.stdout:3/977: stat d7/d26/fca 0 2024-04-25T23:01:10.415 INFO:tasks.workunit.client.0.smithi043.stdout:5/910: dread - d0/d2c/d39/d1c/d25/d7a/d2d/fb2 zero size 2024-04-25T23:01:10.415 INFO:tasks.workunit.client.0.smithi043.stdout:5/911: readlink d0/d22/l11f 0 2024-04-25T23:01:10.416 INFO:tasks.workunit.client.0.smithi043.stdout:3/978: mkdir d7/d26/d27/d34/d1a/d40/d8f/d156 0 2024-04-25T23:01:10.418 INFO:tasks.workunit.client.0.smithi043.stdout:5/912: link d0/d2c/d39/dc4/lc8 d0/d2c/d39/d1c/d101/l128 0 2024-04-25T23:01:10.418 INFO:tasks.workunit.client.0.smithi043.stdout:3/979: mknod d7/d26/d2d/dce/d13b/d7c/d10d/c157 0 2024-04-25T23:01:10.419 INFO:tasks.workunit.client.0.smithi043.stdout:8/722: dread d3/d4/d7c/d92/d62/fa9 [0,4194304] 0 2024-04-25T23:01:10.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/980: creat d7/d26/d88/db8/f158 x:0 0 0 2024-04-25T23:01:10.420 INFO:tasks.workunit.client.0.smithi043.stdout:9/961: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/f12d [0,4194304] 0 2024-04-25T23:01:10.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/723: dwrite d3/d4/d36/f45 [4194304,4194304] 0 2024-04-25T23:01:10.426 INFO:tasks.workunit.client.0.smithi043.stdout:8/724: mkdir d3/d4/db/d4e/d8b/d9f/d33/df6 0 2024-04-25T23:01:10.428 INFO:tasks.workunit.client.0.smithi043.stdout:8/725: rename d3/d4/db/d14/ld6 to d3/d4/db/d14/d4c/lf7 0 2024-04-25T23:01:10.429 INFO:tasks.workunit.client.0.smithi043.stdout:8/726: truncate d3/d4/db/d4e/d8b/d91/fad 215466 0 2024-04-25T23:01:10.430 INFO:tasks.workunit.client.0.smithi043.stdout:8/727: creat d3/d4/db/d4e/d5c/d59/d61/d97/dcd/ff8 x:0 0 0 2024-04-25T23:01:10.434 INFO:tasks.workunit.client.0.smithi043.stdout:3/981: truncate d7/d26/f78 2840722 0 2024-04-25T23:01:10.436 INFO:tasks.workunit.client.0.smithi043.stdout:3/982: dread - d7/d26/d88/d121/f14b zero size 2024-04-25T23:01:10.437 INFO:tasks.workunit.client.0.smithi043.stdout:3/983: readlink d7/d26/d2d/dce/d13b/d7c/db2/d87/l100 0 2024-04-25T23:01:10.437 INFO:tasks.workunit.client.0.smithi043.stdout:3/984: stat d7/d26/d88/lb4 0 2024-04-25T23:01:10.438 INFO:tasks.workunit.client.0.smithi043.stdout:8/728: dwrite d3/d4/db/d4e/d5c/f1e [0,4194304] 0 2024-04-25T23:01:10.438 INFO:tasks.workunit.client.0.smithi043.stdout:3/985: chown d7/d26/d88/d121/f14b 44311504 1 2024-04-25T23:01:10.439 INFO:tasks.workunit.client.0.smithi043.stdout:8/729: dread d3/d4/d7c/d92/fa4 [0,4194304] 0 2024-04-25T23:01:10.441 INFO:tasks.workunit.client.0.smithi043.stdout:8/730: readlink d3/d4/db/d14/l16 0 2024-04-25T23:01:10.442 INFO:tasks.workunit.client.0.smithi043.stdout:4/957: dread d3/d21/d84/faf [0,4194304] 0 2024-04-25T23:01:10.442 INFO:tasks.workunit.client.0.smithi043.stdout:4/958: chown d3/de/c10 9 1 2024-04-25T23:01:10.442 INFO:tasks.workunit.client.0.smithi043.stdout:1/941: sync 2024-04-25T23:01:10.442 INFO:tasks.workunit.client.0.smithi043.stdout:2/855: sync 2024-04-25T23:01:10.443 INFO:tasks.workunit.client.0.smithi043.stdout:2/856: stat d2/d66/d85/fbb 0 2024-04-25T23:01:10.443 INFO:tasks.workunit.client.0.smithi043.stdout:1/942: creat d0/d3c/f156 x:0 0 0 2024-04-25T23:01:10.443 INFO:tasks.workunit.client.0.smithi043.stdout:4/959: fdatasync d3/d21/d6b/d87/d8a/fe0 0 2024-04-25T23:01:10.443 INFO:tasks.workunit.client.0.smithi043.stdout:2/857: symlink d2/d66/d85/d76/l124 0 2024-04-25T23:01:10.444 INFO:tasks.workunit.client.0.smithi043.stdout:4/960: write d3/d21/d6b/d87/d8a/f117 [718851,1005] 0 2024-04-25T23:01:10.444 INFO:tasks.workunit.client.0.smithi043.stdout:1/943: fdatasync d0/d16/dd1/f100 0 2024-04-25T23:01:10.445 INFO:tasks.workunit.client.0.smithi043.stdout:2/858: write d2/d66/d85/d43/d5d/da9/dd7/fb2 [1467657,27578] 0 2024-04-25T23:01:10.445 INFO:tasks.workunit.client.0.smithi043.stdout:4/961: getdents d3/de/d46 0 2024-04-25T23:01:10.446 INFO:tasks.workunit.client.0.smithi043.stdout:2/859: write d2/d66/d85/d76/d97/fcd [371922,14252] 0 2024-04-25T23:01:10.447 INFO:tasks.workunit.client.0.smithi043.stdout:2/860: fsync d2/d66/d85/d43/d67/db3/f4a 0 2024-04-25T23:01:10.448 INFO:tasks.workunit.client.0.smithi043.stdout:6/859: dread d1/d2a/db5/dcb/fd9 [0,4194304] 0 2024-04-25T23:01:10.448 INFO:tasks.workunit.client.0.smithi043.stdout:9/962: dread d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/f3f [0,4194304] 0 2024-04-25T23:01:10.448 INFO:tasks.workunit.client.0.smithi043.stdout:8/731: read d3/d4/d7d/fbd [30983,90514] 0 2024-04-25T23:01:10.449 INFO:tasks.workunit.client.0.smithi043.stdout:4/962: dread d3/f7d [0,4194304] 0 2024-04-25T23:01:10.449 INFO:tasks.workunit.client.0.smithi043.stdout:9/963: unlink d8/f59 0 2024-04-25T23:01:10.449 INFO:tasks.workunit.client.0.smithi043.stdout:4/963: chown d3/de/fcb 117376 1 2024-04-25T23:01:10.450 INFO:tasks.workunit.client.0.smithi043.stdout:8/732: write d3/d4/db/d4e/d5c/d59/fe0 [5791023,57915] 0 2024-04-25T23:01:10.450 INFO:tasks.workunit.client.0.smithi043.stdout:3/986: dread d7/d26/d2d/fb9 [0,4194304] 0 2024-04-25T23:01:10.451 INFO:tasks.workunit.client.0.smithi043.stdout:4/964: rename d3/d21/c26 to d3/d37/c150 0 2024-04-25T23:01:10.452 INFO:tasks.workunit.client.0.smithi043.stdout:8/733: chown d3/d4/db/d4e/d8b/d9f/d33/db0/ff1 5632 1 2024-04-25T23:01:10.452 INFO:tasks.workunit.client.0.smithi043.stdout:3/987: mkdir d7/d26/d27/d34/d1a/d28/d9e/dcc/d159 0 2024-04-25T23:01:10.453 INFO:tasks.workunit.client.0.smithi043.stdout:4/965: truncate d3/d21/d6b/d87/fb4 1439303 0 2024-04-25T23:01:10.453 INFO:tasks.workunit.client.0.smithi043.stdout:3/988: fsync d7/d26/d27/d34/d1a/d28/f4c 0 2024-04-25T23:01:10.453 INFO:tasks.workunit.client.0.smithi043.stdout:8/734: creat d3/d4/db/d4e/d8b/d9f/dd5/ff9 x:0 0 0 2024-04-25T23:01:10.454 INFO:tasks.workunit.client.0.smithi043.stdout:2/861: dwrite d2/d7f/f81 [4194304,4194304] 0 2024-04-25T23:01:10.454 INFO:tasks.workunit.client.0.smithi043.stdout:6/860: truncate d1/d5/d3b/d4c/d21/d38/d99/feb 2259825 0 2024-04-25T23:01:10.454 INFO:tasks.workunit.client.0.smithi043.stdout:4/966: creat d3/d19/d34/d76/dde/f151 x:0 0 0 2024-04-25T23:01:10.455 INFO:tasks.workunit.client.0.smithi043.stdout:9/964: read d8/de/d12/d16/d24/dbe/dc6/d68/fb1 [370808,79503] 0 2024-04-25T23:01:10.456 INFO:tasks.workunit.client.0.smithi043.stdout:3/989: symlink d7/d26/d2d/dce/d13b/d7c/db2/l15a 0 2024-04-25T23:01:10.456 INFO:tasks.workunit.client.0.smithi043.stdout:8/735: dread - d3/d4/db/d4e/d5c/d59/d61/d97/dcd/ff8 zero size 2024-04-25T23:01:10.456 INFO:tasks.workunit.client.0.smithi043.stdout:2/862: unlink d2/d66/d85/d76/d97/f9e 0 2024-04-25T23:01:10.456 INFO:tasks.workunit.client.0.smithi043.stdout:6/861: mknod d1/d5/d3b/d4c/d21/d38/d99/c11d 0 2024-04-25T23:01:10.457 INFO:tasks.workunit.client.0.smithi043.stdout:8/736: mkdir d3/d4/db/d14/d56/d5d/d9c/da7/dfa 0 2024-04-25T23:01:10.457 INFO:tasks.workunit.client.0.smithi043.stdout:6/862: creat d1/d2a/db5/f11e x:0 0 0 2024-04-25T23:01:10.457 INFO:tasks.workunit.client.0.smithi043.stdout:3/990: rename d7/d26/d88/lb4 to d7/d26/d27/d34/d1a/d40/d8f/d51/l15b 0 2024-04-25T23:01:10.459 INFO:tasks.workunit.client.0.smithi043.stdout:8/737: truncate d3/d4/d7c/fc6 726471 0 2024-04-25T23:01:10.459 INFO:tasks.workunit.client.0.smithi043.stdout:6/863: creat d1/d5/d3b/d4c/d21/d55/d68/d30/f11f x:0 0 0 2024-04-25T23:01:10.459 INFO:tasks.workunit.client.0.smithi043.stdout:3/991: symlink d7/d26/d27/d34/d1a/d40/d8f/d51/l15c 0 2024-04-25T23:01:10.459 INFO:tasks.workunit.client.0.smithi043.stdout:9/965: dread d8/fd [0,4194304] 0 2024-04-25T23:01:10.459 INFO:tasks.workunit.client.0.smithi043.stdout:3/992: rmdir d7/dac 39 2024-04-25T23:01:10.459 INFO:tasks.workunit.client.0.smithi043.stdout:8/738: unlink d3/d4/d98/fd0 0 2024-04-25T23:01:10.459 INFO:tasks.workunit.client.0.smithi043.stdout:6/864: write d1/d5/d3b/d4c/ff0 [6496392,12502] 0 2024-04-25T23:01:10.460 INFO:tasks.workunit.client.0.smithi043.stdout:4/967: read d3/d21/d84/fcc [1454571,83655] 0 2024-04-25T23:01:10.460 INFO:tasks.workunit.client.0.smithi043.stdout:8/739: dread - d3/d4/d36/fde zero size 2024-04-25T23:01:10.461 INFO:tasks.workunit.client.0.smithi043.stdout:9/966: truncate d8/de/d44/fc0 1930278 0 2024-04-25T23:01:10.461 INFO:tasks.workunit.client.0.smithi043.stdout:3/993: dread - d7/d26/d27/d34/d1a/d40/d8f/d51/d5a/f147 zero size 2024-04-25T23:01:10.461 INFO:tasks.workunit.client.0.smithi043.stdout:6/865: creat d1/d5/d3b/d4c/d21/d38/d99/f120 x:0 0 0 2024-04-25T23:01:10.462 INFO:tasks.workunit.client.0.smithi043.stdout:4/968: creat d3/d37/d12d/d140/f152 x:0 0 0 2024-04-25T23:01:10.462 INFO:tasks.workunit.client.0.smithi043.stdout:9/967: symlink d8/de/d44/d65/l146 0 2024-04-25T23:01:10.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/994: symlink d7/d26/d2d/dce/l15d 0 2024-04-25T23:01:10.464 INFO:tasks.workunit.client.0.smithi043.stdout:2/863: dwrite d2/d66/d85/d76/d97/f35 [0,4194304] 0 2024-04-25T23:01:10.464 INFO:tasks.workunit.client.0.smithi043.stdout:9/968: creat d8/de/d44/f147 x:0 0 0 2024-04-25T23:01:10.467 INFO:tasks.workunit.client.0.smithi043.stdout:5/913: sync 2024-04-25T23:01:10.467 INFO:tasks.workunit.client.0.smithi043.stdout:0/890: sync 2024-04-25T23:01:10.467 INFO:tasks.workunit.client.0.smithi043.stdout:1/944: sync 2024-04-25T23:01:10.468 INFO:tasks.workunit.client.0.smithi043.stdout:2/864: mknod d2/d66/d85/d43/d5d/da9/dd7/db9/c125 0 2024-04-25T23:01:10.468 INFO:tasks.workunit.client.0.smithi043.stdout:0/891: stat d1b/d23/d39/d90/df4/fe4 0 2024-04-25T23:01:10.469 INFO:tasks.workunit.client.0.smithi043.stdout:1/945: dread - d0/d2f/deb/ff2 zero size 2024-04-25T23:01:10.469 INFO:tasks.workunit.client.0.smithi043.stdout:8/740: dwrite d3/d4/db/d4e/d8b/d9f/d33/f9a [0,4194304] 0 2024-04-25T23:01:10.470 INFO:tasks.workunit.client.0.smithi043.stdout:0/892: chown d1b/db0/fc5 0 1 2024-04-25T23:01:10.470 INFO:tasks.workunit.client.0.smithi043.stdout:8/741: stat d3/d4/d36/f45 0 2024-04-25T23:01:10.470 INFO:tasks.workunit.client.0.smithi043.stdout:6/866: dwrite d1/d2a/db5/dc4/dfa/fee [0,4194304] 0 2024-04-25T23:01:10.470 INFO:tasks.workunit.client.0.smithi043.stdout:3/995: link d7/dac/f114 d7/d26/d27/d34/f15e 0 2024-04-25T23:01:10.471 INFO:tasks.workunit.client.0.smithi043.stdout:0/893: write f8 [1470528,64742] 0 2024-04-25T23:01:10.471 INFO:tasks.workunit.client.0.smithi043.stdout:0/894: readlink d1b/l21 0 2024-04-25T23:01:10.472 INFO:tasks.workunit.client.0.smithi043.stdout:6/867: mknod d1/d2a/db5/dc4/c121 0 2024-04-25T23:01:10.472 INFO:tasks.workunit.client.0.smithi043.stdout:8/742: rename d3/d4/db/d4e/d5c/d59/lc8 to d3/d4/db/d4e/d8b/d9f/dd5/lfb 0 2024-04-25T23:01:10.472 INFO:tasks.workunit.client.0.smithi043.stdout:1/946: symlink d0/d16/d5a/d128/l157 0 2024-04-25T23:01:10.473 INFO:tasks.workunit.client.0.smithi043.stdout:6/868: dread - d1/d5/d3b/d4c/d21/d38/f87 zero size 2024-04-25T23:01:10.474 INFO:tasks.workunit.client.0.smithi043.stdout:1/947: symlink d0/d16/d5a/d5b/l158 0 2024-04-25T23:01:10.474 INFO:tasks.workunit.client.0.smithi043.stdout:8/743: stat d3/d4/db/d4e/d5c/d59/d61/d97/dc3/ce9 0 2024-04-25T23:01:10.475 INFO:tasks.workunit.client.0.smithi043.stdout:6/869: mkdir d1/d2a/dd5/d122 0 2024-04-25T23:01:10.475 INFO:tasks.workunit.client.0.smithi043.stdout:1/948: creat d0/d16/df7/dbf/d130/f159 x:0 0 0 2024-04-25T23:01:10.476 INFO:tasks.workunit.client.0.smithi043.stdout:6/870: mkdir d1/d5/d3b/d62/d123 0 2024-04-25T23:01:10.476 INFO:tasks.workunit.client.0.smithi043.stdout:9/969: dwrite d8/de/d44/d47/f8a [0,4194304] 0 2024-04-25T23:01:10.477 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:10.474+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:10.478 INFO:tasks.workunit.client.0.smithi043.stdout:6/871: creat d1/d2a/db5/dc4/f124 x:0 0 0 2024-04-25T23:01:10.478 INFO:tasks.workunit.client.0.smithi043.stdout:6/872: chown d1/d5/d3b/d62/d123 101 1 2024-04-25T23:01:10.478 INFO:tasks.workunit.client.0.smithi043.stdout:3/996: truncate d7/f2a 5678919 0 2024-04-25T23:01:10.478 INFO:tasks.workunit.client.0.smithi043.stdout:1/949: truncate d0/d9/d63/f90 334849 0 2024-04-25T23:01:10.478 INFO:tasks.workunit.client.0.smithi043.stdout:9/970: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/f148 x:0 0 0 2024-04-25T23:01:10.479 INFO:tasks.workunit.client.0.smithi043.stdout:8/744: dread d3/d4/db/d4e/d5c/f1e [0,4194304] 0 2024-04-25T23:01:10.479 INFO:tasks.workunit.client.0.smithi043.stdout:1/950: chown d0/d86/d10d/d117/dd7/fe3 19484645 1 2024-04-25T23:01:10.481 INFO:tasks.workunit.client.0.smithi043.stdout:6/873: symlink d1/d5/d3b/d4c/l125 0 2024-04-25T23:01:10.481 INFO:tasks.workunit.client.0.smithi043.stdout:1/951: unlink d0/d9/d63/c6f 0 2024-04-25T23:01:10.481 INFO:tasks.workunit.client.0.smithi043.stdout:9/971: creat d8/de/d12/d16/d24/dbe/d10d/d111/f149 x:0 0 0 2024-04-25T23:01:10.482 INFO:tasks.workunit.client.0.smithi043.stdout:6/874: unlink d1/d5/d3b/d4c/d1a/l34 0 2024-04-25T23:01:10.482 INFO:tasks.workunit.client.0.smithi043.stdout:9/972: write d8/de/f78 [1348299,107890] 0 2024-04-25T23:01:10.483 INFO:tasks.workunit.client.0.smithi043.stdout:1/952: creat d0/d2f/f15a x:0 0 0 2024-04-25T23:01:10.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/953: chown d0/d2f/l8e 3061 1 2024-04-25T23:01:10.485 INFO:tasks.workunit.client.0.smithi043.stdout:1/954: readlink d0/d16/d5a/d5b/le0 0 2024-04-25T23:01:10.485 INFO:tasks.workunit.client.0.smithi043.stdout:8/745: read d3/d4/db/d14/f54 [3375445,82340] 0 2024-04-25T23:01:10.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/997: dwrite d7/d26/d88/db0/f135 [0,4194304] 0 2024-04-25T23:01:10.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/998: stat d7/d26/d2d/dce/d13b/f8e 0 2024-04-25T23:01:10.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/955: mknod d0/d2f/d11a/d144/c15b 0 2024-04-25T23:01:10.486 INFO:tasks.workunit.client.0.smithi043.stdout:8/746: rmdir d3/d4/db/d4e/d5c 39 2024-04-25T23:01:10.486 INFO:tasks.workunit.client.0.smithi043.stdout:4/969: sync 2024-04-25T23:01:10.486 INFO:tasks.workunit.client.0.smithi043.stdout:9/973: rename d8/de/d44/d65/d103/d142/ld9 to d8/de/d44/d65/l14a 0 2024-04-25T23:01:10.487 INFO:tasks.workunit.client.0.smithi043.stdout:0/895: sync 2024-04-25T23:01:10.487 INFO:tasks.workunit.client.0.smithi043.stdout:2/865: sync 2024-04-25T23:01:10.487 INFO:tasks.workunit.client.0.smithi043.stdout:1/956: symlink d0/d16/dd1/l15c 0 2024-04-25T23:01:10.487 INFO:tasks.workunit.client.0.smithi043.stdout:4/970: mkdir d3/d21/d120/d153 0 2024-04-25T23:01:10.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/971: stat d3/d21/d6b/d87/d8a 0 2024-04-25T23:01:10.489 INFO:tasks.workunit.client.0.smithi043.stdout:9/974: mknod d8/de/d12/de4/c14b 0 2024-04-25T23:01:10.489 INFO:tasks.workunit.client.0.smithi043.stdout:1/957: mkdir d0/d2f/d11a/d15d 0 2024-04-25T23:01:10.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/972: chown d3/de/d46/d6a/c103 153201736 1 2024-04-25T23:01:10.490 INFO:tasks.workunit.client.0.smithi043.stdout:8/747: write d3/d4/db/d4e/d5c/f1e [5068802,39581] 0 2024-04-25T23:01:10.491 INFO:tasks.workunit.client.0.smithi043.stdout:1/958: symlink d0/d2f/d11a/d15d/l15e 0 2024-04-25T23:01:10.491 INFO:tasks.workunit.client.0.smithi043.stdout:4/973: write d3/d19/f5a [1710330,118562] 0 2024-04-25T23:01:10.491 INFO:tasks.workunit.client.0.smithi043.stdout:9/975: fsync d8/de/d12/d16/d24/dbe/dc6/d2f/dad/ff9 0 2024-04-25T23:01:10.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/976: mknod d8/de/d12/d16/d24/dbe/dc6/d2f/d84/c14c 0 2024-04-25T23:01:10.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/896: truncate d1b/d23/d39/f46 1681036 0 2024-04-25T23:01:10.496 INFO:tasks.workunit.client.0.smithi043.stdout:1/959: getdents d0/d86/d10b/d10e 0 2024-04-25T23:01:10.498 INFO:tasks.workunit.client.0.smithi043.stdout:1/960: unlink d0/d9/f25 0 2024-04-25T23:01:10.498 INFO:tasks.workunit.client.0.smithi043.stdout:9/977: symlink d8/de/d44/d65/d103/d142/l14d 0 2024-04-25T23:01:10.498 INFO:tasks.workunit.client.0.smithi043.stdout:8/748: dwrite d3/d4/db/d4e/d5c/d59/fe0 [0,4194304] 0 2024-04-25T23:01:10.499 INFO:tasks.workunit.client.0.smithi043.stdout:4/974: dwrite d3/d19/f8d [0,4194304] 0 2024-04-25T23:01:10.499 INFO:tasks.workunit.client.0.smithi043.stdout:4/975: dread - d3/d37/d7a/f147 zero size 2024-04-25T23:01:10.500 INFO:tasks.workunit.client.0.smithi043.stdout:8/749: chown d3/d4/db/d4e/d8b/d91/ld7 178383254 1 2024-04-25T23:01:10.501 INFO:tasks.workunit.client.0.smithi043.stdout:8/750: write d3/d4/db/d14/d4c/d68/f9b [2063690,11160] 0 2024-04-25T23:01:10.502 INFO:tasks.workunit.client.0.smithi043.stdout:4/976: unlink d3/l62 0 2024-04-25T23:01:10.502 INFO:tasks.workunit.client.0.smithi043.stdout:1/961: mkdir d0/d86/d10d/d117/d13e/d15f 0 2024-04-25T23:01:10.503 INFO:tasks.workunit.client.0.smithi043.stdout:4/977: write d3/d37/d7a/de7/f125 [888319,66885] 0 2024-04-25T23:01:10.504 INFO:tasks.workunit.client.0.smithi043.stdout:4/978: rmdir d3/de/d46/d6a/d13c 0 2024-04-25T23:01:10.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/751: mkdir d3/d4/db/d4e/d8b/d9f/d8d/dfc 0 2024-04-25T23:01:10.506 INFO:tasks.workunit.client.0.smithi043.stdout:4/979: creat d3/d21/da5/dff/f154 x:0 0 0 2024-04-25T23:01:10.506 INFO:tasks.workunit.client.0.smithi043.stdout:8/752: rename d3/d4/db/d4e/d5c/d59/d61/d97/dcd/ff8 to d3/d4/db/ffd 0 2024-04-25T23:01:10.507 INFO:tasks.workunit.client.0.smithi043.stdout:8/753: write d3/d4/db/d4e/d5c/d59/d61/d66/f89 [1513216,57968] 0 2024-04-25T23:01:10.509 INFO:tasks.workunit.client.0.smithi043.stdout:9/978: dread d8/f96 [0,4194304] 0 2024-04-25T23:01:10.510 INFO:tasks.workunit.client.0.smithi043.stdout:9/979: mkdir d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/d14e 0 2024-04-25T23:01:10.511 INFO:tasks.workunit.client.0.smithi043.stdout:4/980: dwrite d3/de/d27/d45/f12f [0,4194304] 0 2024-04-25T23:01:10.513 INFO:tasks.workunit.client.0.smithi043.stdout:4/981: creat d3/de/d27/d5c/db9/f155 x:0 0 0 2024-04-25T23:01:10.514 INFO:tasks.workunit.client.0.smithi043.stdout:4/982: chown d3/d19/fab 654529 1 2024-04-25T23:01:10.514 INFO:tasks.workunit.client.0.smithi043.stdout:3/999: dread d7/d26/d27/d34/f106 [0,4194304] 0 2024-04-25T23:01:10.516 INFO:tasks.workunit.client.0.smithi043.stdout:0/897: sync 2024-04-25T23:01:10.517 INFO:tasks.workunit.client.0.smithi043.stdout:0/898: stat d1b/d117 0 2024-04-25T23:01:10.518 INFO:tasks.workunit.client.0.smithi043.stdout:0/899: mknod d1b/d23/d7a/dad/df5/c118 0 2024-04-25T23:01:10.519 INFO:tasks.workunit.client.0.smithi043.stdout:2/866: dread d2/d66/d85/d43/d5d/da9/dd7/fb2 [0,4194304] 0 2024-04-25T23:01:10.520 INFO:tasks.workunit.client.0.smithi043.stdout:8/754: write d3/d4/d36/f76 [1099349,37802] 0 2024-04-25T23:01:10.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/867: creat d2/d66/d85/d76/d97/d77/f126 x:0 0 0 2024-04-25T23:01:10.521 INFO:tasks.workunit.client.0.smithi043.stdout:4/983: dwrite d3/d19/d34/d76/f109 [0,4194304] 0 2024-04-25T23:01:10.521 INFO:tasks.workunit.client.0.smithi043.stdout:6/875: dread d1/f1f [0,4194304] 0 2024-04-25T23:01:10.524 INFO:tasks.workunit.client.0.smithi043.stdout:2/868: rmdir d2/d66/d85/d76/d97/d77/d115 39 2024-04-25T23:01:10.524 INFO:tasks.workunit.client.0.smithi043.stdout:4/984: unlink d3/de/d46/d6a/d8f/d8e/fae 0 2024-04-25T23:01:10.525 INFO:tasks.workunit.client.0.smithi043.stdout:2/869: dread - d2/d66/d85/d43/d67/db3/d13/d40/f74 zero size 2024-04-25T23:01:10.527 INFO:tasks.workunit.client.0.smithi043.stdout:0/900: write d1b/d23/d39/f46 [1890246,59528] 0 2024-04-25T23:01:10.527 INFO:tasks.workunit.client.0.smithi043.stdout:9/980: dwrite d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d31/fb9 [0,4194304] 0 2024-04-25T23:01:10.529 INFO:tasks.workunit.client.0.smithi043.stdout:0/901: getdents d1b/dea 0 2024-04-25T23:01:10.531 INFO:tasks.workunit.client.0.smithi043.stdout:6/876: dwrite d1/d5/d3b/d62/f90 [0,4194304] 0 2024-04-25T23:01:10.531 INFO:tasks.workunit.client.0.smithi043.stdout:0/902: write d1b/d31/f49 [996661,84652] 0 2024-04-25T23:01:10.532 INFO:tasks.workunit.client.0.smithi043.stdout:6/877: unlink d1/dc8/fe1 0 2024-04-25T23:01:10.532 INFO:tasks.workunit.client.0.smithi043.stdout:2/870: write d2/d66/d85/d43/d5d/f84 [1429927,115441] 0 2024-04-25T23:01:10.533 INFO:tasks.workunit.client.0.smithi043.stdout:8/755: dread d3/d4/db/d4e/d5c/d59/d61/d66/f89 [0,4194304] 0 2024-04-25T23:01:10.534 INFO:tasks.workunit.client.0.smithi043.stdout:4/985: dwrite d3/d21/d6b/d87/d8a/f10e [0,4194304] 0 2024-04-25T23:01:10.534 INFO:tasks.workunit.client.0.smithi043.stdout:6/878: mknod d1/d5/d3b/d4c/d21/d55/da2/ddb/c126 0 2024-04-25T23:01:10.534 INFO:tasks.workunit.client.0.smithi043.stdout:2/871: creat d2/d66/d85/d43/d5d/da9/dd7/da0/f127 x:0 0 0 2024-04-25T23:01:10.535 INFO:tasks.workunit.client.0.smithi043.stdout:8/756: symlink d3/d4/db/d4e/d5c/d59/d61/d97/dcd/lfe 0 2024-04-25T23:01:10.536 INFO:tasks.workunit.client.0.smithi043.stdout:2/872: mknod d2/d66/d85/d43/d5d/da9/dd7/da0/c128 0 2024-04-25T23:01:10.536 INFO:tasks.workunit.client.0.smithi043.stdout:9/981: read d8/de/d12/d16/d24/dbe/dc6/d2f/fa5 [439341,58914] 0 2024-04-25T23:01:10.536 INFO:tasks.workunit.client.0.smithi043.stdout:8/757: chown d3/d4/d7c/d92/fdc 1747 1 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.678880774, 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.678849788000001, 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.678807366000001, 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.678776547, 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.678746867999999, 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.664489869000001, 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.664079502, 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.661578805, 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.661526203999999, 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.661492758, 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.654140573999999, 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.654027256999999, 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.653963313, 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.653918301000001, 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.653881054999999, 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.652547156000001, 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.650386428999999, 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.648240529000001, 2024-04-25T23:01:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.647874460000001, 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.644420619, 2024-04-25T23:01:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:10.630 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:10.632 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:10.636 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:10.630+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:10.642 INFO:tasks.workunit.client.0.smithi043.stdout:2/873: rename d2/d66/d85/d76/ff0 to d2/d66/d85/d43/d67/d8d/f129 0 2024-04-25T23:01:10.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/982: mkdir d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/d14f 0 2024-04-25T23:01:10.642 INFO:tasks.workunit.client.0.smithi043.stdout:2/874: write d2/d66/d85/d43/d5d/dee/f102 [397513,34642] 0 2024-04-25T23:01:10.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/983: chown d8/de/c124 79261 1 2024-04-25T23:01:10.642 INFO:tasks.workunit.client.0.smithi043.stdout:6/879: dwrite d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/fc0 [0,4194304] 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/984: chown d8/de/d44/d65/l146 19443 1 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:5/914: dread d0/d2c/d39/d1c/d5e/ffc [0,4194304] 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:5/915: readlink d0/l84 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:6/880: chown d1/d5/d3b/d4c/d21/d55/d68/d30/c72 388 1 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:5/916: chown d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d102 17362 1 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:8/758: dwrite d3/d4/db/d4e/d5c/d59/d61/d66/f89 [0,4194304] 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/962: dread d0/d9/fb4 [0,4194304] 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:6/881: read - d1/d5/d3b/d4c/d21/d55/d68/d30/ff5 zero size 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/963: creat d0/d16/d135/f160 x:0 0 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:6/882: fdatasync d1/d2a/ff9 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:5/917: chown d0/d2c/d39/d1c/d5e/fa7 7 1 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:6/883: symlink d1/d2a/dd5/l127 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/964: fsync d0/d86/fd5 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/965: symlink d0/l161 0 2024-04-25T23:01:10.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/966: mknod d0/d86/d10d/d117/c162 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:1/967: readlink d0/l13 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:8/759: dwrite d3/d4/db/d4e/d5c/d59/d61/d97/dcd/fda [0,4194304] 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/884: dwrite d1/d2a/db5/dc4/dfa/fee [0,4194304] 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/885: read - d1/d5/d3b/fac zero size 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/886: fdatasync d1/d5/f7 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/986: sync 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/887: mkdir d1/d5/d3b/d4c/d21/d38/d128 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/987: write d3/d37/d7a/de7/f125 [550349,62272] 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/988: mknod d3/d37/c156 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/989: chown d3/d21/d6b/d87/d9a 26148273 1 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/985: dwrite d8/de/d12/d16/f36 [0,4194304] 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/990: truncate d3/d37/d4d/f92 885339 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/991: fdatasync d3/de/d27/ff9 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/986: mknod d8/de/d44/d65/c150 0 2024-04-25T23:01:10.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/992: rename d3/d19/d34/dea/dc8/lf1 to d3/de/d27/d5c/db9/l157 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:4/993: symlink d3/de/d46/d6a/d8f/d8e/db5/l158 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:4/994: rename d3/d21/d6b/d87/d8a/cad to d3/d37/c159 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:8/760: dread d3/d4/db/d14/d4c/d68/f9b [0,4194304] 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:4/995: getdents d3/d21/d84 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:4/996: creat d3/d21/d120/d153/f15a x:0 0 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:6/888: write d1/d5/d3b/d4c/d21/d55/fa6 [322718,20696] 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:6/889: mkdir d1/d2a/d129 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:6/890: write d1/d2a/f4e [2024606,129940] 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:6/891: fsync d1/d2a/ff9 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:8/761: read d3/d4/db/d14/dcc/df5/f27 [6218477,84970] 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:4/997: dwrite d3/d21/d6b/d87/fb4 [0,4194304] 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:8/762: chown d3/d4/d7c/d92/d62/d6e 8779 1 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:8/763: fdatasync d3/d4/d36/fde 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:0/903: dread d1b/d8b/f85 [0,4194304] 0 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:8/764: rmdir d3 39 2024-04-25T23:01:10.645 INFO:tasks.workunit.client.0.smithi043.stdout:6/892: symlink d1/d5/d3b/d4c/d21/d55/d68/l12a 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/875: dread d2/d66/d85/d43/f8e [0,4194304] 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:4/998: getdents d3/d21/d6b/d87 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/876: stat d2/d66/d85/d43/d5d/da9/fc3 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:4/999: creat d3/d19/d34/f15b x:0 0 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/877: chown d2/d66/d85/d43/d67/d8d/f111 176 1 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:8/765: truncate d3/d4/db/d4e/d8b/d9f/d33/db0/feb 956984 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:8/766: write d3/d4/db/d14/d56/f70 [3267293,22254] 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:8/767: getdents d3/d4/db/d4e/d5c 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:8/768: rename d3/d4/db/d14/d56/d5d to d3/d4/db/d14/d56/d5d/dff 22 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:5/918: dread d0/d2c/d39/d1c/d25/d7a/d2d/d5f/ff9 [0,4194304] 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:5/919: write d0/d22/d95/fea [4914228,110411] 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/878: dwrite d2/d66/d85/d76/d97/d77/da2/fa4 [4194304,4194304] 0 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:5/920: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62 39 2024-04-25T23:01:10.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/879: write d2/d66/d85/d43/f8e [3012480,20736] 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:0/904: dread d1b/f37 [0,4194304] 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:0/905: chown d1b/d31/db1 40078084 1 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/921: rename d0/d2c/d39/d1c/d25/d7a/f6f to d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62/f129 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:0/906: getdents d1b/d117 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/769: dwrite d3/d4/db/f2d [4194304,4194304] 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/922: chown d0/d2c/d39/d1c/d25/d7a/d2d/dc9 0 1 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/770: getdents d3 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/923: chown d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/faa 75468 1 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/771: mknod d3/d4/db/d4e/d5c/d59/c100 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/772: readlink d3/d4/db/d14/l16 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:2/880: dread d2/d66/d85/d43/d67/db3/d13/fa6 [0,4194304] 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:0/907: dwrite d1b/d7f/fd8 [0,4194304] 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:2/881: fdatasync d2/d66/d85/d76/f91 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/773: dread d3/d4/db/d14/d4c/d68/f9b [0,4194304] 0 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:1/968: sync 2024-04-25T23:01:10.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/924: dwrite d0/d2c/d39/d1c/d5e/ffc [0,4194304] 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:0/908: link d1b/d8b/dc0/fc9 d1b/d117/f119 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/969: dwrite d0/d9/ddc/f102 [0,4194304] 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:2/882: dwrite d2/d66/d85/d43/d67/d8d/f129 [0,4194304] 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/970: mknod d0/d86/d10b/d10e/c163 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/971: readlink d0/d2f/d11a/d15d/l15e 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:2/883: mkdir d2/d66/d85/d43/d5d/da9/dd7/da0/d12a 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/972: chown d0/d9/faf 477 1 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/973: write d0/d16/dd1/f100 [3188996,19965] 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/974: fsync d0/d86/fb7 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:8/774: dread d3/d4/db/d14/f19 [0,4194304] 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:8/775: chown d3/d4/d7c/d92/d62 150 1 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:2/884: dwrite d2/d66/d85/d43/d5d/da9/dd7/df7/fab [0,4194304] 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:8/776: mknod d3/d4/db/d4e/d5c/d59/db7/c101 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:8/777: write d3/d4/d7c/f9e [2208116,74180] 0 2024-04-25T23:01:10.648 INFO:tasks.workunit.client.0.smithi043.stdout:2/885: rename d2/d66/d85/d76/d97/d77/da2/ffa to d2/d66/d85/d76/d97/d77/d115/f12b 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:2/886: getdents d2/d66/d85/d43/d67/db3/d110 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:2/887: creat d2/f12c x:0 0 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:2/888: getdents d2/d66/d85/d43/d67/db3/d13 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:2/889: rmdir d2/d66/d85/d43/d67 39 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/909: write d1b/d117/f119 [3364100,73791] 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:8/778: write d3/d4/db/d4e/d8b/d91/fad [1257245,65872] 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/910: write d1b/f56 [1397170,124439] 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:6/893: dread d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/d9c/dc3/de3/f106 [0,4194304] 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/911: write d1b/d23/d39/f4b [3008551,92594] 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:8/779: symlink d3/d4/db/d14/dcc/dd2/l102 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:8/780: fdatasync d3/d4/db/d14/d56/d5d/d9c/da7/fb6 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:8/781: write d3/d4/db/d14/d4c/d68/f7a [127058,72158] 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:2/890: truncate d2/d66/d85/d76/d97/f35 1288348 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:2/891: link d2/d66/d85/d43/d5d/da9/dd7/da3/l117 d2/d66/l12d 0 2024-04-25T23:01:10.649 INFO:tasks.workunit.client.0.smithi043.stdout:9/987: sync 2024-04-25T23:01:10.651 INFO:tasks.workunit.client.0.smithi043.stdout:9/988: link d8/de/d44/d65/fc8 d8/de/d12/d16/d24/dbe/d10d/d111/f151 0 2024-04-25T23:01:10.651 INFO:tasks.workunit.client.0.smithi043.stdout:9/989: chown d8/de/c7b 550371 1 2024-04-25T23:01:10.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/894: write d1/d2a/db5/dcb/fd0 [601232,12166] 0 2024-04-25T23:01:10.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/782: truncate d3/d4/db/d4e/d5c/d59/fe0 5390938 0 2024-04-25T23:01:10.652 INFO:tasks.workunit.client.0.smithi043.stdout:9/990: truncate d8/de/d12/d7a/fef 735801 0 2024-04-25T23:01:10.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/783: mkdir d3/d4/d7c/d92/d62/d6e/d103 0 2024-04-25T23:01:10.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/784: chown d3/d4/db/d4e/f80 17 1 2024-04-25T23:01:10.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/785: stat d3/d4/db/d14/f19 0 2024-04-25T23:01:10.652 INFO:tasks.workunit.client.0.smithi043.stdout:0/912: dwrite d1b/d23/d91/ddd/d100/f111 [0,4194304] 0 2024-04-25T23:01:10.652 INFO:tasks.workunit.client.0.smithi043.stdout:2/892: dread d2/d66/d85/d43/fc4 [0,4194304] 0 2024-04-25T23:01:10.653 INFO:tasks.workunit.client.0.smithi043.stdout:0/913: dread d1b/d31/d3c/d72/f78 [0,4194304] 0 2024-04-25T23:01:10.653 INFO:tasks.workunit.client.0.smithi043.stdout:2/893: chown d2/d66/d85/d43/d5d/da9/dd7/da0/c128 1188 1 2024-04-25T23:01:10.655 INFO:tasks.workunit.client.0.smithi043.stdout:2/894: creat d2/d66/d85/d43/d67/db3/f12e x:0 0 0 2024-04-25T23:01:10.657 INFO:tasks.workunit.client.0.smithi043.stdout:2/895: rename d2/d66/d85/d43/d5d/da9/fda to d2/d66/d85/d43/f12f 0 2024-04-25T23:01:10.658 INFO:tasks.workunit.client.0.smithi043.stdout:0/914: dwrite d1b/d23/d7a/dc8/ffe [0,4194304] 0 2024-04-25T23:01:10.658 INFO:tasks.workunit.client.0.smithi043.stdout:0/915: write f11 [433561,110308] 0 2024-04-25T23:01:10.660 INFO:tasks.workunit.client.0.smithi043.stdout:2/896: creat d2/d66/d85/d43/d5d/dee/f130 x:0 0 0 2024-04-25T23:01:10.660 INFO:tasks.workunit.client.0.smithi043.stdout:0/916: symlink d1b/d31/d3c/d72/ddf/l11a 0 2024-04-25T23:01:10.661 INFO:tasks.workunit.client.0.smithi043.stdout:0/917: fdatasync d1b/d23/d7a/fdb 0 2024-04-25T23:01:10.662 INFO:tasks.workunit.client.0.smithi043.stdout:0/918: mknod d1b/d23/d7a/c11b 0 2024-04-25T23:01:10.662 INFO:tasks.workunit.client.0.smithi043.stdout:2/897: rename d2/d66/d85/d76/d97/d77/da2/db5/fe1 to d2/d66/d85/d43/d5d/da9/dd7/df7/f131 0 2024-04-25T23:01:10.663 INFO:tasks.workunit.client.0.smithi043.stdout:0/919: write d1b/d31/d3c/f48 [2060787,113066] 0 2024-04-25T23:01:10.663 INFO:tasks.workunit.client.0.smithi043.stdout:2/898: rmdir d2/d66/d85 39 2024-04-25T23:01:10.664 INFO:tasks.workunit.client.0.smithi043.stdout:0/920: write d1b/d23/d39/f4b [5147341,128753] 0 2024-04-25T23:01:10.664 INFO:tasks.workunit.client.0.smithi043.stdout:2/899: dread - d2/d66/d85/d43/d67/d10c/f116 zero size 2024-04-25T23:01:10.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/921: fsync d1b/d23/f4e 0 2024-04-25T23:01:10.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/922: symlink d1b/d8b/d7d/l11c 0 2024-04-25T23:01:10.665 INFO:tasks.workunit.client.0.smithi043.stdout:2/900: write d2/d66/d85/d43/d5d/dee/f130 [855518,126505] 0 2024-04-25T23:01:10.666 INFO:tasks.workunit.client.0.smithi043.stdout:2/901: write d2/d66/d85/d43/d5d/da9/fc3 [5065002,84040] 0 2024-04-25T23:01:10.667 INFO:tasks.workunit.client.0.smithi043.stdout:2/902: stat d2/d66/d85/d43/d67/d10c/f116 0 2024-04-25T23:01:10.667 INFO:tasks.workunit.client.0.smithi043.stdout:5/925: sync 2024-04-25T23:01:10.671 INFO:tasks.workunit.client.0.smithi043.stdout:0/923: dwrite d1b/db0/fd2 [0,4194304] 0 2024-04-25T23:01:10.671 INFO:tasks.workunit.client.0.smithi043.stdout:1/975: dread d0/d2f/d4b/d8f/fe1 [0,4194304] 0 2024-04-25T23:01:10.673 INFO:tasks.workunit.client.0.smithi043.stdout:0/924: dread - d1b/d23/d7b/da6/dcb/f115 zero size 2024-04-25T23:01:10.673 INFO:tasks.workunit.client.0.smithi043.stdout:6/895: dread d1/d2a/db5/dcb/fff [0,4194304] 0 2024-04-25T23:01:10.675 INFO:tasks.workunit.client.0.smithi043.stdout:0/925: mkdir d1b/d23/d7b/da6/dce/d11d 0 2024-04-25T23:01:10.675 INFO:tasks.workunit.client.0.smithi043.stdout:6/896: write d1/d5/d3b/d4c/d1a/f2e [1078923,46661] 0 2024-04-25T23:01:10.676 INFO:tasks.workunit.client.0.smithi043.stdout:5/926: dwrite d0/d2c/d39/d1c/f123 [0,4194304] 0 2024-04-25T23:01:10.676 INFO:tasks.workunit.client.0.smithi043.stdout:2/903: dwrite d2/d66/d85/d43/d67/db3/d13/d40/f51 [0,4194304] 0 2024-04-25T23:01:10.677 INFO:tasks.workunit.client.0.smithi043.stdout:5/927: dread - d0/d6a/fcd zero size 2024-04-25T23:01:10.678 INFO:tasks.workunit.client.0.smithi043.stdout:0/926: creat d1b/d31/d3c/d50/f11e x:0 0 0 2024-04-25T23:01:10.678 INFO:tasks.workunit.client.0.smithi043.stdout:2/904: truncate d2/d66/d85/d43/d67/db3/f12e 612851 0 2024-04-25T23:01:10.680 INFO:tasks.workunit.client.0.smithi043.stdout:0/927: write d1b/d23/f3e [2593453,85160] 0 2024-04-25T23:01:10.681 INFO:tasks.workunit.client.0.smithi043.stdout:0/928: chown d1b/d31/db1 816 1 2024-04-25T23:01:10.683 INFO:tasks.workunit.client.0.smithi043.stdout:2/905: dread d2/d66/d85/d43/fc4 [0,4194304] 0 2024-04-25T23:01:10.683 INFO:tasks.workunit.client.0.smithi043.stdout:1/976: dwrite d0/d86/d10d/d117/f119 [0,4194304] 0 2024-04-25T23:01:10.684 INFO:tasks.workunit.client.0.smithi043.stdout:8/786: sync 2024-04-25T23:01:10.685 INFO:tasks.workunit.client.0.smithi043.stdout:1/977: truncate d0/d3c/f62 4755668 0 2024-04-25T23:01:10.686 INFO:tasks.workunit.client.0.smithi043.stdout:8/787: mknod d3/d4/db/d4e/d5c/d59/db7/c104 0 2024-04-25T23:01:10.686 INFO:tasks.workunit.client.0.smithi043.stdout:2/906: rename d2/d66/l12d to d2/d66/d85/d43/d5d/da9/dd7/da3/d105/l132 0 2024-04-25T23:01:10.686 INFO:tasks.workunit.client.0.smithi043.stdout:1/978: unlink d0/dce/cdf 0 2024-04-25T23:01:10.686 INFO:tasks.workunit.client.0.smithi043.stdout:6/897: dwrite d1/d5/d3b/d4c/d21/d55/fb2 [0,4194304] 0 2024-04-25T23:01:10.687 INFO:tasks.workunit.client.0.smithi043.stdout:2/907: write d2/d66/d85/d43/d67/d10c/f116 [486641,116272] 0 2024-04-25T23:01:10.688 INFO:tasks.workunit.client.0.smithi043.stdout:6/898: write d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/fc6 [500068,67509] 0 2024-04-25T23:01:10.689 INFO:tasks.workunit.client.0.smithi043.stdout:1/979: rmdir d0/d2f/deb 39 2024-04-25T23:01:10.689 INFO:tasks.workunit.client.0.smithi043.stdout:8/788: rename d3/d4/db/d14/dcc/df5 to d3/d4/db/d14/da5/d105 0 2024-04-25T23:01:10.689 INFO:tasks.workunit.client.0.smithi043.stdout:0/929: dwrite d1b/d55/f6d [0,4194304] 0 2024-04-25T23:01:10.690 INFO:tasks.workunit.client.0.smithi043.stdout:6/899: write d1/d5/d3b/d4c/d21/d38/d99/f10e [647447,44176] 0 2024-04-25T23:01:10.691 INFO:tasks.workunit.client.0.smithi043.stdout:0/930: truncate d1b/d8b/d7d/f114 173743 0 2024-04-25T23:01:10.691 INFO:tasks.workunit.client.0.smithi043.stdout:2/908: truncate d2/d66/d85/d43/d67/db3/f42 1456093 0 2024-04-25T23:01:10.691 INFO:tasks.workunit.client.0.smithi043.stdout:8/789: stat d3/d4/db/d4e/d8b/d9f/c4d 0 2024-04-25T23:01:10.691 INFO:tasks.workunit.client.0.smithi043.stdout:0/931: chown d1b/fa4 139 1 2024-04-25T23:01:10.691 INFO:tasks.workunit.client.0.smithi043.stdout:6/900: write d1/d5/d3b/d4c/f58 [1044400,35750] 0 2024-04-25T23:01:10.692 INFO:tasks.workunit.client.0.smithi043.stdout:2/909: dread - d2/d66/d85/d43/d67/d8d/ffc zero size 2024-04-25T23:01:10.693 INFO:tasks.workunit.client.0.smithi043.stdout:2/910: chown d2/d66/d85/d76/f91 23409661 1 2024-04-25T23:01:10.693 INFO:tasks.workunit.client.0.smithi043.stdout:6/901: fsync d1/d5/d3b/d4c/d21/d38/f87 0 2024-04-25T23:01:10.693 INFO:tasks.workunit.client.0.smithi043.stdout:0/932: rename d1b/d31/d3c/d50/f11e to d1b/db0/f11f 0 2024-04-25T23:01:10.694 INFO:tasks.workunit.client.0.smithi043.stdout:8/790: write d3/d4/db/d14/da5/d105/f27 [3715134,82867] 0 2024-04-25T23:01:10.694 INFO:tasks.workunit.client.0.smithi043.stdout:6/902: read - d1/d2a/db5/dc4/dc9/d10b/f110 zero size 2024-04-25T23:01:10.697 INFO:tasks.workunit.client.0.smithi043.stdout:2/911: link d2/d66/d85/d43/d67/db3/l70 d2/d66/d85/d43/d67/db3/d110/l133 0 2024-04-25T23:01:10.697 INFO:tasks.workunit.client.0.smithi043.stdout:9/991: dread d8/de/d12/d16/d24/dbe/dc6/d2f/d84/d69/f116 [0,4194304] 0 2024-04-25T23:01:10.698 INFO:tasks.workunit.client.0.smithi043.stdout:1/980: dwrite d0/d2f/d11a/d144/f152 [0,4194304] 0 2024-04-25T23:01:10.698 INFO:tasks.workunit.client.0.smithi043.stdout:8/791: link d3/d4/d6d/ca8 d3/d4/db/d4e/d5c/d59/d61/c106 0 2024-04-25T23:01:10.699 INFO:tasks.workunit.client.0.smithi043.stdout:1/981: symlink d0/d9/d63/l164 0 2024-04-25T23:01:10.699 INFO:tasks.workunit.client.0.smithi043.stdout:9/992: rmdir d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9 39 2024-04-25T23:01:10.700 INFO:tasks.workunit.client.0.smithi043.stdout:1/982: chown d0/d86/d10d/d117 1943937 1 2024-04-25T23:01:10.700 INFO:tasks.workunit.client.0.smithi043.stdout:9/993: mkdir d8/de/d44/d65/d103/d152 0 2024-04-25T23:01:10.701 INFO:tasks.workunit.client.0.smithi043.stdout:1/983: truncate d0/d2f/f116 602063 0 2024-04-25T23:01:10.702 INFO:tasks.workunit.client.0.smithi043.stdout:8/792: link d3/d4/db/d14/d56/d5d/f63 d3/d4/db/d4e/d5c/d59/d61/d97/dc3/f107 0 2024-04-25T23:01:10.703 INFO:tasks.workunit.client.0.smithi043.stdout:1/984: creat d0/d86/d10b/f165 x:0 0 0 2024-04-25T23:01:10.704 INFO:tasks.workunit.client.0.smithi043.stdout:9/994: rename d8/de/d44/d47/l7d to d8/de/d12/d16/l153 0 2024-04-25T23:01:10.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/903: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/f6e [0,4194304] 0 2024-04-25T23:01:10.705 INFO:tasks.workunit.client.0.smithi043.stdout:8/793: write d3/d4/db/d4e/d8b/d9f/f3b [4407030,119025] 0 2024-04-25T23:01:10.705 INFO:tasks.workunit.client.0.smithi043.stdout:2/912: dwrite d2/d66/d85/d43/d5d/da9/dd7/db9/f112 [0,4194304] 0 2024-04-25T23:01:10.708 INFO:tasks.workunit.client.0.smithi043.stdout:1/985: rename d0/d9/d63/c8c to d0/d2f/d11a/c166 0 2024-04-25T23:01:10.708 INFO:tasks.workunit.client.0.smithi043.stdout:9/995: creat d8/de/d44/d65/d103/d142/f154 x:0 0 0 2024-04-25T23:01:10.708 INFO:tasks.workunit.client.0.smithi043.stdout:8/794: fdatasync d3/d4/d7c/d92/d62/fcb 0 2024-04-25T23:01:10.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/986: mkdir d0/d86/d10d/d167 0 2024-04-25T23:01:10.709 INFO:tasks.workunit.client.0.smithi043.stdout:2/913: symlink d2/d66/d85/d43/d5d/da9/dd7/l134 0 2024-04-25T23:01:10.709 INFO:tasks.workunit.client.0.smithi043.stdout:9/996: readlink d8/de/d44/d47/l86 0 2024-04-25T23:01:10.710 INFO:tasks.workunit.client.0.smithi043.stdout:1/987: symlink d0/l168 0 2024-04-25T23:01:10.710 INFO:tasks.workunit.client.0.smithi043.stdout:8/795: creat d3/d4/db/d14/d56/d5d/f108 x:0 0 0 2024-04-25T23:01:10.710 INFO:tasks.workunit.client.0.smithi043.stdout:2/914: fdatasync d2/d66/d85/d43/d67/d8d/f79 0 2024-04-25T23:01:10.711 INFO:tasks.workunit.client.0.smithi043.stdout:1/988: write d0/f72 [678114,75363] 0 2024-04-25T23:01:10.712 INFO:tasks.workunit.client.0.smithi043.stdout:2/915: creat d2/d66/d85/d76/d97/f135 x:0 0 0 2024-04-25T23:01:10.712 INFO:tasks.workunit.client.0.smithi043.stdout:8/796: write d3/d4/db/d4e/d5c/fe4 [817608,75644] 0 2024-04-25T23:01:10.712 INFO:tasks.workunit.client.0.smithi043.stdout:9/997: getdents d8/de/d12/d7a 0 2024-04-25T23:01:10.712 INFO:tasks.workunit.client.0.smithi043.stdout:1/989: symlink d0/d9/d63/d12e/l169 0 2024-04-25T23:01:10.713 INFO:tasks.workunit.client.0.smithi043.stdout:6/904: dwrite d1/d5/d3b/d4c/d21/d38/de6/f112 [0,4194304] 0 2024-04-25T23:01:10.713 INFO:tasks.workunit.client.0.smithi043.stdout:0/933: read d1b/d23/d39/d90/fde [261101,53383] 0 2024-04-25T23:01:10.714 INFO:tasks.workunit.client.0.smithi043.stdout:1/990: rmdir d0/d9/ddc/de6 39 2024-04-25T23:01:10.714 INFO:tasks.workunit.client.0.smithi043.stdout:0/934: write d1b/d31/f81 [693542,124270] 0 2024-04-25T23:01:10.714 INFO:tasks.workunit.client.0.smithi043.stdout:9/998: fdatasync d8/de/d44/d47/f10c 0 2024-04-25T23:01:10.714 INFO:tasks.workunit.client.0.smithi043.stdout:8/797: mkdir d3/d4/db/d14/d56/d5d/d9c/d109 0 2024-04-25T23:01:10.715 INFO:tasks.workunit.client.0.smithi043.stdout:0/935: stat d1b/d23/d7b 0 2024-04-25T23:01:10.715 INFO:tasks.workunit.client.0.smithi043.stdout:6/905: unlink d1/d5/d3b/d4c/d21/d38/de6/f112 0 2024-04-25T23:01:10.715 INFO:tasks.workunit.client.0.smithi043.stdout:2/916: chown d2/d66/d85/d43/d5d/da9/dd7/da3/l117 7 1 2024-04-25T23:01:10.716 INFO:tasks.workunit.client.0.smithi043.stdout:8/798: mkdir d3/d4/d6d/d10a 0 2024-04-25T23:01:10.717 INFO:tasks.workunit.client.0.smithi043.stdout:9/999: creat d8/de/d12/d16/d24/dbe/dc6/d2f/d84/dc9/d115/f155 x:0 0 0 2024-04-25T23:01:10.718 INFO:tasks.workunit.client.0.smithi043.stdout:8/799: mknod d3/d4/db/d14/d56/d5d/d9c/c10b 0 2024-04-25T23:01:10.720 INFO:tasks.workunit.client.0.smithi043.stdout:1/991: dread d0/d2f/d4b/da6/fe7 [0,4194304] 0 2024-04-25T23:01:10.722 INFO:tasks.workunit.client.0.smithi043.stdout:0/936: dwrite d1b/db0/fd5 [0,4194304] 0 2024-04-25T23:01:10.722 INFO:tasks.workunit.client.0.smithi043.stdout:8/800: rename d3/d4/db/d4e/d8b/d9f/c2f to d3/d4/db/d4e/d5c/c10c 0 2024-04-25T23:01:10.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/917: dwrite d2/d66/d85/d76/d97/d77/fd5 [0,4194304] 0 2024-04-25T23:01:10.723 INFO:tasks.workunit.client.0.smithi043.stdout:0/937: write d1b/db0/f107 [109787,130316] 0 2024-04-25T23:01:10.723 INFO:tasks.workunit.client.0.smithi043.stdout:8/801: rmdir d3/d4/db 39 2024-04-25T23:01:10.724 INFO:tasks.workunit.client.0.smithi043.stdout:2/918: dread - d2/d66/d85/fbb zero size 2024-04-25T23:01:10.724 INFO:tasks.workunit.client.0.smithi043.stdout:0/938: write d1b/db0/f113 [770179,123926] 0 2024-04-25T23:01:10.730 INFO:tasks.workunit.client.0.smithi043.stdout:0/939: dwrite d1b/f40 [0,4194304] 0 2024-04-25T23:01:10.732 INFO:tasks.workunit.client.0.smithi043.stdout:0/940: mkdir d1b/d23/d7a/d120 0 2024-04-25T23:01:10.732 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:10.730+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:10.733 INFO:tasks.workunit.client.0.smithi043.stdout:0/941: rmdir d1b/d23/d39/d90 39 2024-04-25T23:01:10.742 INFO:tasks.workunit.client.0.smithi043.stdout:6/906: write d1/d5/d3b/d4c/d21/d55/d68/f9e [841336,55248] 0 2024-04-25T23:01:10.744 INFO:tasks.workunit.client.0.smithi043.stdout:2/919: truncate d2/d66/d85/d43/d5d/da9/dd7/fb2 2474968 0 2024-04-25T23:01:10.745 INFO:tasks.workunit.client.0.smithi043.stdout:8/802: chown d3/d4/db/d4e/d5c/d59/d61/d97/dc3 291 1 2024-04-25T23:01:10.745 INFO:tasks.workunit.client.0.smithi043.stdout:2/920: creat d2/d66/d85/d43/d5d/da9/dd7/da0/f136 x:0 0 0 2024-04-25T23:01:10.746 INFO:tasks.workunit.client.0.smithi043.stdout:6/907: creat d1/d5/d3b/d4c/d21/d55/d68/f12b x:0 0 0 2024-04-25T23:01:10.746 INFO:tasks.workunit.client.0.smithi043.stdout:5/928: dread d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f65 [0,4194304] 0 2024-04-25T23:01:10.746 INFO:tasks.workunit.client.0.smithi043.stdout:8/803: chown d3/d4/db/d4e/d5c/d2e/d5e/fec 8990 1 2024-04-25T23:01:10.747 INFO:tasks.workunit.client.0.smithi043.stdout:5/929: mknod d0/d2c/c12a 0 2024-04-25T23:01:10.747 INFO:tasks.workunit.client.0.smithi043.stdout:2/921: read - d2/d66/d85/d43/d5d/dee/fd0 zero size 2024-04-25T23:01:10.748 INFO:tasks.workunit.client.0.smithi043.stdout:5/930: creat d0/d22/f12b x:0 0 0 2024-04-25T23:01:10.748 INFO:tasks.workunit.client.0.smithi043.stdout:2/922: symlink d2/d66/d85/d43/d5d/da9/l137 0 2024-04-25T23:01:10.748 INFO:tasks.workunit.client.0.smithi043.stdout:5/931: chown d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62 28 1 2024-04-25T23:01:10.749 INFO:tasks.workunit.client.0.smithi043.stdout:5/932: chown d0/c10 6705 1 2024-04-25T23:01:10.751 INFO:tasks.workunit.client.0.smithi043.stdout:1/992: dread d0/d9/f80 [0,4194304] 0 2024-04-25T23:01:10.752 INFO:tasks.workunit.client.0.smithi043.stdout:6/908: dwrite d1/dc8/ff2 [0,4194304] 0 2024-04-25T23:01:10.752 INFO:tasks.workunit.client.0.smithi043.stdout:1/993: dread - d0/d2f/deb/ff2 zero size 2024-04-25T23:01:10.753 INFO:tasks.workunit.client.0.smithi043.stdout:6/909: readlink d1/d5/d3b/d4c/d21/d55/d6d/d96/l5f 0 2024-04-25T23:01:10.755 INFO:tasks.workunit.client.0.smithi043.stdout:1/994: creat d0/d2f/d11a/f16a x:0 0 0 2024-04-25T23:01:10.757 INFO:tasks.workunit.client.0.smithi043.stdout:5/933: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/f74 [0,4194304] 0 2024-04-25T23:01:10.761 INFO:tasks.workunit.client.0.smithi043.stdout:8/804: dwrite d3/d4/d7c/d92/d62/fa9 [0,4194304] 0 2024-04-25T23:01:10.762 INFO:tasks.workunit.client.0.smithi043.stdout:6/910: dwrite d1/d5/d3b/d4c/d21/d55/fba [0,4194304] 0 2024-04-25T23:01:10.765 INFO:tasks.workunit.client.0.smithi043.stdout:1/995: dwrite d0/d86/d10d/d117/d4f/f142 [0,4194304] 0 2024-04-25T23:01:10.765 INFO:tasks.workunit.client.0.smithi043.stdout:8/805: creat d3/d4/d7c/f10d x:0 0 0 2024-04-25T23:01:10.767 INFO:tasks.workunit.client.0.smithi043.stdout:8/806: mkdir d3/d4/db/d10e 0 2024-04-25T23:01:10.768 INFO:tasks.workunit.client.0.smithi043.stdout:5/934: dwrite d0/d2c/f6b [0,4194304] 0 2024-04-25T23:01:10.768 INFO:tasks.workunit.client.0.smithi043.stdout:1/996: truncate d0/d86/d10d/d117/d105/f112 823482 0 2024-04-25T23:01:10.769 INFO:tasks.workunit.client.0.smithi043.stdout:0/942: dread d1b/d31/d3c/d50/f9b [0,4194304] 0 2024-04-25T23:01:10.769 INFO:tasks.workunit.client.0.smithi043.stdout:0/943: sync 2024-04-25T23:01:10.770 INFO:tasks.workunit.client.0.smithi043.stdout:5/935: readlink d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d62/l10d 0 2024-04-25T23:01:10.771 INFO:tasks.workunit.client.0.smithi043.stdout:1/997: creat d0/d86/d10d/d117/dd7/f16b x:0 0 0 2024-04-25T23:01:10.773 INFO:tasks.workunit.client.0.smithi043.stdout:6/911: dwrite d1/d5/d3b/d62/f73 [4194304,4194304] 0 2024-04-25T23:01:10.773 INFO:tasks.workunit.client.0.smithi043.stdout:1/998: mknod d0/d86/daa/c16c 0 2024-04-25T23:01:10.773 INFO:tasks.workunit.client.0.smithi043.stdout:5/936: symlink d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/l12c 0 2024-04-25T23:01:10.774 INFO:tasks.workunit.client.0.smithi043.stdout:1/999: write d0/d2f/deb/f11c [564042,116841] 0 2024-04-25T23:01:10.776 INFO:tasks.workunit.client.0.smithi043.stdout:5/937: getdents d0/d2c/d39/d1c/d25/d7a/d41/d47/d81 0 2024-04-25T23:01:10.778 INFO:tasks.workunit.client.0.smithi043.stdout:8/807: dwrite d3/d4/db/d14/fe3 [0,4194304] 0 2024-04-25T23:01:10.779 INFO:tasks.workunit.client.0.smithi043.stdout:8/808: fsync d3/d4/db/d4e/d8b/d9f/d33/db0/feb 0 2024-04-25T23:01:10.783 INFO:tasks.workunit.client.0.smithi043.stdout:5/938: dwrite d0/f17 [4194304,4194304] 0 2024-04-25T23:01:10.784 INFO:tasks.workunit.client.0.smithi043.stdout:5/939: mkdir d0/d2c/d12d 0 2024-04-25T23:01:10.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/944: dwrite d1b/d31/d3c/d72/f78 [0,4194304] 0 2024-04-25T23:01:10.785 INFO:tasks.workunit.client.0.smithi043.stdout:5/940: write d0/f9d [3071549,3717] 0 2024-04-25T23:01:10.785 INFO:tasks.workunit.client.0.smithi043.stdout:0/945: symlink d1b/dea/l121 0 2024-04-25T23:01:10.786 INFO:tasks.workunit.client.0.smithi043.stdout:8/809: dwrite d3/d4/db/d4e/d8b/d9f/d33/f9a [0,4194304] 0 2024-04-25T23:01:10.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/810: chown d3/d4/db/l23 3888395 1 2024-04-25T23:01:10.788 INFO:tasks.workunit.client.0.smithi043.stdout:5/941: fdatasync d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/d119/fdc 0 2024-04-25T23:01:10.789 INFO:tasks.workunit.client.0.smithi043.stdout:5/942: dread - d0/d2c/d39/d1c/d25/d7a/d92/fdf zero size 2024-04-25T23:01:10.790 INFO:tasks.workunit.client.0.smithi043.stdout:8/811: creat d3/d4/db/d4e/d5c/d59/d61/d97/dc3/f10f x:0 0 0 2024-04-25T23:01:10.790 INFO:tasks.workunit.client.0.smithi043.stdout:8/812: chown d3 4757 1 2024-04-25T23:01:10.795 INFO:tasks.workunit.client.0.smithi043.stdout:5/943: dwrite d0/d2c/d39/d63/de7/f126 [0,4194304] 0 2024-04-25T23:01:10.800 INFO:tasks.workunit.client.0.smithi043.stdout:8/813: write d3/d4/db/d14/d56/d5d/f63 [3778010,10778] 0 2024-04-25T23:01:10.802 INFO:tasks.workunit.client.0.smithi043.stdout:8/814: getdents d3/d4/d7c/d92/d62 0 2024-04-25T23:01:10.802 INFO:tasks.workunit.client.0.smithi043.stdout:8/815: sync 2024-04-25T23:01:10.802 INFO:tasks.workunit.client.0.smithi043.stdout:2/923: dread d2/d66/d85/d43/d67/db3/d13/f6e [0,4194304] 0 2024-04-25T23:01:10.804 INFO:tasks.workunit.client.0.smithi043.stdout:8/816: rename d3/d4/db/d4e/d8b/d9f/db4 to d3/d4/db/d4e/d8b/d9f/d110 0 2024-04-25T23:01:10.807 INFO:tasks.workunit.client.0.smithi043.stdout:8/817: dread d3/d4/db/d14/fe3 [0,4194304] 0 2024-04-25T23:01:10.807 INFO:tasks.workunit.client.0.smithi043.stdout:6/912: dread d1/d5/d3b/d4c/f11 [0,4194304] 0 2024-04-25T23:01:10.808 INFO:tasks.workunit.client.0.smithi043.stdout:8/818: stat d3/d4/db/d14/d56/d5d 0 2024-04-25T23:01:10.808 INFO:tasks.workunit.client.0.smithi043.stdout:2/924: dwrite d2/d66/d85/d43/d67/db3/f47 [0,4194304] 0 2024-04-25T23:01:10.808 INFO:tasks.workunit.client.0.smithi043.stdout:6/913: chown d1/d2a/db5/dc4/f103 7 1 2024-04-25T23:01:10.809 INFO:tasks.workunit.client.0.smithi043.stdout:2/925: write d2/d66/d85/f37 [212770,102768] 0 2024-04-25T23:01:10.810 INFO:tasks.workunit.client.0.smithi043.stdout:6/914: chown d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/ld7 15169747 1 2024-04-25T23:01:10.810 INFO:tasks.workunit.client.0.smithi043.stdout:6/915: mknod d1/d5/d3b/d4c/d21/c12c 0 2024-04-25T23:01:10.811 INFO:tasks.workunit.client.0.smithi043.stdout:2/926: creat d2/d66/d85/d43/d67/ddd/f138 x:0 0 0 2024-04-25T23:01:10.812 INFO:tasks.workunit.client.0.smithi043.stdout:2/927: readlink d2/d66/d85/d43/d67/db3/d13/d40/l11b 0 2024-04-25T23:01:10.812 INFO:tasks.workunit.client.0.smithi043.stdout:6/916: symlink d1/d2a/dd5/d122/l12d 0 2024-04-25T23:01:10.813 INFO:tasks.workunit.client.0.smithi043.stdout:2/928: readlink d2/d66/d85/d76/d97/d77/d115/l11f 0 2024-04-25T23:01:10.814 INFO:tasks.workunit.client.0.smithi043.stdout:8/819: dwrite d3/d4/db/d4e/d5c/d59/d61/fa0 [0,4194304] 0 2024-04-25T23:01:10.815 INFO:tasks.workunit.client.0.smithi043.stdout:2/929: fdatasync d2/d66/d85/d43/d5d/da9/dd7/df7/ffe 0 2024-04-25T23:01:10.816 INFO:tasks.workunit.client.0.smithi043.stdout:8/820: getdents d3/d4/db/d14/d56/d5d/d9c/d109 0 2024-04-25T23:01:10.816 INFO:tasks.workunit.client.0.smithi043.stdout:2/930: write d2/d66/d85/d43/d67/db3/f27 [690868,31261] 0 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:15150 4.2b e55/17 4:d5a2f2a8:::10000003161.00000000:head v 55'209, mlcod=55'207)", 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:10.794169+0000", 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.022670111, 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.022689562, 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:10.817 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.794169+0000", 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.794169+0000", 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.794170+0000", 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5820000000000001e-06 2024-04-25T23:01:10.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.804441+0000", 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010270591000000001 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.804465+0000", 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4102999999999999e-05 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.804502+0000", 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.7486e-05 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.804591+0000", 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8258999999999996e-05 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.804626+0000", 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.5129999999999997e-05 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:15153 4.28 4:163bf742:::1000000369a.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:10.800136+0000", 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.016702241, 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.016763100999999999, 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 15153 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.821 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800136+0000", 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800136+0000", 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800137+0000", 2024-04-25T23:01:10.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.5000000000000003e-07 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.806279+0000", 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061421389999999996 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.806299+0000", 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9745000000000002e-05 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.806309+0000", 2024-04-25T23:01:10.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0394000000000001e-05 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.806404+0000", 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5014999999999997e-05 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.806509+0000", 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010514900000000001 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:15163 4.17 4:ebab4161:::10000003365.00000000:head [write 212770~102768 [2@375591] in=102768b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:10.810874+0000", 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0059650329999999998, 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0060676799999999998, 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 15163 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.810874+0000", 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.810874+0000", 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.810875+0000", 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1960000000000001e-06 2024-04-25T23:01:10.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.811176+0000", 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000301558 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.811192+0000", 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5400000000000002e-05 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.811200+0000", 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4309999999999994e-06 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.811268+0000", 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7448999999999997e-05 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.811407+0000", 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000139145 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.811562+0000", 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154995 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:10.828 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:15157 4.c e55/17 4:3266ed47:::100000039bf.00000000:head v 55'225, mlcod=55'223)", 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:10.805017+0000", 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.011821692999999999, 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011965382, 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.805017+0000", 2024-04-25T23:01:10.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.805017+0000", 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.805018+0000", 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.830 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.812045+0000", 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.007026816 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.812061+0000", 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5999e-05 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.812069+0000", 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7280000000000001e-06 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.812116+0000", 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.7024000000000002e-05 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.812137+0000", 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0469999999999999e-05 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.832 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:15164 4.6 4:609bbbf5:::10000003345.00000000:head [read 524288~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:10.813741+0000", 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0030976290000000002, 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032745930000000001, 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 15164 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:10.833 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813741+0000", 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813741+0000", 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813743+0000", 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8330000000000001e-06 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.834 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813752+0000", 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.8270000000000004e-06 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813800+0000", 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.816e-05 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813817+0000", 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7010000000000001e-05 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813889+0000", 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.2144999999999995e-05 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.813954+0000", 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5437000000000004e-05 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:15148 4.b 4:d05f85ee:::100000031ca.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:10.793351+0000", 2024-04-25T23:01:10.836 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.023487401000000001, 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.023701674999999998, 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 15148 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.793351+0000", 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.837 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.793351+0000", 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.793353+0000", 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3680000000000001e-06 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800031+0000", 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0066786709999999997 2024-04-25T23:01:10.838 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800057+0000", 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.6007e-05 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800068+0000", 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0722e-05 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:10.839 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800185+0000", 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011728 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800351+0000", 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016584999999999999 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.800457+0000", 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000105529 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:10.811351+0000", 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010893776000000001 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 6 2024-04-25T23:01:10.841 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:10.843 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:8/821: readlink d3/d4/d7c/d92/l75 0 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:2/931: readlink d2/d66/d85/d43/d5d/da9/ld1 0 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:8/822: symlink d3/d4/db/d4e/d8b/d9f/d33/df6/l111 0 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:2/932: chown d2/d66/d85/d43/d67/db3/d13/d40/l69 57 1 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:8/823: getdents d3/d4/d7c/d92/d62 0 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:5/944: fsync d0/d2c/d39/d63/de7/f126 0 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:6/917: getdents d1/d2a/dd5/d122 0 2024-04-25T23:01:10.846 INFO:tasks.workunit.client.0.smithi043.stdout:5/945: dread - d0/d2c/f109 zero size 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/946: fsync d0/d2c/d39/d1c/d25/d7a/d2d/df0/df3/f121 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:8/824: link d3/d4/db/d4e/d5c/d59/c100 d3/d4/db/d4e/d5c/d59/d61/d66/c112 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:2/933: dwrite d2/d66/d85/d43/d5d/dee/fd0 [0,4194304] 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:8/825: write d3/d4/db/def/ff4 [983320,105158] 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:2/934: symlink d2/d66/d85/d43/d5d/da9/l139 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:2/935: mknod d2/d66/d85/d43/d5d/dee/c13a 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/947: dwrite d0/f5 [4194304,4194304] 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:2/936: creat d2/d66/d85/d76/d97/d77/da2/db7/f13b x:0 0 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/948: write d0/d22/d95/fc3 [2471000,110337] 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:2/937: fsync d2/d66/d85/d76/d97/d77/fd5 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:0/946: dread d1b/d31/d3c/f52 [0,4194304] 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:2/938: write d2/d66/d85/d76/fc9 [140305,26881] 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:0/947: creat d1b/dea/f122 x:0 0 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/949: link d0/d2c/d39/d1c/d25/d7a/d2d/l52 d0/d2c/d39/d1c/d25/d7a/d41/d4a/d85/d119/l12e 0 2024-04-25T23:01:10.847 INFO:tasks.workunit.client.0.smithi043.stdout:5/950: truncate d0/d2c/d39/d1c/d5e/f77 5051185 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/948: truncate d1b/d23/d7a/f98 1903494 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/949: readlink d1b/d23/d7a/l9a 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/950: chown d1b/d7f/c95 275 1 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/951: mkdir d1b/d31/d3c/d123 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:2/939: dwrite d2/d66/d85/d76/d97/d77/da2/db7/f10f [0,4194304] 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:5/951: truncate d0/f17 2850786 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/952: link d1b/d8b/c68 d1b/d23/d39/d90/df4/c124 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:2/940: write d2/d66/d85/d76/d97/fcd [530169,78168] 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:5/952: rmdir d0/d6a 39 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/953: fsync d1b/d23/d39/d90/df4/fe4 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/954: creat d1b/d31/f125 x:0 0 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:2/941: dread d2/d66/d85/d43/d67/db3/f12e [0,4194304] 0 2024-04-25T23:01:10.848 INFO:tasks.workunit.client.0.smithi043.stdout:2/942: getdents d2/d66/d85/d76/d97/d77 0 2024-04-25T23:01:10.849 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:10.840+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:10.849 INFO:tasks.workunit.client.0.smithi043.stdout:8/826: dread d3/d4/db/f4a [0,4194304] 0 2024-04-25T23:01:10.849 INFO:tasks.workunit.client.0.smithi043.stdout:0/955: dwrite d1b/db0/fd2 [0,4194304] 0 2024-04-25T23:01:10.850 INFO:tasks.workunit.client.0.smithi043.stdout:0/956: write d1b/d23/d7b/da6/db7/db9/fcd [1706260,66755] 0 2024-04-25T23:01:10.851 INFO:tasks.workunit.client.0.smithi043.stdout:2/943: dwrite d2/d66/d85/f36 [0,4194304] 0 2024-04-25T23:01:10.851 INFO:tasks.workunit.client.0.smithi043.stdout:0/957: dread - d1b/d23/d91/ddd/f109 zero size 2024-04-25T23:01:10.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/827: unlink d3/d4/db/d14/c8e 0 2024-04-25T23:01:10.853 INFO:tasks.workunit.client.0.smithi043.stdout:0/958: symlink d1b/d8b/dc0/l126 0 2024-04-25T23:01:10.853 INFO:tasks.workunit.client.0.smithi043.stdout:8/828: rmdir d3/d4/db/d14/d56/d5d/d9c/da7 39 2024-04-25T23:01:10.853 INFO:tasks.workunit.client.0.smithi043.stdout:2/944: getdents d2/d66/d121 0 2024-04-25T23:01:10.855 INFO:tasks.workunit.client.0.smithi043.stdout:8/829: symlink d3/d4/db/d4e/d8b/d9f/d110/l113 0 2024-04-25T23:01:10.855 INFO:tasks.workunit.client.0.smithi043.stdout:6/918: dread d1/d5/d3b/f44 [0,4194304] 0 2024-04-25T23:01:10.857 INFO:tasks.workunit.client.0.smithi043.stdout:8/830: symlink d3/d4/db/d4e/d5c/d59/d61/d97/dcd/l114 0 2024-04-25T23:01:10.857 INFO:tasks.workunit.client.0.smithi043.stdout:6/919: write d1/d5/d3b/f44 [2635095,120812] 0 2024-04-25T23:01:10.859 INFO:tasks.workunit.client.0.smithi043.stdout:0/959: dwrite d1b/d23/d39/f44 [0,4194304] 0 2024-04-25T23:01:10.860 INFO:tasks.workunit.client.0.smithi043.stdout:2/945: truncate d2/d66/d85/d43/d5d/da9/dd7/df7/fab 1238911 0 2024-04-25T23:01:10.860 INFO:tasks.workunit.client.0.smithi043.stdout:8/831: rename d3/d4/db/d4e/d5c/d2e to d3/d4/db/d4e/d5c/d59/d61/d115 0 2024-04-25T23:01:10.860 INFO:tasks.workunit.client.0.smithi043.stdout:0/960: unlink d1b/d31/d3c/c93 0 2024-04-25T23:01:10.861 INFO:tasks.workunit.client.0.smithi043.stdout:8/832: creat d3/d4/db/d14/da5/f116 x:0 0 0 2024-04-25T23:01:10.861 INFO:tasks.workunit.client.0.smithi043.stdout:2/946: mknod d2/d66/d85/d43/d5d/da9/dd7/da0/d12a/c13c 0 2024-04-25T23:01:10.862 INFO:tasks.workunit.client.0.smithi043.stdout:2/947: chown d2/d66/cf3 530228740 1 2024-04-25T23:01:10.863 INFO:tasks.workunit.client.0.smithi043.stdout:2/948: unlink d2/d66/d85/d43/d5d/da9/dd7/da3/l117 0 2024-04-25T23:01:10.864 INFO:tasks.workunit.client.0.smithi043.stdout:2/949: unlink d2/d66/d85/d76/d97/f49 0 2024-04-25T23:01:10.867 INFO:tasks.workunit.client.0.smithi043.stdout:5/953: sync 2024-04-25T23:01:10.867 INFO:tasks.workunit.client.0.smithi043.stdout:6/920: sync 2024-04-25T23:01:10.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:10.873 INFO:tasks.workunit.client.0.smithi043.stdout:5/954: dwrite d0/d2c/d39/d1c/d25/d7a/d2d/d5f/f53 [0,4194304] 0 2024-04-25T23:01:10.875 INFO:tasks.workunit.client.0.smithi043.stdout:5/955: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/f50 [3042272,128045] 0 2024-04-25T23:01:10.876 INFO:tasks.workunit.client.0.smithi043.stdout:5/956: mkdir d0/d2c/d12d/d12f 0 2024-04-25T23:01:10.877 INFO:tasks.workunit.client.0.smithi043.stdout:2/950: dread d2/d66/d85/d43/d5d/da9/dd7/fb2 [0,4194304] 0 2024-04-25T23:01:10.878 INFO:tasks.workunit.client.0.smithi043.stdout:0/961: sync 2024-04-25T23:01:10.878 INFO:tasks.workunit.client.0.smithi043.stdout:8/833: sync 2024-04-25T23:01:10.878 INFO:tasks.workunit.client.0.smithi043.stdout:5/957: sync 2024-04-25T23:01:10.879 INFO:tasks.workunit.client.0.smithi043.stdout:8/834: readlink d3/d4/db/lb1 0 2024-04-25T23:01:10.879 INFO:tasks.workunit.client.0.smithi043.stdout:2/951: creat d2/d66/d85/d76/d97/d77/da2/f13d x:0 0 0 2024-04-25T23:01:10.879 INFO:tasks.workunit.client.0.smithi043.stdout:0/962: truncate d1b/dea/ff7 522846 0 2024-04-25T23:01:10.880 INFO:tasks.workunit.client.0.smithi043.stdout:5/958: read d0/f17 [2492207,107050] 0 2024-04-25T23:01:10.880 INFO:tasks.workunit.client.0.smithi043.stdout:0/963: rmdir d1b/d23/d7a/dad/df5 39 2024-04-25T23:01:10.880 INFO:tasks.workunit.client.0.smithi043.stdout:2/952: creat d2/d66/d85/d76/d97/d77/da2/db7/f13e x:0 0 0 2024-04-25T23:01:10.880 INFO:tasks.workunit.client.0.smithi043.stdout:5/959: sync 2024-04-25T23:01:10.881 INFO:tasks.workunit.client.0.smithi043.stdout:0/964: write d1b/d23/f2a [1896073,57456] 0 2024-04-25T23:01:10.881 INFO:tasks.workunit.client.0.smithi043.stdout:2/953: write d2/d66/d85/d43/d67/db3/d13/f1e [2938765,55597] 0 2024-04-25T23:01:10.882 INFO:tasks.workunit.client.0.smithi043.stdout:2/954: mkdir d2/d66/d85/d76/d97/d13f 0 2024-04-25T23:01:10.883 INFO:tasks.workunit.client.0.smithi043.stdout:2/955: symlink d2/d66/dc6/l140 0 2024-04-25T23:01:10.886 INFO:tasks.workunit.client.0.smithi043.stdout:5/960: dwrite d0/d2c/f6b [0,4194304] 0 2024-04-25T23:01:10.888 INFO:tasks.workunit.client.0.smithi043.stdout:0/965: dwrite d1b/d23/d91/fe7 [0,4194304] 0 2024-04-25T23:01:10.889 INFO:tasks.workunit.client.0.smithi043.stdout:0/966: chown d1b/d23/f53 191964 1 2024-04-25T23:01:10.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/835: truncate d3/d4/db/d4e/d8b/d9f/f65 1596566 0 2024-04-25T23:01:10.890 INFO:tasks.workunit.client.0.smithi043.stdout:0/967: unlink d1b/d8b/d103/fa8 0 2024-04-25T23:01:10.890 INFO:tasks.workunit.client.0.smithi043.stdout:8/836: rmdir d3/d4/db/d14/d4c 39 2024-04-25T23:01:10.891 INFO:tasks.workunit.client.0.smithi043.stdout:2/956: dwrite d2/d66/d85/d76/fc9 [0,4194304] 0 2024-04-25T23:01:10.891 INFO:tasks.workunit.client.0.smithi043.stdout:8/837: creat d3/d4/d7d/f117 x:0 0 0 2024-04-25T23:01:10.893 INFO:tasks.workunit.client.0.smithi043.stdout:2/957: write d2/d66/d85/d43/d5d/da9/dd7/da0/ff6 [2551377,30965] 0 2024-04-25T23:01:10.893 INFO:tasks.workunit.client.0.smithi043.stdout:8/838: link d3/c8a d3/d4/d6d/d10a/c118 0 2024-04-25T23:01:10.895 INFO:tasks.workunit.client.0.smithi043.stdout:5/961: truncate d0/d2c/d39/f5b 1533716 0 2024-04-25T23:01:10.896 INFO:tasks.workunit.client.0.smithi043.stdout:8/839: link d3/d4/db/d4e/d8b/d9f/c95 d3/d4/db/def/c119 0 2024-04-25T23:01:10.896 INFO:tasks.workunit.client.0.smithi043.stdout:2/958: link d2/d66/d85/d43/d5d/l6c d2/d66/d85/d43/d5d/da9/dd7/da0/l141 0 2024-04-25T23:01:10.897 INFO:tasks.workunit.client.0.smithi043.stdout:2/959: chown d2/d66/d85/d76/d97/d13f 1949 1 2024-04-25T23:01:10.898 INFO:tasks.workunit.client.0.smithi043.stdout:8/840: unlink d3/d4/db/d4e/d8b/d9f/d33/f9a 0 2024-04-25T23:01:10.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/962: link d0/d2c/d39/d1c/d25/d7a/f1e d0/d2c/d39/dc4/f130 0 2024-04-25T23:01:10.899 INFO:tasks.workunit.client.0.smithi043.stdout:2/960: truncate d2/d66/d85/d43/d67/db3/d13/f6e 4440256 0 2024-04-25T23:01:10.899 INFO:tasks.workunit.client.0.smithi043.stdout:8/841: chown d3/d4/db/d4e/d5c/d59/d61/d97/dc3/f10f 41 1 2024-04-25T23:01:10.899 INFO:tasks.workunit.client.0.smithi043.stdout:5/963: getdents d0/d2c/d39/d1c/d101 0 2024-04-25T23:01:10.901 INFO:tasks.workunit.client.0.smithi043.stdout:5/964: getdents d0/d6a 0 2024-04-25T23:01:10.902 INFO:tasks.workunit.client.0.smithi043.stdout:5/965: symlink d0/d2c/d39/d1c/d25/d7a/d2d/df0/l131 0 2024-04-25T23:01:10.904 INFO:tasks.workunit.client.0.smithi043.stdout:5/966: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d10c 0 2024-04-25T23:01:10.906 INFO:tasks.workunit.client.0.smithi043.stdout:8/842: dwrite d3/d4/db/d4e/d5c/d59/d61/d66/f89 [0,4194304] 0 2024-04-25T23:01:10.907 INFO:tasks.workunit.client.0.smithi043.stdout:6/921: dread d1/d5/d3b/f7a [4194304,4194304] 0 2024-04-25T23:01:10.909 INFO:tasks.workunit.client.0.smithi043.stdout:8/843: write d3/d4/db/d4e/d5c/d59/d61/d66/f6f [2760687,113972] 0 2024-04-25T23:01:10.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/961: dwrite d2/d66/d85/d76/d97/f39 [0,4194304] 0 2024-04-25T23:01:10.909 INFO:tasks.workunit.client.0.smithi043.stdout:6/922: symlink d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/l12e 0 2024-04-25T23:01:10.910 INFO:tasks.workunit.client.0.smithi043.stdout:6/923: mkdir d1/d5/d3b/d62/d12f 0 2024-04-25T23:01:10.911 INFO:tasks.workunit.client.0.smithi043.stdout:8/844: write d3/d4/db/d14/f54 [1303064,128860] 0 2024-04-25T23:01:10.911 INFO:tasks.workunit.client.0.smithi043.stdout:2/962: creat d2/d66/d85/d43/d67/db3/d13/d40/f142 x:0 0 0 2024-04-25T23:01:10.912 INFO:tasks.workunit.client.0.smithi043.stdout:6/924: mkdir d1/d2a/db5/dc4/dc9/d130 0 2024-04-25T23:01:10.912 INFO:tasks.workunit.client.0.smithi043.stdout:2/963: read - d2/d66/d85/d43/d5d/da9/dd7/da0/f136 zero size 2024-04-25T23:01:10.912 INFO:tasks.workunit.client.0.smithi043.stdout:8/845: rmdir d3/d4/db/d14/d56/d5d/d9c 39 2024-04-25T23:01:10.914 INFO:tasks.workunit.client.0.smithi043.stdout:2/964: symlink d2/d66/d85/d76/d97/d77/d9a/l143 0 2024-04-25T23:01:10.914 INFO:tasks.workunit.client.0.smithi043.stdout:2/965: chown d2/d66/d85/d43/fc4 8 1 2024-04-25T23:01:10.915 INFO:tasks.workunit.client.0.smithi043.stdout:2/966: truncate d2/d66/d85/d43/d67/d8d/fb8 1109195 0 2024-04-25T23:01:10.916 INFO:tasks.workunit.client.0.smithi043.stdout:8/846: creat d3/d4/db/d4e/d8b/f11a x:0 0 0 2024-04-25T23:01:10.916 INFO:tasks.workunit.client.0.smithi043.stdout:2/967: creat d2/d66/d85/d76/d97/d77/d115/f144 x:0 0 0 2024-04-25T23:01:10.917 INFO:tasks.workunit.client.0.smithi043.stdout:8/847: mknod d3/d4/db/d4e/d5c/d59/d61/d66/c11b 0 2024-04-25T23:01:10.917 INFO:tasks.workunit.client.0.smithi043.stdout:2/968: chown d2/d66/d85/d76/d97/d77/da2/db7/f10f 1816 1 2024-04-25T23:01:10.919 INFO:tasks.workunit.client.0.smithi043.stdout:2/969: link d2/d66/d85/d43/d67/db3/d13/d40/l69 d2/d66/d85/d43/d5d/da9/dd7/da3/l145 0 2024-04-25T23:01:10.920 INFO:tasks.workunit.client.0.smithi043.stdout:2/970: mknod d2/d66/d85/d43/d67/ddd/c146 0 2024-04-25T23:01:10.921 INFO:tasks.workunit.client.0.smithi043.stdout:8/848: dread d3/d4/db/d4e/d5c/d59/d61/d66/f89 [0,4194304] 0 2024-04-25T23:01:10.921 INFO:tasks.workunit.client.0.smithi043.stdout:2/971: symlink d2/d66/d85/d43/d67/d10c/l147 0 2024-04-25T23:01:10.922 INFO:tasks.workunit.client.0.smithi043.stdout:2/972: chown d2/d66/d85/d43/d67/d8d/l1b 1071572776 1 2024-04-25T23:01:10.923 INFO:tasks.workunit.client.0.smithi043.stdout:2/973: mkdir d2/d66/d85/d43/d11d/d148 0 2024-04-25T23:01:10.924 INFO:tasks.workunit.client.0.smithi043.stdout:5/967: truncate d0/d2c/d39/d1c/d25/d7a/d41/f86 990579 0 2024-04-25T23:01:10.924 INFO:tasks.workunit.client.0.smithi043.stdout:6/925: truncate d1/d5/d3b/f3c 3049646 0 2024-04-25T23:01:10.924 INFO:tasks.workunit.client.0.smithi043.stdout:2/974: mkdir d2/d66/d85/d76/d97/d77/d9a/d149 0 2024-04-25T23:01:10.925 INFO:tasks.workunit.client.0.smithi043.stdout:5/968: mknod d0/d2c/d39/d1c/c132 0 2024-04-25T23:01:10.926 INFO:tasks.workunit.client.0.smithi043.stdout:2/975: creat d2/d66/d121/f14a x:0 0 0 2024-04-25T23:01:10.926 INFO:tasks.workunit.client.0.smithi043.stdout:5/969: chown d0/d2c/d39/d1c/d25/d7a/d41/d47 213885514 1 2024-04-25T23:01:10.926 INFO:tasks.workunit.client.0.smithi043.stdout:6/926: creat d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/d9c/dc3/f131 x:0 0 0 2024-04-25T23:01:10.927 INFO:tasks.workunit.client.0.smithi043.stdout:5/970: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b/d102 39 2024-04-25T23:01:10.928 INFO:tasks.workunit.client.0.smithi043.stdout:8/849: dwrite d3/d4/db/d4e/d8b/d91/fad [0,4194304] 0 2024-04-25T23:01:10.928 INFO:tasks.workunit.client.0.smithi043.stdout:2/976: dread d2/d66/d85/d43/d5d/da9/dd7/df7/fab [0,4194304] 0 2024-04-25T23:01:10.929 INFO:tasks.workunit.client.0.smithi043.stdout:2/977: write d2/d66/d85/d43/d67/db3/f4a [1736351,45909] 0 2024-04-25T23:01:10.931 INFO:tasks.workunit.client.0.smithi043.stdout:2/978: rename d2/d66/d85/d43/d5d/da9/dd7/da0/le3 to d2/d66/d85/d76/d97/d77/l14b 0 2024-04-25T23:01:10.934 INFO:tasks.workunit.client.0.smithi043.stdout:5/971: read d0/d2c/d39/d1c/d5e/ffc [74676,1621] 0 2024-04-25T23:01:10.934 INFO:tasks.workunit.client.0.smithi043.stdout:8/850: dwrite d3/d4/db/d4e/d8b/d9f/dd5/ff9 [0,4194304] 0 2024-04-25T23:01:10.935 INFO:tasks.workunit.client.0.smithi043.stdout:2/979: truncate d2/d66/d85/d43/d67/d10c/ffb 305895 0 2024-04-25T23:01:10.936 INFO:tasks.workunit.client.0.smithi043.stdout:2/980: read - d2/d66/d85/f57 zero size 2024-04-25T23:01:10.939 INFO:tasks.workunit.client.0.smithi043.stdout:2/981: dread - d2/d66/d85/d43/d67/faa zero size 2024-04-25T23:01:10.941 INFO:tasks.workunit.client.0.smithi043.stdout:2/982: creat d2/d66/d85/d43/d67/db3/f14c x:0 0 0 2024-04-25T23:01:10.941 INFO:tasks.workunit.client.0.smithi043.stdout:8/851: dwrite d3/d4/db/d14/fe3 [4194304,4194304] 0 2024-04-25T23:01:10.942 INFO:tasks.workunit.client.0.smithi043.stdout:2/983: dread - d2/d66/d85/d76/d97/f10b zero size 2024-04-25T23:01:10.942 INFO:tasks.workunit.client.0.smithi043.stdout:5/972: dwrite d0/d2c/d39/d1c/d25/d7a/f1e [0,4194304] 0 2024-04-25T23:01:10.943 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:10.938+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:10.951 INFO:tasks.workunit.client.0.smithi043.stdout:2/984: dwrite d2/d66/d85/d43/d67/d8d/f119 [0,4194304] 0 2024-04-25T23:01:10.954 INFO:tasks.workunit.client.0.smithi043.stdout:2/985: creat d2/d66/d85/d76/d97/d77/d115/f14d x:0 0 0 2024-04-25T23:01:10.954 INFO:tasks.workunit.client.0.smithi043.stdout:2/986: write d2/f106 [40490,72482] 0 2024-04-25T23:01:10.955 INFO:tasks.workunit.client.0.smithi043.stdout:2/987: mkdir d2/d66/d85/d43/d5d/da9/dd7/da3/d14e 0 2024-04-25T23:01:10.961 INFO:tasks.workunit.client.0.smithi043.stdout:2/988: dwrite d2/d66/d85/d43/d67/db3/d13/fa6 [0,4194304] 0 2024-04-25T23:01:10.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/989: truncate d2/d66/d85/d76/faf 92407 0 2024-04-25T23:01:10.964 INFO:tasks.workunit.client.0.smithi043.stdout:2/990: mkdir d2/d66/d85/d76/d97/d77/da2/db5/d14f 0 2024-04-25T23:01:10.965 INFO:tasks.workunit.client.0.smithi043.stdout:2/991: creat d2/d66/d85/d76/d97/d77/d9a/d149/f150 x:0 0 0 2024-04-25T23:01:10.966 INFO:tasks.workunit.client.0.smithi043.stdout:2/992: symlink d2/d66/d85/l151 0 2024-04-25T23:01:10.966 INFO:tasks.workunit.client.0.smithi043.stdout:2/993: chown d2/d66/d85/d76/d97 101467 1 2024-04-25T23:01:10.968 INFO:tasks.workunit.client.0.smithi043.stdout:2/994: mkdir d2/d66/d85/d43/d67/d8d/d152 0 2024-04-25T23:01:10.969 INFO:tasks.workunit.client.0.smithi043.stdout:2/995: write d2/d66/d85/d43/d5d/da9/dd7/da0/f127 [269036,47807] 0 2024-04-25T23:01:10.970 INFO:tasks.workunit.client.0.smithi043.stdout:5/973: dread d0/d2c/d39/d1c/f55 [0,4194304] 0 2024-04-25T23:01:10.970 INFO:tasks.workunit.client.0.smithi043.stdout:2/996: creat d2/d66/d85/d76/d97/d77/da2/db5/f153 x:0 0 0 2024-04-25T23:01:10.971 INFO:tasks.workunit.client.0.smithi043.stdout:2/997: mknod d2/d66/d85/d43/d5d/da9/dd7/da3/c154 0 2024-04-25T23:01:10.971 INFO:tasks.workunit.client.0.smithi043.stdout:5/974: write d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d91/ffa [4889319,17118] 0 2024-04-25T23:01:10.972 INFO:tasks.workunit.client.0.smithi043.stdout:5/975: mkdir d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d133 0 2024-04-25T23:01:10.976 INFO:tasks.workunit.client.0.smithi043.stdout:5/976: truncate d0/d2c/d39/d1c/d25/d7a/d2d/d5f/ff9 680605 0 2024-04-25T23:01:10.977 INFO:tasks.workunit.client.0.smithi043.stdout:5/977: fsync d0/d2c/d39/d1c/d25/d7a/d2d/d8b/f50 0 2024-04-25T23:01:10.993 INFO:tasks.workunit.client.0.smithi043.stdout:0/968: sync 2024-04-25T23:01:11.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/969: dread d1b/d31/f8a [0,4194304] 0 2024-04-25T23:01:11.012 INFO:tasks.workunit.client.0.smithi043.stdout:0/970: dread - d1b/d8b/d103/fff zero size 2024-04-25T23:01:11.016 INFO:tasks.workunit.client.0.smithi043.stdout:0/971: truncate d1b/d31/f8a 1071216 0 2024-04-25T23:01:11.017 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:11.017 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:11.017 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:11.017 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:11.017 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:0/972: truncate d1b/db0/f113 393505 0 2024-04-25T23:01:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:0/973: chown d1b/d31/d3c/d50/c6f 1739874 1 2024-04-25T23:01:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:0/974: mkdir d1b/d23/d91/d127 0 2024-04-25T23:01:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:0/975: creat d1b/d23/d39/d90/df4/f128 x:0 0 0 2024-04-25T23:01:11.024 INFO:tasks.workunit.client.0.smithi043.stdout:0/976: read d1b/f4a [139378,120683] 0 2024-04-25T23:01:11.025 INFO:tasks.workunit.client.0.smithi043.stdout:0/977: mkdir d1b/d23/dab/dbd/dcc/d129 0 2024-04-25T23:01:11.025 INFO:tasks.workunit.client.0.smithi043.stdout:5/978: sync 2024-04-25T23:01:11.025 INFO:tasks.workunit.client.0.smithi043.stdout:6/927: sync 2024-04-25T23:01:11.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/998: sync 2024-04-25T23:01:11.025 INFO:tasks.workunit.client.0.smithi043.stdout:8/852: sync 2024-04-25T23:01:11.026 INFO:tasks.workunit.client.0.smithi043.stdout:6/928: chown d1/d2a/db5/dcb/fff 0 1 2024-04-25T23:01:11.026 INFO:tasks.workunit.client.0.smithi043.stdout:0/978: mkdir d1b/d23/d7b/da6/dce/d11d/d12a 0 2024-04-25T23:01:11.027 INFO:tasks.workunit.client.0.smithi043.stdout:2/999: symlink d2/d66/d85/d76/d97/d77/da2/db7/dbf/l155 0 2024-04-25T23:01:11.027 INFO:tasks.workunit.client.0.smithi043.stdout:0/979: mkdir d1b/d23/dab/d10f/d12b 0 2024-04-25T23:01:11.028 INFO:tasks.workunit.client.0.smithi043.stdout:6/929: rename d1/d5/d3b/d4c/d21/d55/fb2 to d1/d5/d3b/d62/d123/f132 0 2024-04-25T23:01:11.028 INFO:tasks.workunit.client.0.smithi043.stdout:0/980: readlink d1b/l1c 0 2024-04-25T23:01:11.029 INFO:tasks.workunit.client.0.smithi043.stdout:0/981: mknod d1b/d31/d3c/d72/c12c 0 2024-04-25T23:01:11.029 INFO:tasks.workunit.client.0.smithi043.stdout:6/930: mknod d1/d5/d3b/d4c/d21/d55/d68/d30/dbf/c133 0 2024-04-25T23:01:11.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/931: creat d1/d2a/db5/f134 x:0 0 0 2024-04-25T23:01:11.032 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:11.033 INFO:tasks.workunit.client.0.smithi043.stdout:8/853: dwrite d3/d4/db/d4e/d5c/d59/d61/d97/dcd/fda [0,4194304] 0 2024-04-25T23:01:11.033 INFO:tasks.workunit.client.0.smithi043.stdout:5/979: dread d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/f5c [0,4194304] 0 2024-04-25T23:01:11.033 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:11.034 INFO:tasks.workunit.client.0.smithi043.stdout:8/854: creat d3/d4/db/d14/d56/d5d/f11c x:0 0 0 2024-04-25T23:01:11.035 INFO:tasks.workunit.client.0.smithi043.stdout:5/980: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/df0/d10b/d134 0 2024-04-25T23:01:11.035 INFO:tasks.workunit.client.0.smithi043.stdout:0/982: dwrite d1b/d23/f2a [0,4194304] 0 2024-04-25T23:01:11.036 INFO:tasks.workunit.client.0.smithi043.stdout:0/983: dread - d1b/d8b/d103/fe8 zero size 2024-04-25T23:01:11.036 INFO:tasks.workunit.client.0.smithi043.stdout:8/855: write d3/d4/db/d4e/d8b/d9f/d33/f67 [432141,13304] 0 2024-04-25T23:01:11.036 INFO:tasks.workunit.client.0.smithi043.stdout:5/981: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d8b/daf/d117/d135 0 2024-04-25T23:01:11.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/856: symlink d3/d4/db/d4e/d5c/d59/db7/l11d 0 2024-04-25T23:01:11.037 INFO:tasks.workunit.client.0.smithi043.stdout:0/984: rename d1b/d31/f6c to d1b/dcf/dd7/df6/f12d 0 2024-04-25T23:01:11.038 INFO:tasks.workunit.client.0.smithi043.stdout:8/857: stat d3/d4/d7c/f10d 0 2024-04-25T23:01:11.038 INFO:tasks.workunit.client.0.smithi043.stdout:5/982: creat d0/d2c/d39/d1c/f136 x:0 0 0 2024-04-25T23:01:11.038 INFO:tasks.workunit.client.0.smithi043.stdout:0/985: stat d1b/dcf/dd7/ce3 0 2024-04-25T23:01:11.039 INFO:tasks.workunit.client.0.smithi043.stdout:5/983: creat d0/d2c/f137 x:0 0 0 2024-04-25T23:01:11.040 INFO:tasks.workunit.client.0.smithi043.stdout:0/986: truncate d1b/d23/d7a/dad/fd4 664362 0 2024-04-25T23:01:11.040 INFO:tasks.workunit.client.0.smithi043.stdout:0/987: readlink d1b/db0/lee 0 2024-04-25T23:01:11.041 INFO:tasks.workunit.client.0.smithi043.stdout:5/984: truncate d0/d2c/d39/d1c/d25/d7a/d2d/f74 4732139 0 2024-04-25T23:01:11.043 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:11.040+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:11.044 INFO:tasks.workunit.client.0.smithi043.stdout:8/858: dwrite d3/d4/db/d14/da5/f116 [0,4194304] 0 2024-04-25T23:01:11.045 INFO:tasks.workunit.client.0.smithi043.stdout:8/859: write d3/d4/d7c/d92/d62/fcb [2100110,75939] 0 2024-04-25T23:01:11.046 INFO:tasks.workunit.client.0.smithi043.stdout:0/988: dwrite d1b/d23/f70 [0,4194304] 0 2024-04-25T23:01:11.048 INFO:tasks.workunit.client.0.smithi043.stdout:0/989: fdatasync d1b/f4a 0 2024-04-25T23:01:11.052 INFO:tasks.workunit.client.0.smithi043.stdout:8/860: dwrite d3/d4/db/d4e/d5c/d59/d61/d66/f6f [0,4194304] 0 2024-04-25T23:01:11.054 INFO:tasks.workunit.client.0.smithi043.stdout:8/861: rename d3/d4/d7c/d92/d62/le7 to d3/d4/db/d4e/d5c/d59/d61/l11e 0 2024-04-25T23:01:11.061 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:11.061 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:11.061 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:11.064 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:11.065 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:11.075 INFO:tasks.workunit.client.0.smithi043.stdout:0/990: dread d1b/d23/d39/d90/df4/f63 [0,4194304] 0 2024-04-25T23:01:11.076 INFO:tasks.workunit.client.0.smithi043.stdout:6/932: sync 2024-04-25T23:01:11.076 INFO:tasks.workunit.client.0.smithi043.stdout:8/862: sync 2024-04-25T23:01:11.078 INFO:tasks.workunit.client.0.smithi043.stdout:8/863: getdents d3/d4/d6d 0 2024-04-25T23:01:11.078 INFO:tasks.workunit.client.0.smithi043.stdout:6/933: link d1/d5/d3b/db6/le5 d1/d2a/dd5/d122/l135 0 2024-04-25T23:01:11.078 INFO:tasks.workunit.client.0.smithi043.stdout:8/864: stat d3/d4/db/d4e/d5c/d59/db7/l11d 0 2024-04-25T23:01:11.080 INFO:tasks.workunit.client.0.smithi043.stdout:0/991: read d1b/d23/d7a/f98 [191831,110066] 0 2024-04-25T23:01:11.080 INFO:tasks.workunit.client.0.smithi043.stdout:8/865: link d3/d4/d36/f76 d3/d4/db/d4e/d8b/d9f/d33/f11f 0 2024-04-25T23:01:11.080 INFO:tasks.workunit.client.0.smithi043.stdout:0/992: getdents d1b/d23/dab/dbd 0 2024-04-25T23:01:11.081 INFO:tasks.workunit.client.0.smithi043.stdout:0/993: chown d1b/d23/l34 2 1 2024-04-25T23:01:11.082 INFO:tasks.workunit.client.0.smithi043.stdout:6/934: write d1/d5/d3b/d4c/d21/d38/de6/f11b [2891908,130746] 0 2024-04-25T23:01:11.086 INFO:tasks.workunit.client.0.smithi043.stdout:0/994: truncate d1b/d23/d91/f10b 1638865 0 2024-04-25T23:01:11.087 INFO:tasks.workunit.client.0.smithi043.stdout:0/995: rmdir d1b/d23/d7a/d120 0 2024-04-25T23:01:11.088 INFO:tasks.workunit.client.0.smithi043.stdout:0/996: link d1b/d31/d3c/d72/c12c d1b/d31/d3c/d50/c12e 0 2024-04-25T23:01:11.089 INFO:tasks.workunit.client.0.smithi043.stdout:8/866: dread d3/d4/db/d14/d4c/d68/f9b [0,4194304] 0 2024-04-25T23:01:11.091 INFO:tasks.workunit.client.0.smithi043.stdout:8/867: truncate d3/d4/db/d4e/d8b/d9f/d33/db0/feb 877722 0 2024-04-25T23:01:11.092 INFO:tasks.workunit.client.0.smithi043.stdout:5/985: dread d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d3a/fcc [0,4194304] 0 2024-04-25T23:01:11.094 INFO:tasks.workunit.client.0.smithi043.stdout:5/986: creat d0/d2c/d39/d1c/d25/d7a/d2d/df0/df3/f138 x:0 0 0 2024-04-25T23:01:11.094 INFO:tasks.workunit.client.0.smithi043.stdout:0/997: truncate f11 3230517 0 2024-04-25T23:01:11.095 INFO:tasks.workunit.client.0.smithi043.stdout:5/987: symlink d0/d22/d95/l139 0 2024-04-25T23:01:11.097 INFO:tasks.workunit.client.0.smithi043.stdout:8/868: dwrite d3/d4/db/d14/d56/d5d/f108 [0,4194304] 0 2024-04-25T23:01:11.100 INFO:tasks.workunit.client.0.smithi043.stdout:5/988: write d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2/f114 [3037632,110706] 0 2024-04-25T23:01:11.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/989: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fd7 [1193924,22791] 0 2024-04-25T23:01:11.107 INFO:tasks.workunit.client.0.smithi043.stdout:5/990: dwrite d0/d2c/d39/d1c/d5e/ffc [0,4194304] 0 2024-04-25T23:01:11.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/991: write d0/d2c/d39/d1c/d25/d7a/d2d/d8b/fab [2509940,74552] 0 2024-04-25T23:01:11.109 INFO:tasks.workunit.client.0.smithi043.stdout:5/992: write d0/d2c/d39/d1c/d25/d7a/fda [812448,100960] 0 2024-04-25T23:01:11.111 INFO:tasks.workunit.client.0.smithi043.stdout:5/993: symlink d0/d2c/d39/d1c/d25/d7a/d2d/l13a 0 2024-04-25T23:01:11.112 INFO:tasks.workunit.client.0.smithi043.stdout:5/994: dread - d0/d2c/d39/d1c/d25/d7a/d92/fdf zero size 2024-04-25T23:01:11.112 INFO:tasks.workunit.client.0.smithi043.stdout:5/995: write d0/d2c/f9a [1826209,70239] 0 2024-04-25T23:01:11.114 INFO:tasks.workunit.client.0.smithi043.stdout:5/996: creat d0/d2c/d39/d1c/d25/d7a/d41/d47/d81/d133/f13b x:0 0 0 2024-04-25T23:01:11.114 INFO:tasks.workunit.client.0.smithi043.stdout:8/869: dread d3/d4/d36/fd3 [0,4194304] 0 2024-04-25T23:01:11.114 INFO:tasks.workunit.client.0.smithi043.stdout:5/997: chown d0/d2c/d39/d1c/d25/d7a/d2d/d5f/dc2/f114 361259373 1 2024-04-25T23:01:11.115 INFO:tasks.workunit.client.0.smithi043.stdout:8/870: creat d3/d4/db/d4e/d5c/d59/d61/d115/d5e/f120 x:0 0 0 2024-04-25T23:01:11.116 INFO:tasks.workunit.client.0.smithi043.stdout:8/871: chown d3/d4/d36/f76 3764 1 2024-04-25T23:01:11.116 INFO:tasks.workunit.client.0.smithi043.stdout:5/998: mkdir d0/d2c/d39/d1c/d25/d7a/d2d/d13c 0 2024-04-25T23:01:11.117 INFO:tasks.workunit.client.0.smithi043.stdout:5/999: rmdir d0/d2c/d39/d1c/d25/d7a/d2d/d5f/d116 0 2024-04-25T23:01:11.117 INFO:tasks.workunit.client.0.smithi043.stdout:0/998: dread d1b/d23/f3d [0,4194304] 0 2024-04-25T23:01:11.118 INFO:tasks.workunit.client.0.smithi043.stdout:8/872: getdents d3/d4/db/d4e/d8b/d9f/d33/db0 0 2024-04-25T23:01:11.120 INFO:tasks.workunit.client.0.smithi043.stdout:0/999: dread d1b/d23/d91/fe7 [0,4194304] 0 2024-04-25T23:01:11.123 INFO:tasks.workunit.client.0.smithi043.stdout:8/873: write d3/d4/d36/f64 [3547811,4525] 0 2024-04-25T23:01:11.124 INFO:tasks.workunit.client.0.smithi043.stdout:8/874: mkdir d3/d4/db/d14/d121 0 2024-04-25T23:01:11.124 INFO:tasks.workunit.client.0.smithi043.stdout:8/875: truncate d3/d4/d36/fde 731036 0 2024-04-25T23:01:11.125 INFO:tasks.workunit.client.0.smithi043.stdout:8/876: write d3/d4/db/ffd [1046590,27410] 0 2024-04-25T23:01:11.130 INFO:tasks.workunit.client.0.smithi043.stdout:8/877: dwrite d3/d4/db/d4e/d5c/d59/d61/d97/fe8 [0,4194304] 0 2024-04-25T23:01:11.133 INFO:tasks.workunit.client.0.smithi043.stdout:8/878: link d3/d4/db/d4e/d5c/d59/d61/d115/d5e/f120 d3/d4/db/d14/da5/f122 0 2024-04-25T23:01:11.139 INFO:tasks.workunit.client.0.smithi043.stdout:8/879: write d3/d4/db/d14/d4c/d68/f7a [1343862,1517] 0 2024-04-25T23:01:11.144 INFO:tasks.workunit.client.0.smithi043.stdout:8/880: write d3/d4/db/d4e/d5c/d59/d61/d115/d5e/f120 [690927,40763] 0 2024-04-25T23:01:11.144 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:11.142+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:11.145 INFO:tasks.workunit.client.0.smithi043.stdout:8/881: truncate d3/d4/db/d14/d56/d5d/f63 4786528 0 2024-04-25T23:01:11.145 INFO:tasks.workunit.client.0.smithi043.stdout:8/882: write d3/d4/d7c/f10d [345934,21022] 0 2024-04-25T23:01:11.146 INFO:tasks.workunit.client.0.smithi043.stdout:8/883: mknod d3/c123 0 2024-04-25T23:01:11.152 INFO:tasks.workunit.client.0.smithi043.stdout:8/884: symlink d3/d4/db/d4e/d5c/d59/d61/d115/d5e/l124 0 2024-04-25T23:01:11.157 INFO:tasks.workunit.client.0.smithi043.stdout:8/885: dwrite d3/d4/db/d14/d4c/d68/f7a [0,4194304] 0 2024-04-25T23:01:11.159 INFO:tasks.workunit.client.0.smithi043.stdout:8/886: creat d3/d4/db/d14/d3e/f125 x:0 0 0 2024-04-25T23:01:11.160 INFO:tasks.workunit.client.0.smithi043.stdout:8/887: creat d3/d4/d6d/d10a/f126 x:0 0 0 2024-04-25T23:01:11.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/888: creat d3/d4/db/d14/d4c/d68/f127 x:0 0 0 2024-04-25T23:01:11.164 INFO:tasks.workunit.client.0.smithi043.stdout:8/889: read d3/d4/db/d14/d56/f70 [3369298,83084] 0 2024-04-25T23:01:11.170 INFO:tasks.workunit.client.0.smithi043.stdout:8/890: dwrite d3/d4/db/d14/d56/d5d/d9c/da7/fe6 [0,4194304] 0 2024-04-25T23:01:11.176 INFO:tasks.workunit.client.0.smithi043.stdout:8/891: dwrite d3/d4/db/d4e/d5c/d59/db7/ff3 [0,4194304] 0 2024-04-25T23:01:11.177 INFO:tasks.workunit.client.0.smithi043.stdout:8/892: rmdir d3/d4/d7c/d92/d62 39 2024-04-25T23:01:11.178 INFO:tasks.workunit.client.0.smithi043.stdout:8/893: getdents d3/d4/db/d4e/d5c/d59/d61 0 2024-04-25T23:01:11.179 INFO:tasks.workunit.client.0.smithi043.stdout:8/894: creat d3/d4/d98/f128 x:0 0 0 2024-04-25T23:01:11.180 INFO:tasks.workunit.client.0.smithi043.stdout:8/895: mknod d3/d4/db/d14/d56/d5d/d9c/d109/c129 0 2024-04-25T23:01:11.181 INFO:tasks.workunit.client.0.smithi043.stdout:8/896: write d3/d4/d36/fd3 [238786,46995] 0 2024-04-25T23:01:11.181 INFO:tasks.workunit.client.0.smithi043.stdout:8/897: write d3/d4/db/d14/d3e/f125 [365220,13080] 0 2024-04-25T23:01:11.182 INFO:tasks.workunit.client.0.smithi043.stdout:8/898: stat d3/d4/f25 0 2024-04-25T23:01:11.182 INFO:tasks.workunit.client.0.smithi043.stdout:8/899: chown d3/c8a 743 1 2024-04-25T23:01:11.183 INFO:tasks.workunit.client.0.smithi043.stdout:8/900: rename d3/d4/db/d4e/d8b/d9f/d33/df6 to d3/d4/db/d4e/d8b/d12a 0 2024-04-25T23:01:11.184 INFO:tasks.workunit.client.0.smithi043.stdout:8/901: write d3/d4/d36/fde [1236834,77526] 0 2024-04-25T23:01:11.189 INFO:tasks.workunit.client.0.smithi043.stdout:8/902: truncate d3/d4/d7c/d92/d62/fa9 2112919 0 2024-04-25T23:01:11.190 INFO:tasks.workunit.client.0.smithi043.stdout:8/903: mknod d3/d4/db/d14/d56/d5d/d9c/da7/dfa/c12b 0 2024-04-25T23:01:11.200 INFO:tasks.workunit.client.0.smithi043.stdout:8/904: dwrite d3/d4/f8 [0,4194304] 0 2024-04-25T23:01:11.201 INFO:tasks.workunit.client.0.smithi043.stdout:8/905: chown d3/d4/db/d4e/d8b/d9f/d8d 3 1 2024-04-25T23:01:11.201 INFO:tasks.workunit.client.0.smithi043.stdout:6/935: sync 2024-04-25T23:01:11.201 INFO:tasks.workunit.client.0.smithi043.stdout:8/906: unlink d3/d4/db/f4a 0 2024-04-25T23:01:11.205 INFO:tasks.workunit.client.0.smithi043.stdout:8/907: link d3/d4/db/d4e/d5c/d59/d61/d97/dc3/f107 d3/d4/db/d4e/d5c/f12c 0 2024-04-25T23:01:11.208 INFO:tasks.workunit.client.0.smithi043.stdout:6/936: dwrite d1/d2a/db5/dc4/f124 [0,4194304] 0 2024-04-25T23:01:11.210 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:11.210 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:11.213 INFO:tasks.workunit.client.0.smithi043.stdout:6/937: dwrite d1/d5/d3b/d62/f69 [4194304,4194304] 0 2024-04-25T23:01:11.214 INFO:tasks.workunit.client.0.smithi043.stdout:6/938: write d1/d5/d3b/d4c/d1a/f2e [5851906,107291] 0 2024-04-25T23:01:11.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/939: readlink d1/d5/d3b/d4c/l61 0 2024-04-25T23:01:11.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/940: readlink d1/d2a/dd5/d122/l135 0 2024-04-25T23:01:11.217 INFO:tasks.workunit.client.0.smithi043.stdout:6/941: truncate d1/d2a/db5/dc4/dc9/d10b/f110 515089 0 2024-04-25T23:01:11.227 INFO:tasks.workunit.client.0.smithi043.stdout:6/942: read d1/d2a/db5/dc4/dfa/fee [258344,81981] 0 2024-04-25T23:01:11.227 INFO:tasks.workunit.client.0.smithi043.stdout:6/943: chown d1/d5/d3b/d4c/d21/d55/d6d/d96 19 1 2024-04-25T23:01:11.228 INFO:tasks.workunit.client.0.smithi043.stdout:6/944: fdatasync d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/ffc 0 2024-04-25T23:01:11.229 INFO:tasks.workunit.client.0.smithi043.stdout:6/945: mknod d1/d5/d3b/d62/d123/c136 0 2024-04-25T23:01:11.230 INFO:tasks.workunit.client.0.smithi043.stdout:6/946: getdents d1/d5/d3b/d62 0 2024-04-25T23:01:11.233 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:11.236 INFO:tasks.workunit.client.0.smithi043.stdout:6/947: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/f3d [0,4194304] 0 2024-04-25T23:01:11.245 INFO:tasks.workunit.client.0.smithi043.stdout:8/908: dread d3/d4/d7d/fbd [0,4194304] 0 2024-04-25T23:01:11.246 INFO:tasks.workunit.client.0.smithi043.stdout:8/909: rename d3/d4/db/d4e/d8b/d9f/d8d to d3/d4/db/def/d12d 0 2024-04-25T23:01:11.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/910: mknod d3/d4/d7d/c12e 0 2024-04-25T23:01:11.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/911: fsync d3/d4/db/d14/d56/d5d/d9c/da7/fe6 0 2024-04-25T23:01:11.253 INFO:tasks.workunit.client.0.smithi043.stdout:8/912: dwrite d3/d4/db/d14/d4c/fbb [0,4194304] 0 2024-04-25T23:01:11.258 INFO:tasks.workunit.client.0.smithi043.stdout:8/913: dread d3/d4/d7c/f10d [0,4194304] 0 2024-04-25T23:01:11.258 INFO:tasks.workunit.client.0.smithi043.stdout:6/948: dread d1/d5/d3b/db6/fb8 [0,4194304] 0 2024-04-25T23:01:11.259 INFO:tasks.workunit.client.0.smithi043.stdout:8/914: mkdir d3/d4/db/def/d12d/dfc/d12f 0 2024-04-25T23:01:11.259 INFO:tasks.workunit.client.0.smithi043.stdout:6/949: write d1/d2a/dd5/fed [793559,75911] 0 2024-04-25T23:01:11.260 INFO:tasks.workunit.client.0.smithi043.stdout:8/915: symlink d3/d4/db/d4e/d8b/l130 0 2024-04-25T23:01:11.260 INFO:tasks.workunit.client.0.smithi043.stdout:6/950: fsync d1/d5/d3b/d4c/d21/d38/d99/feb 0 2024-04-25T23:01:11.261 INFO:tasks.workunit.client.0.smithi043.stdout:6/951: unlink d1/d5/d3b/d4c/d21/d38/d99/f10e 0 2024-04-25T23:01:11.262 INFO:tasks.workunit.client.0.smithi043.stdout:6/952: mkdir d1/d5/d3b/d4c/d21/d38/d99/d137 0 2024-04-25T23:01:11.262 INFO:tasks.workunit.client.0.smithi043.stdout:6/953: rmdir d1/d5/d3b/d4c/d21/d55/d68 39 2024-04-25T23:01:11.270 INFO:tasks.workunit.client.0.smithi043.stdout:6/954: dwrite d1/d5/d3b/d4c/d21/d38/d99/feb [0,4194304] 0 2024-04-25T23:01:11.272 INFO:tasks.workunit.client.0.smithi043.stdout:6/955: getdents d1/d5/d3b/d4c/d21/d55/da2/ddb 0 2024-04-25T23:01:11.275 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:11.274+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:11.277 INFO:tasks.workunit.client.0.smithi043.stdout:6/956: dwrite d1/d5/d3b/d4c/d21/d38/de6/f11b [0,4194304] 0 2024-04-25T23:01:11.277 INFO:tasks.workunit.client.0.smithi043.stdout:6/957: dread - d1/d2a/db5/dcb/f118 zero size 2024-04-25T23:01:11.280 INFO:tasks.workunit.client.0.smithi043.stdout:6/958: write d1/d5/f1d [510682,108460] 0 2024-04-25T23:01:11.281 INFO:tasks.workunit.client.0.smithi043.stdout:6/959: chown d1/d5/d3b/d4c/d21/c113 216169518 1 2024-04-25T23:01:11.282 INFO:tasks.workunit.client.0.smithi043.stdout:6/960: link d1/d5/d3b/d4c/d21/c83 d1/d5/d3b/d4c/d21/d55/d68/dc5/c138 0 2024-04-25T23:01:11.283 INFO:tasks.workunit.client.0.smithi043.stdout:6/961: creat d1/d5/d3b/d4c/d21/f139 x:0 0 0 2024-04-25T23:01:11.284 INFO:tasks.workunit.client.0.smithi043.stdout:8/916: sync 2024-04-25T23:01:11.285 INFO:tasks.workunit.client.0.smithi043.stdout:6/962: dread d1/d2a/db5/dc4/dc9/d10b/f110 [0,4194304] 0 2024-04-25T23:01:11.286 INFO:tasks.workunit.client.0.smithi043.stdout:6/963: dread d1/d5/d3b/d4c/d21/fab [0,4194304] 0 2024-04-25T23:01:11.287 INFO:tasks.workunit.client.0.smithi043.stdout:8/917: truncate d3/d4/d7c/d92/fa4 869134 0 2024-04-25T23:01:11.287 INFO:tasks.workunit.client.0.smithi043.stdout:6/964: getdents d1/d5/d3b 0 2024-04-25T23:01:11.288 INFO:tasks.workunit.client.0.smithi043.stdout:6/965: write d1/d2a/db5/dc4/dc9/fd8 [737050,100426] 0 2024-04-25T23:01:11.291 INFO:tasks.workunit.client.0.smithi043.stdout:8/918: truncate d3/d4/d7c/d92/fa4 1800381 0 2024-04-25T23:01:11.292 INFO:tasks.workunit.client.0.smithi043.stdout:8/919: rmdir d3/d4/db/d4e/d5c/d59/d61 39 2024-04-25T23:01:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:6/966: dwrite d1/d5/d3b/d4c/d21/f4f [0,4194304] 0 2024-04-25T23:01:11.294 INFO:tasks.workunit.client.0.smithi043.stdout:6/967: mknod d1/d5/d3b/d4c/d21/d55/d68/d7f/c13a 0 2024-04-25T23:01:11.295 INFO:tasks.workunit.client.0.smithi043.stdout:8/920: sync 2024-04-25T23:01:11.297 INFO:tasks.workunit.client.0.smithi043.stdout:8/921: write d3/d4/db/d4e/d8b/d9f/d33/f67 [71371,16647] 0 2024-04-25T23:01:11.301 INFO:tasks.workunit.client.0.smithi043.stdout:6/968: dwrite d1/d5/d3b/d4c/d21/d55/f74 [0,4194304] 0 2024-04-25T23:01:11.302 INFO:tasks.workunit.client.0.smithi043.stdout:6/969: readlink d1/d5/d3b/d4c/d21/d55/d68/d7f/lf8 0 2024-04-25T23:01:11.303 INFO:tasks.workunit.client.0.smithi043.stdout:6/970: fsync d1/d5/d3b/d4c/d21/d55/d68/d7f/f102 0 2024-04-25T23:01:11.303 INFO:tasks.workunit.client.0.smithi043.stdout:6/971: chown d1/d5/d3b/d4c/d21 3873825 1 2024-04-25T23:01:11.305 INFO:tasks.workunit.client.0.smithi043.stdout:6/972: readlink d1/d5/d3b/d4c/d21/d55/d68/le7 0 2024-04-25T23:01:11.305 INFO:tasks.workunit.client.0.smithi043.stdout:8/922: dwrite d3/d4/db/d4e/d5c/d59/d61/fa0 [0,4194304] 0 2024-04-25T23:01:11.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/973: dwrite d1/d5/d3b/d4c/d21/d55/d6d/d96/f111 [0,4194304] 0 2024-04-25T23:01:11.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/974: symlink d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/d9c/dc3/de3/l13b 0 2024-04-25T23:01:11.313 INFO:tasks.workunit.client.0.smithi043.stdout:6/975: mknod d1/d5/d3b/d4c/d21/d38/c13c 0 2024-04-25T23:01:11.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/976: getdents d1/d5/d3b/d4c/d21 0 2024-04-25T23:01:11.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/977: creat d1/d5/d3b/d4c/d21/d55/d68/d30/f13d x:0 0 0 2024-04-25T23:01:11.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/978: dwrite d1/d5/d3b/d62/f69 [0,4194304] 0 2024-04-25T23:01:11.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/979: unlink d1/d5/d3b/d4c/d21/d55/c88 0 2024-04-25T23:01:11.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/980: write d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/fb1 [492056,97711] 0 2024-04-25T23:01:11.324 INFO:tasks.workunit.client.0.smithi043.stdout:8/923: read d3/d4/d7c/d92/d62/fa9 [878031,31900] 0 2024-04-25T23:01:11.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/924: dread d3/d4/db/d14/d4c/fbb [0,4194304] 0 2024-04-25T23:01:11.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/925: fdatasync d3/faf 0 2024-04-25T23:01:11.331 INFO:tasks.workunit.client.0.smithi043.stdout:6/981: dwrite d1/d5/d3b/d4c/d21/d55/d68/d30/f13d [0,4194304] 0 2024-04-25T23:01:11.332 INFO:tasks.workunit.client.0.smithi043.stdout:6/982: chown d1 1 1 2024-04-25T23:01:11.334 INFO:tasks.workunit.client.0.smithi043.stdout:6/983: creat d1/d5/d3b/f13e x:0 0 0 2024-04-25T23:01:11.338 INFO:tasks.workunit.client.0.smithi043.stdout:8/926: write d3/d4/d36/f82 [931931,41149] 0 2024-04-25T23:01:11.339 INFO:tasks.workunit.client.0.smithi043.stdout:6/984: rename d1/d5/d3b/d4c/d21/fab to d1/d5/d3b/d4c/d21/d38/d99/f13f 0 2024-04-25T23:01:11.340 INFO:tasks.workunit.client.0.smithi043.stdout:6/985: mkdir d1/d5/d3b/d4c/d21/d55/d6d/d96/d119/d9c/dc3/de3/d140 0 2024-04-25T23:01:11.343 INFO:tasks.workunit.client.0.smithi043.stdout:8/927: dwrite d3/d4/db/d14/f19 [0,4194304] 0 2024-04-25T23:01:11.345 INFO:tasks.workunit.client.0.smithi043.stdout:8/928: write d3/d4/db/d14/d4c/d68/f127 [172453,116792] 0 2024-04-25T23:01:11.345 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:11.342+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:11.346 INFO:tasks.workunit.client.0.smithi043.stdout:8/929: creat d3/d4/db/d14/d56/d5d/d9c/da7/dfa/f131 x:0 0 0 2024-04-25T23:01:11.346 INFO:tasks.workunit.client.0.smithi043.stdout:8/930: write d3/d4/db/d4e/d5c/f1e [199862,110889] 0 2024-04-25T23:01:11.348 INFO:tasks.workunit.client.0.smithi043.stdout:8/931: truncate d3/d4/db/d4e/d5c/d59/d61/d97/dc3/f107 4731150 0 2024-04-25T23:01:11.349 INFO:tasks.workunit.client.0.smithi043.stdout:8/932: rename d3/d4/d36/f76 to d3/d4/db/d14/d3e/f132 0 2024-04-25T23:01:11.349 INFO:tasks.workunit.client.0.smithi043.stdout:8/933: chown d3/d4/db/d4e/d5c/d59/db7/l11d 81105 1 2024-04-25T23:01:11.350 INFO:tasks.workunit.client.0.smithi043.stdout:8/934: fsync d3/d4/db/d14/d56/d5d/d9c/da7/fe6 0 2024-04-25T23:01:11.351 INFO:tasks.workunit.client.0.smithi043.stdout:8/935: mkdir d3/d4/db/d4e/d5c/d59/db7/d133 0 2024-04-25T23:01:11.352 INFO:tasks.workunit.client.0.smithi043.stdout:8/936: link d3/d4/d7c/d92/l40 d3/d4/db/d4e/d5c/d59/l134 0 2024-04-25T23:01:11.353 INFO:tasks.workunit.client.0.smithi043.stdout:8/937: write d3/d4/db/d4e/f80 [165149,13887] 0 2024-04-25T23:01:11.354 INFO:tasks.workunit.client.0.smithi043.stdout:8/938: creat d3/d4/db/d4e/d8b/d9f/d33/db0/f135 x:0 0 0 2024-04-25T23:01:11.354 INFO:tasks.workunit.client.0.smithi043.stdout:8/939: write d3/d4/db/d14/da5/f116 [765526,54824] 0 2024-04-25T23:01:11.355 INFO:tasks.workunit.client.0.smithi043.stdout:8/940: rename d3/fb5 to d3/d4/db/d10e/f136 0 2024-04-25T23:01:11.362 INFO:tasks.workunit.client.0.smithi043.stdout:8/941: creat d3/d4/db/d4e/d5c/d59/d61/d97/dcd/f137 x:0 0 0 2024-04-25T23:01:11.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:01:11.384 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:11.384 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:11.394 INFO:tasks.workunit.client.0.smithi043.stdout:6/986: sync 2024-04-25T23:01:11.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/942: sync 2024-04-25T23:01:11.395 INFO:tasks.workunit.client.0.smithi043.stdout:8/943: symlink d3/d4/db/d4e/d8b/d9f/l138 0 2024-04-25T23:01:11.396 INFO:tasks.workunit.client.0.smithi043.stdout:8/944: unlink d3/d4/db/d4e/d5c/d59/d61/d66/f6f 0 2024-04-25T23:01:11.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:11.399 INFO:tasks.workunit.client.0.smithi043.stdout:8/945: dread - d3/d4/db/d4e/d5c/d59/d61/d97/fd1 zero size 2024-04-25T23:01:11.400 INFO:tasks.workunit.client.0.smithi043.stdout:6/987: dwrite d1/d5/d3b/d4c/d21/d38/d99/f120 [0,4194304] 0 2024-04-25T23:01:11.404 INFO:tasks.workunit.client.0.smithi043.stdout:8/946: truncate d3/d4/db/d14/d4c/d68/f7a 289195 0 2024-04-25T23:01:11.405 INFO:tasks.workunit.client.0.smithi043.stdout:8/947: chown d3/d4/db/d4e/d8b/d9f/c95 0 1 2024-04-25T23:01:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:6/988: dwrite d1/d2a/f5e [0,4194304] 0 2024-04-25T23:01:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:8/948: symlink d3/d4/db/d14/d56/d5d/d9c/da7/dfa/l139 0 2024-04-25T23:01:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:8/949: fdatasync d3/d4/db/d4e/d8b/f11a 0 2024-04-25T23:01:11.408 INFO:tasks.workunit.client.0.smithi043.stdout:6/989: write d1/d5/d3b/d4c/d21/d38/de6/ffb [408420,87065] 0 2024-04-25T23:01:11.410 INFO:tasks.workunit.client.0.smithi043.stdout:6/990: mkdir d1/d5/d3b/d4c/d141 0 2024-04-25T23:01:11.410 INFO:tasks.workunit.client.0.smithi043.stdout:8/950: read d3/d4/db/d14/d56/d5d/d9c/da7/fb6 [2628807,15344] 0 2024-04-25T23:01:11.411 INFO:tasks.workunit.client.0.smithi043.stdout:6/991: getdents d1/d2a/db5/dc4/dc9/d10b 0 2024-04-25T23:01:11.411 INFO:tasks.workunit.client.0.smithi043.stdout:6/992: chown d1/d2a/db5/f11a 2412490 1 2024-04-25T23:01:11.412 INFO:tasks.workunit.client.0.smithi043.stdout:6/993: write d1/d5/fe4 [246021,62513] 0 2024-04-25T23:01:11.413 INFO:tasks.workunit.client.0.smithi043.stdout:6/994: rmdir d1/d2a/db5/dc4 39 2024-04-25T23:01:11.414 INFO:tasks.workunit.client.0.smithi043.stdout:6/995: write d1/d5/d3b/d4c/d21/d38/de6/d107/f117 [301427,78848] 0 2024-04-25T23:01:11.415 INFO:tasks.workunit.client.0.smithi043.stdout:6/996: unlink d1/d5/d3b/d4c/d21/d55/d68/lef 0 2024-04-25T23:01:11.421 INFO:tasks.workunit.client.0.smithi043.stdout:6/997: dwrite d1/d2a/db5/dcb/f118 [0,4194304] 0 2024-04-25T23:01:11.423 INFO:tasks.workunit.client.0.smithi043.stdout:6/998: rename d1/d5/d3b/d4c/d1a/c66 to d1/d5/d3b/d4c/d21/df3/c142 0 2024-04-25T23:01:11.424 INFO:tasks.workunit.client.0.smithi043.stdout:6/999: write d1/d2a/db5/dcb/fff [3741814,38090] 0 2024-04-25T23:01:11.430 INFO:tasks.workunit.client.0.smithi043.stdout:8/951: dread d3/d4/db/d14/da5/d105/f27 [0,4194304] 0 2024-04-25T23:01:11.432 INFO:tasks.workunit.client.0.smithi043.stdout:8/952: rename d3/d4/db/d14/da5/cab to d3/d4/db/d14/dcc/c13a 0 2024-04-25T23:01:11.434 INFO:tasks.workunit.client.0.smithi043.stdout:8/953: link d3/d4/db/d4e/d8b/d9f/d33/db0/feb d3/d4/db/d4e/d8b/f13b 0 2024-04-25T23:01:11.435 INFO:tasks.workunit.client.0.smithi043.stdout:8/954: fsync d3/d4/f25 0 2024-04-25T23:01:11.435 INFO:tasks.workunit.client.0.smithi043.stdout:8/955: readlink d3/d4/db/d4e/l7b 0 2024-04-25T23:01:11.436 INFO:tasks.workunit.client.0.smithi043.stdout:8/956: mknod d3/d4/db/d14/d56/d5d/c13c 0 2024-04-25T23:01:11.437 INFO:tasks.workunit.client.0.smithi043.stdout:8/957: mknod d3/d4/db/d14/d3e/c13d 0 2024-04-25T23:01:11.437 INFO:tasks.workunit.client.0.smithi043.stdout:8/958: fsync d3/d4/f8 0 2024-04-25T23:01:11.438 INFO:tasks.workunit.client.0.smithi043.stdout:8/959: symlink d3/d4/db/d4e/d5c/d59/db7/d133/l13e 0 2024-04-25T23:01:11.439 INFO:tasks.workunit.client.0.smithi043.stdout:8/960: unlink d3/d4/db/d14/d56/d5d/c9d 0 2024-04-25T23:01:11.441 INFO:tasks.workunit.client.0.smithi043.stdout:8/961: link d3/d4/db/d4e/d8b/d9f/d33/f2a d3/d4/db/d4e/d5c/d59/db7/f13f 0 2024-04-25T23:01:11.441 INFO:tasks.workunit.client.0.smithi043.stdout:8/962: dread - d3/d4/db/fa6 zero size 2024-04-25T23:01:11.442 INFO:tasks.workunit.client.0.smithi043.stdout:8/963: write d3/d4/db/d4e/d5c/ff0 [652245,2490] 0 2024-04-25T23:01:11.442 INFO:tasks.workunit.client.0.smithi043.stdout:8/964: creat d3/d4/d36/f140 x:0 0 0 2024-04-25T23:01:11.443 INFO:tasks.workunit.client.0.smithi043.stdout:8/965: symlink d3/d4/db/d14/d3e/l141 0 2024-04-25T23:01:11.446 INFO:tasks.workunit.client.0.smithi043.stdout:8/966: truncate d3/d4/db/def/ff4 225929 0 2024-04-25T23:01:11.447 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:11.444+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:11.448 INFO:tasks.workunit.client.0.smithi043.stdout:8/967: write d3/d4/d7c/d92/fa4 [2726125,87014] 0 2024-04-25T23:01:11.449 INFO:tasks.workunit.client.0.smithi043.stdout:8/968: dread - d3/d4/d7d/f117 zero size 2024-04-25T23:01:11.449 INFO:tasks.workunit.client.0.smithi043.stdout:8/969: fdatasync d3/d4/db/d4e/d8b/d9f/f15 0 2024-04-25T23:01:11.451 INFO:tasks.workunit.client.0.smithi043.stdout:8/970: mkdir d3/d4/db/d4e/d5c/d59/d61/d97/dcd/d142 0 2024-04-25T23:01:11.452 INFO:tasks.workunit.client.0.smithi043.stdout:8/971: symlink d3/d4/db/d14/d56/d5d/d9c/l143 0 2024-04-25T23:01:11.453 INFO:tasks.workunit.client.0.smithi043.stdout:8/972: symlink d3/d4/db/d4e/d5c/d59/d61/d115/d5e/l144 0 2024-04-25T23:01:11.453 INFO:tasks.workunit.client.0.smithi043.stdout:8/973: fdatasync d3/d4/f8 0 2024-04-25T23:01:11.455 INFO:tasks.workunit.client.0.smithi043.stdout:8/974: write d3/d4/db/d4e/d8b/d9f/d33/f2a [441814,69896] 0 2024-04-25T23:01:11.456 INFO:tasks.workunit.client.0.smithi043.stdout:8/975: write d3/d4/db/d4e/d5c/d59/d61/d97/dcd/f137 [895973,79591] 0 2024-04-25T23:01:11.520 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:11.520 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:11.534 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:11.547 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:11.546+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:11.552 INFO:tasks.workunit.client.0.smithi043.stdout:8/976: sync 2024-04-25T23:01:11.574 INFO:tasks.workunit.client.0.smithi043.stdout:8/977: dread d3/d4/db/d14/d56/f70 [0,4194304] 0 2024-04-25T23:01:11.576 INFO:tasks.workunit.client.0.smithi043.stdout:8/978: chown d3/d4/db/d4e/d5c/d59/db7/f13f 895293144 1 2024-04-25T23:01:11.589 INFO:tasks.workunit.client.0.smithi043.stdout:8/979: dwrite d3/d4/db/d4e/d5c/d59/d61/d115/d5e/fec [0,4194304] 0 2024-04-25T23:01:11.590 INFO:tasks.workunit.client.0.smithi043.stdout:8/980: write d3/d4/d6d/d10a/f126 [471005,17083] 0 2024-04-25T23:01:11.622 INFO:tasks.workunit.client.0.smithi043.stdout:8/981: dread d3/d4/d7c/d92/d62/d6e/f74 [0,4194304] 0 2024-04-25T23:01:11.626 INFO:tasks.workunit.client.0.smithi043.stdout:8/982: write d3/d4/db/d14/d56/d5d/d9c/da7/dfa/f131 [929610,102727] 0 2024-04-25T23:01:11.628 INFO:tasks.workunit.client.0.smithi043.stdout:8/983: readlink d3/d4/db/d4e/d5c/d59/d61/d115/d5e/l144 0 2024-04-25T23:01:11.630 INFO:tasks.workunit.client.0.smithi043.stdout:8/984: symlink d3/d4/db/def/l145 0 2024-04-25T23:01:11.631 INFO:tasks.workunit.client.0.smithi043.stdout:8/985: chown d3/d4/db/d14/da5/dea 16829563 1 2024-04-25T23:01:11.634 INFO:tasks.workunit.client.0.smithi043.stdout:8/986: mknod d3/d4/db/d14/d121/c146 0 2024-04-25T23:01:11.635 INFO:tasks.workunit.client.0.smithi043.stdout:8/987: write d3/d4/db/d4e/d8b/d9f/d33/db0/ff1 [193693,100380] 0 2024-04-25T23:01:11.638 INFO:tasks.workunit.client.0.smithi043.stdout:8/988: mkdir d3/d4/db/d4e/d8b/d147 0 2024-04-25T23:01:11.639 INFO:tasks.workunit.client.0.smithi043.stdout:8/989: write d3/d4/db/d14/d3e/f125 [391422,109414] 0 2024-04-25T23:01:11.648 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:11.646+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:11.651 INFO:tasks.workunit.client.0.smithi043.stdout:8/990: dwrite d3/d4/db/d4e/d8b/d9f/f3b [4194304,4194304] 0 2024-04-25T23:01:11.657 INFO:tasks.workunit.client.0.smithi043.stdout:8/991: write d3/d4/db/d10e/f136 [4282617,78664] 0 2024-04-25T23:01:11.671 INFO:tasks.workunit.client.0.smithi043.stdout:8/992: dread d3/d4/d7c/d92/d62/fa9 [0,4194304] 0 2024-04-25T23:01:11.673 INFO:tasks.workunit.client.0.smithi043.stdout:8/993: symlink d3/d4/db/d4e/d8b/d9f/dd5/l148 0 2024-04-25T23:01:11.674 INFO:tasks.workunit.client.0.smithi043.stdout:8/994: write d3/d4/d36/f64 [1571360,88470] 0 2024-04-25T23:01:11.675 INFO:tasks.workunit.client.0.smithi043.stdout:8/995: dread - d3/d4/d36/f140 zero size 2024-04-25T23:01:11.677 INFO:tasks.workunit.client.0.smithi043.stdout:8/996: chown d3/d4/db/d4e/d5c/d59/d61/d115/d5e/l124 42078142 1 2024-04-25T23:01:11.678 INFO:tasks.workunit.client.0.smithi043.stdout:8/997: symlink d3/d4/db/d4e/d8b/d12a/l149 0 2024-04-25T23:01:11.680 INFO:tasks.workunit.client.0.smithi043.stdout:8/998: getdents d3/d4/d98 0 2024-04-25T23:01:11.682 INFO:tasks.workunit.client.0.smithi043.stdout:8/999: symlink d3/d4/db/d14/d56/d5d/d9c/da7/dfa/l14a 0 2024-04-25T23:01:11.686 INFO:tasks.workunit.client.0.smithi043.stderr:+ rm -rf -- ./tmp.G7uZ8STz75 2024-04-25T23:01:11.701 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:11.701 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:11.716 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:11.763 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:11.762+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:11.849 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:11.844+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:11.855 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:11.856 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:11.875 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:11.949 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:11.948+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:12.048 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:12.048 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:12.050 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:12.046+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:12.062 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:12.151 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:12.148+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:12.226 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:12.226 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:12.241 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:12.287 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:12.284+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:12.345 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:01:12.356 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:12.348+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:12.374 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:12.374 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:12.388 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:12.453 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:12.450+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:12.549 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:12.550 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:12.554 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:12.548+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:12.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:12.655 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:12.654+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:12.730 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:12.730 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:12.744 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:12.791 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:12.790+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:12.857 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:12.854+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:12.884 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:12.884 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:12.898 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:12.958 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:12.952+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.058 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:13.056+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.066 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:13.067 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:13.067 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:13.082 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:13.159 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:13.158+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:13.201 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:13.201 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:13.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:13.234 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:13.253 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:13.253 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:13.253 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:13.257 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:13.257 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:13.263 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:13.260+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.347 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3409 3.a 3:545c15c7:::200.00000017:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:13.346738+0000", 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.001081334, 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011290569999999999, 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.346738+0000", 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.346738+0000", 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.346741+0000", 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2059999999999999e-06 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.346756+0000", 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4554e-05 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.346791+0000", 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5385000000000001e-05 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.346809+0000", 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8054e-05 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.346908+0000", 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8911000000000002e-05 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:13.347074+0000", 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016525599999999999 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-04-25T23:01:13.351 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:13.360 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:13.356+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.362 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:13.460 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:13.456+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.522 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:13.523 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:13.523 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:13.523 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:13.523 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:13.536 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:13.579 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:13.576+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.662 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:13.660+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:13.704 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.845287538000001, 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:13.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:13.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.845256551999999, 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.845214129999999, 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:13.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:13.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.845183311, 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:13.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:13.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.845153631999999, 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:13.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:13.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:13.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.830896633000002, 2024-04-25T23:01:13.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:13.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:13.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.830486266000001, 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.736 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.827985568999999, 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:13.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:13.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:13.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:13.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.827932967999999, 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.827899521999999, 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.820547338000001, 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:13.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.820434021000001, 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.820370077, 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:13.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:13.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.820325064999999, 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.764 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:13.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:13.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.768 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.820287819000001, 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:13.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:13.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.772 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.818953919999998, 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:13.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:13.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.816793192999999, 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.777 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:13.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.814647293, 2024-04-25T23:01:13.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.785 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.814281223999998, 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:13.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.810827382999999, 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:13.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:13.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:13.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.794 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:13.795 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:13.795 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:13.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2024-04-25T23:01:13.796 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:13.797 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:13.792+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:13.897 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:13.894+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:13.968 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3894 4.0 4:012d4814:::1000000347c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.960853+0000", 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.007009894, 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0070348249999999998, 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.960853+0000", 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.960853+0000", 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.960854+0000", 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.7399999999999991e-07 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.960858+0000", 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2119999999999997e-06 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.960869+0000", 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.155e-05 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.960877+0000", 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6450000000000005e-06 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.960996+0000", 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118558 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.961066+0000", 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0009e-05 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.961274+0000", 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000208653 2024-04-25T23:01:13.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964452+0000", 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0031778420000000002 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3870 4.26 4:679d829b:::100000033cc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.956822+0000", 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.011040202000000001, 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.011171762, 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.973 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.956822+0000", 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.956822+0000", 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.956823+0000", 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.3900000000000004e-07 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.956832+0000", 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.5799999999999992e-06 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.956841+0000", 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9910000000000008e-06 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.956848+0000", 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9700000000000002e-06 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.958759+0000", 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001911315 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.958837+0000", 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8265999999999999e-05 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.958958+0000", 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012087999999999999 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963155+0000", 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0041971090000000001 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3905 4.11 4:896d0484:::100000034b0.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.963823+0000", 2024-04-25T23:01:13.977 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0040399069999999997, 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042508210000000001, 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963823+0000", 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963823+0000", 2024-04-25T23:01:13.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963823+0000", 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7100000000000002e-07 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963825+0000", 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2170000000000001e-06 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963830+0000", 2024-04-25T23:01:13.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8890000000000001e-06 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963834+0000", 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.8330000000000004e-06 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963891+0000", 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7154000000000002e-05 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:13.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963970+0000", 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8464e-05 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964077+0000", 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000106912 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.966911+0000", 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0028347160000000001 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.981 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3906 4.26 4:661d81ee:::100000034b1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.963861+0000", 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00400176, 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042923700000000002, 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.982 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963861+0000", 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963861+0000", 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963862+0000", 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1200000000000001e-07 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963866+0000", 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.924e-06 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963876+0000", 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0308e-05 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963881+0000", 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1599999999999997e-06 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963928+0000", 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.6947000000000003e-05 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.963995+0000", 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6947999999999997e-05 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964057+0000", 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2025000000000003e-05 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3911 4.26 4:66008a1e:::100000034d8.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.964191+0000", 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.003671629, 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040524539999999996, 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.986 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "waiting for sub ops", 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964191+0000", 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964191+0000", 2024-04-25T23:01:13.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964192+0000", 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.33e-07 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964196+0000", 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.9929999999999997e-06 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964206+0000", 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.9830000000000008e-06 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964213+0000", 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1740000000000003e-06 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.965776+0000", 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001563163 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.965868+0000", 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2252999999999999e-05 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.966005+0000", 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013646900000000001 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3913 4.17 4:eac2cc68:::100000034e1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.964225+0000", 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0036372610000000001, 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040882339999999996, 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964225+0000", 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964225+0000", 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964226+0000", 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0200000000000002e-07 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964228+0000", 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2010000000000002e-06 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964235+0000", 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.2520000000000002e-06 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964241+0000", 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7919999999999998e-06 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964285+0000", 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3723000000000001e-05 2024-04-25T23:01:13.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964386+0000", 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000101374 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3917 4.1e 4:7a4b22dd:::10000003510.00000001:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.964602+0000", 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.0032604259999999999, 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0037717219999999999, 2024-04-25T23:01:13.994 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964602+0000", 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964602+0000", 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964603+0000", 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.6899999999999998e-07 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964606+0000", 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.9639999999999999e-06 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964621+0000", 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5136999999999999e-05 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.964630+0000", 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.965703+0000", 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00107277 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.965969+0000", 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00026656299999999999 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:13.997 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:3925 4.29 4:95f8c0ac:::1000000381f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.967242+0000", 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00062084499999999997, 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001177394, 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967242+0000", 2024-04-25T23:01:13.998 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967242+0000", 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967242+0000", 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.7899999999999999e-07 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:13.999 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967245+0000", 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5129999999999999e-06 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967251+0000", 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5690000000000001e-06 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967258+0000", 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2389999999999999e-06 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.000 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967327+0000", 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9750000000000001e-05 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967448+0000", 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000120932 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(mds.0.3:3922 4.3a e56/17 4:5f7d3757:::1000000351c.00000000:head v 56'178, mlcod=55'175)", 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.967556+0000", 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00030703300000000001, 2024-04-25T23:01:14.001 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00092461599999999996, 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967556+0000", 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967556+0000", 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.002 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967556+0000", 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5700000000000002e-07 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967566+0000", 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5419999999999994e-06 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967577+0000", 2024-04-25T23:01:14.003 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1314999999999999e-05 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967605+0000", 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.747e-05 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967652+0000", 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.7537000000000002e-05 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967685+0000", 2024-04-25T23:01:14.004 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2604999999999997e-05 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "pg_update_log_missing(4.2c epoch 56/17 rep_tid 8524 entries 56'214 (0'0) error 4:346b6c25:::10000003438.00000000:head by mds.0.3:3926 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 56'212)", 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:13.967935+0000", 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4294967295.999928, 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00062920300000000005, 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "reached pg", 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967935+0000", 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967935+0000", 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967935+0000", 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1200000000000003e-07 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.006 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967943+0000", 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.8960000000000003e-06 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967970+0000", 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7081e-05 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.967985+0000", 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5138e-05 2024-04-25T23:01:14.007 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:13.968082+0000", 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6687000000000004e-05 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 10 2024-04-25T23:01:14.008 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:14.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:14.010 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:14.006+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:14.110 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:14.106+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:14.181 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:14.181 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:14.181 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:14.181 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:14.181 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:14.195 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:14.211 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:14.208+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:14.312 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:14.312+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:14.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:14.380 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525610883999999, 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:14.382 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:14.383 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:14.384 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.385 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525536545000001, 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.386 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.387 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.388 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.389 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.390 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525503172000001, 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:14.391 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:14.392 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:14.393 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.394 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.395 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525425268999999, 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.396 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.397 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.398 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.399 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:14.400 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525373983000001, 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.401 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.402 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:14.403 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:14.404 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:14.405 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.52534395, 2024-04-25T23:01:14.406 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.407 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:14.408 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.409 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:14.410 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.411 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525304377000001, 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.412 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.413 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:14.414 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:14.415 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.416 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525274683999999, 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.417 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:14.418 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:14.419 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.420 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.421 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525202797999999, 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:14.423 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:14.424 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.425 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.426 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525168418, 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.427 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:14.428 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.429 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.430 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.431 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.432 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.525138661, 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:14.433 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.434 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.435 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.436 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.437 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.517871976999999, 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:14.438 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:14.439 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:14.440 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.441 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.442 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.507944632000001, 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:14.443 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:14.444 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.445 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.446 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.447 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.504624652, 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.448 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.449 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:14.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:14.451 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:14.452 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.504476589999999, 2024-04-25T23:01:14.453 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.455 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:14.456 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.457 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.503933758999999, 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.458 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:14.459 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.460 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.461 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.462 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.497942109, 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.463 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.465 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.466 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.467 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 9.6898374490000005, 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.468 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:14.469 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.470 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.471 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.0747564989999994, 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.472 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.473 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 8.0725274389999999, 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:14.476 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:14.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:14.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:14.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:14.480 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.480 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.480 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.480 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:14.480 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:14.480 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:14.481 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:14.478+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:14.482 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:14.582 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:14.578+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:14.626 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:14.626 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:14.626 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:14.626 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:14.642 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:14.686 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:14.684+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:14.765 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:14.765 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:14.765 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:14.765 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:14.765 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:14.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:14.784 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:14.782+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:14.885 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:14.882+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.124264728, 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:14.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:14.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.986 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.124233742000001, 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:14.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:14.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.124191320000001, 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:14.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:14.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.124160500999999, 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:14.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:14.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:14.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:14.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.124130822000001, 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:14.999 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.003 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.109873823000001, 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.007 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.109463456, 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:15.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.011 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.106962759000002, 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:15.015 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.106910158000002, 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.106876711999998, 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.020 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:15.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.099524528, 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.024 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:15.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.099411211, 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:15.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.032 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.099347266999999, 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:15.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.099302255000001, 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:15.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:15.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.099265009, 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:15.041 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:15.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.045 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.097931110000001, 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:15.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.095770383000001, 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.050 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.054 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.093624482999999, 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:15.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:15.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:15.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.093258414000001, 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:15.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:15.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:15.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.089804572999999, 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:15.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:15.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:15.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:15.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:15.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:15.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:15.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:15.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:15.068 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:15.069 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:15.070 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:15.064+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:15.170 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:15.166+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:15.191 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:15.191 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:15.191 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:15.191 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:15.205 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:15.257 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:15.291 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:15.290+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:15.353 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:01:15.371 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:15.372 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:15.372 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:15.372 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:15.372 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:15.372 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:15.370+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:15.386 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:15.396 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:15.397 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:15.417 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:15.421 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:15.421 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:15.469 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T23:01:15.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T23:01:15.472 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:15.468+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:15.546 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:15.547 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:15.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:15.607 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:15.604+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:15.673 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:15.668+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:15.695 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:15.695 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:15.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:15.798 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:15.796+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:15.875 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:15.872+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:15.876 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:15.876 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:15.894 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:15.976 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:15.974+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.077 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:16.072+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:16.082 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:16.082 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:16.097 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:16.178 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.174+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.230 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:16.230 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:16.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:16.291 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.290+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.380 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.378+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.419 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:16.419 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:16.434 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:16.519 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.518+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.581 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.578+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.601 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:16.601 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:16.617 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:16.681 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.678+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:16.754 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:16.769 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:16.782 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.778+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:16.882 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:16.880+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:16.907 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:16.907 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:16.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:16.983 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:16.982+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:17.083 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:17.080+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:17.093 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:17.094 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:17.108 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:17.185 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:17.180+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:17.236 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:17.236 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:17.250 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:17.295 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:17.294+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:17.372 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:17.372 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:17.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:01:17.386 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:17.386 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:17.380+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:17.422 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:17.486 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:17.482+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:17.550 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:17.550 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:17.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:17.581 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:17.581 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:17.607 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:17.611 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:17.608+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:17.611 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:17.611 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:17.688 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:17.684+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:17.697 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:17.697 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:17.697 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:17.712 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:17.799 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:17.796+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:17.879 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:17.879 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:17.880 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:17.880 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:17.880 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:17.889 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:17.886+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:17.895 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:17.989 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:17.984+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:18.068 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.211091228000001, 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:18.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:18.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.211060241999999, 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.211017819999999, 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:18.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:18.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:18.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.210987000999999, 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.210957321999999, 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:18.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:18.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:18.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.196700323000002, 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:18.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:18.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:18.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.097 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.196289956000001, 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:18.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:18.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:18.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.193789258999999, 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.106 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.193736657999999, 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.193703211999999, 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:18.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:18.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:18.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.186351028000001, 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:18.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:18.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:18.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:18.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.186237711, 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:18.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.186173767, 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:18.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:18.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.186128754999999, 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:18.128 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.186091509000001, 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:18.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:18.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:18.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.184757609999998, 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.137 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:18.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.141 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.182596882999999, 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:18.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.180450983, 2024-04-25T23:01:18.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.180084913999998, 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.176631072999999, 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:18.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:18.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:18.162 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:18.163 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:18.156+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:18.263 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:18.262+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:18.294 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:18.294 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:18.294 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:18.294 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:18.308 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:18.355 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:01:18.395 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:18.394+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:18.465 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:18.462+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:18.475 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:18.475 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:18.475 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:18.475 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:18.475 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:18.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:18.575 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:18.574+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:18.658 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:18.658 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803779637000002, 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.659 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.660 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.661 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.662 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803705298000001, 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.664 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.665 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:18.666 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:18.667 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.668 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803671925, 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.669 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.670 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.671 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.672 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:18.673 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803594021999999, 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.674 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:18.675 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:18.676 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.677 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803542736000001, 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:18.679 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:18.680 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.681 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.682 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.683 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803512702999999, 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.684 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.685 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.686 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.687 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.688 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.80347313, 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.689 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.690 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.691 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.692 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.693 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803443436999999, 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:18.694 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:18.695 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.698 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803371551000001, 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:18.699 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:18.700 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:18.701 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:18.702 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.703 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803337170999999, 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.704 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.705 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.706 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.707 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:18.708 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.803307413999999, 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.709 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:18.710 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:18.711 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.712 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.713 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.796040730000001, 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:18.714 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:18.715 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:18.716 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.717 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.718 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.786113385, 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.719 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.720 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:18.721 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:18.722 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.723 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.782793405, 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.724 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.725 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.726 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.727 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.728 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.782645342999999, 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.729 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.730 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.731 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.732 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.733 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.782102512000002, 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:18.734 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:18.735 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.736 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.737 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.738 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.776110861999999, 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.739 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:18.740 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:18.741 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.743 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:18.744 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 13.968006202, 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:18.745 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.746 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.747 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.748 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.352925252, 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.749 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:18.750 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:18.751 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:18.752 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.753 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 12.350696192000001, 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.754 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.755 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:18.757 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.758 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.758 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.758 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:18.758 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:18.758 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:18.759 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:18.758+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:18.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:18.861 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:18.858+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:18.892 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:18.892 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:18.892 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:18.892 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:18.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:18.962 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:18.956+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:19.062 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:19.058+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:19.068 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:19.069 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:19.069 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:19.069 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:19.069 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:19.083 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:19.163 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:19.162+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:19.258 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:19.258 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.399234951, 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:19.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:19.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.399203965000002, 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:19.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.399161543000002, 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:19.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.399130723999999, 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:19.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:19.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:19.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:19.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.399101044999998, 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:19.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:19.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.384844046000001, 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:19.282 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:19.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:19.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.384433679000001, 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.381932981999999, 2024-04-25T23:01:19.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:19.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:19.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.381880380999998, 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:19.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:19.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.381846934999999, 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:19.300 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.374494751, 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.374381434, 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:19.309 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.374317489999999, 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:19.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:19.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:19.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:19.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.374272478000002, 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:19.318 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.374235232, 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:19.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:19.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:19.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.372901333000002, 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:19.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:19.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:19.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.331 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.370740605999998, 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.368594706, 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:19.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.368228637000001, 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.364774795999999, 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:19.345 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:19.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:19.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:19.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:19.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:19.350 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:19.351 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:19.352 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:19.350+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:19.453 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:19.448+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:19.485 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:19.485 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:19.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:19.486 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:19.500 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:19.554 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:19.548+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:19.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:19.627 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:19.628 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:19.628 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:19.628 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:19.628 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:19.643 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:19.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-04-25T23:01:19.654 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:19.652+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:19.751 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:19.751 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:19.755 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:19.754+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:19.763 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:19.763 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:19.763 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:19.763 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.90906584, 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.764 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.765 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:19.766 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.767 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.768 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:19.769 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908991500999999, 2024-04-25T23:01:19.770 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.771 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.772 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.773 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.774 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.775 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908958127999998, 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.776 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:19.777 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:19.778 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:19.779 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.780 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908880225000001, 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.781 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:19.782 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.783 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.784 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:19.785 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908828938999999, 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.786 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:19.788 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.789 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.790 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908798906000001, 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.791 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:19.792 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:19.793 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:19.794 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:19.795 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908759332999999, 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.796 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.797 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.798 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:19.799 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:19.800 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908729640000001, 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:19.801 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:19.803 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:19.804 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:19.805 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.806 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908657754, 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.807 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.808 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.809 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.810 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:19.811 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908623374000001, 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.812 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.813 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:19.814 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:19.815 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.816 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.908593617000001, 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.817 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.818 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:19.819 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:19.820 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:19.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.901326933, 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.822 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:19.824 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:19.825 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.826 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.891399587999999, 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.827 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:19.828 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:19.829 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.830 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.831 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:19.832 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.888079607999998, 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:19.833 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.834 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.835 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:19.836 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.887931546000001, 2024-04-25T23:01:19.837 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:19.838 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.839 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.840 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:19.841 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:19.842 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.887388715, 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.843 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.844 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.845 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.846 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.847 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.881397065000002, 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.848 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.849 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:19.850 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:19.851 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:19.852 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.853 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 15.073292405, 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.854 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.855 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.856 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.857 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 13.458211455000001, 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.858 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.859 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.860 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.861 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.862 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 13.455982394999999, 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.863 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.864 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:19.865 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:19.866 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:19.867 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:19.867 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.867 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.867 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.867 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:19.867 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:19.867 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:19.868 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:19.869 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:19.869 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:19.870 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:19.870 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:19.870 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:19.871 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:19.864+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:19.970 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:19.966+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:20.050 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:20.050 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:20.067 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:20.069 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:20.064+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:20.170 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:20.166+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:20.182 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:20.182 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:20.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:20.271 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:20.270+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:20.315 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:20.315 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:20.330 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:20.375 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:20.374+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:20.379 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:01:20.465 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:20.465 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:20.473 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:20.468+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:20.481 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:20.574 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:20.568+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:20.650 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:20.650 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:20.665 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:20.674 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:20.672+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:20.775 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:20.772+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:20.798 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:20.798 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:20.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:20.876 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:20.872+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:20.968 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:20.968 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:20.977 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:20.974+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:20.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:21.079 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:21.076+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:21.179 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:21.176+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:21.197 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:21.198 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:21.212 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:21.280 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:21.278+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:21.368 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:01:21.380 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:21.376+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:21.387 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:21.387 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:21.402 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:21.482 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:21.476+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:21.530 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:21.531 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:21.545 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:21.582 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:21.576+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:21.667 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:21.667 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:21.681 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:21.682 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:21.678+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:21.784 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:21.782+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:21.804 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:21.804 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:21.818 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:21.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:21.884 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:21.882+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:21.972 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:21.972 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:21.986 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:21.982+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:21.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:22.026 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:22.027 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:22.047 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:22.047 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:22.047 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:22.051 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:22.051 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:22.085 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:22.080+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:22.166 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:22.167 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:22.186 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:22.182+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:22.191 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:22.287 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:22.284+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.500163637, 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:22.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.500132651000001, 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:22.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:22.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:22.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.500090229000001, 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:22.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:22.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:22.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.500059409999999, 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.373 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.500029731000001, 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:22.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:22.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.485772732000001, 2024-04-25T23:01:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.485362365, 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.387 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:22.391 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.482861668000002, 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.396 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.482809067000002, 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:22.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:22.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.482775620999998, 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:22.401 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:22.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.475423437, 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.410 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.47531012, 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:22.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:22.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.475246175999999, 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.415 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:22.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:22.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:22.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:22.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:22.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.420 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.422 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.422 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:22.422 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.475201164000001, 2024-04-25T23:01:22.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:22.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:22.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:22.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:22.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.475163918, 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.428 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:22.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.473830019000001, 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.471669292000001, 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.469523391999999, 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.469157323000001, 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.465703481999999, 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:22.458 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:22.459 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:22.460 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:22.458+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:22.560 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:22.556+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:22.587 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:13210 3.19 3:9d0ed013:::200.0000001b:head [write 1440899~19488 [fadvise_dontneed] in=19488b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T23:01:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:22.586987+0000", 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 0.00068422000000000003, 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00075344599999999996, 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.586987+0000", 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.586987+0000", 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.586988+0000", 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.127e-06 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.587006+0000", 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7533999999999998e-05 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.587021+0000", 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5760000000000002e-05 2024-04-25T23:01:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.587029+0000", 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0250000000000002e-06 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.587176+0000", 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014701199999999999 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:22.587408+0000", 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000231611 2024-04-25T23:01:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-04-25T23:01:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 1 2024-04-25T23:01:22.591 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:22.601 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:22.661 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:22.660+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:22.724 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:22.724 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:22.725 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:22.725 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:22.725 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:22.739 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:22.762 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:22.756+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:22.863 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:22.862+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:22.869 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.015096022000002, 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.870 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:22.871 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.872 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.873 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:22.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:22.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.874 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.874 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.874 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:22.874 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:22.874 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:22.875 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.015021683000001, 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:22.876 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.877 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:22.878 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.879 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:22.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:22.880 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.880 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.880 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.880 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:22.880 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:22.881 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:22.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.882 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.882 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.882 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:22.882 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:22.882 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.01498831, 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:22.883 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.884 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.885 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:22.886 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:22.887 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.888 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014910406999999, 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:22.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014859121000001, 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:22.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:22.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:22.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:22.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:22.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:22.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014829087999999, 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:22.900 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:22.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:22.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:22.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:22.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:22.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:22.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:22.906 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.906 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.907 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.907 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.907 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:22.907 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014789515, 2024-04-25T23:01:22.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:22.908 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.908 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.908 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.908 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:22.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:22.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:22.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:22.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:22.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:22.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:22.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:22.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:22.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:22.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:22.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:22.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.916 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014759821999998, 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:22.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:22.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:22.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:22.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:22.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.924 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:22.925 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014687936000001, 2024-04-25T23:01:22.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:22.925 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.925 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.925 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.926 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:22.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:22.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.931 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014653555999999, 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:22.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:22.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:22.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.014623798999999, 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:22.937 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:22.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:22.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:22.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.942 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 31.007357115000001, 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:22.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.944 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:22.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.99742977, 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:22.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:22.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:22.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:22.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:22.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:22.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:22.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:22.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:22.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:22.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:22.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.954 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.954 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:22.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:22.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:22.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:22.957 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.957 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.957 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.958 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:22.958 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:22.958 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.99410979, 2024-04-25T23:01:22.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:22.958 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.959 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:22.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:22.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:22.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:22.964 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.993961727999999, 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:22.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.970 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.993418897000002, 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:22.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:22.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.976 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 30.987427246999999, 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.979 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:22.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:22.982 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 18.179322587000001, 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:22.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:22.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:22.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.986 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 16.564241636999999, 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.987 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:22.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.989 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.990 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:22.991 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 16.562012577000001, 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.992 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.993 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:22.994 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:22.995 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:22.996 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:22.998 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:22.994+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:22.998 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:23.098 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:23.094+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:23.168 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:23.169 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:23.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:23.226 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:23.224+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:23.295 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:23.296 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:23.300 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:23.298+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:23.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:23.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:01:23.401 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:23.398+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:23.476 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.617796298000002, 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.617765312, 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.61772289, 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.617692071, 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.617662392, 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.603405392999999, 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.602995025999999, 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.600494329, 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.600441728, 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.600408282, 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.593056098000002, 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.592942781000001, 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.592878837000001, 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.592833825, 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.592796579000002, 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.591462679999999, 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.589301953, 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.587156053000001, 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.586789983999999, 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.583336143, 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:23.572 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:23.573 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:23.574 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:23.570+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:23.674 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:23.668+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:23.705 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:23.706 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:23.706 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:23.706 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:23.720 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:23.774 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:23.771+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:23.842 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:23.843 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:23.843 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:23.843 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:23.843 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:23.857 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:23.907 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:23.906+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:23.978 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:23.971+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:24.007 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:24.007 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:24.007 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154360525000001, 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:24.008 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.009 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.010 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.011 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:24.012 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154286186, 2024-04-25T23:01:24.013 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.014 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:24.015 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.016 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.017 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.018 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154252812999999, 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.019 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.020 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:24.021 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:24.022 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.024 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154174910000002, 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:24.025 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.026 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.027 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.028 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.029 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154123624, 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.031 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.031 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:24.032 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:24.033 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.034 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.035 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.036 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154093590999999, 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.037 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:24.038 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:24.039 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.040 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.041 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154054017999997, 2024-04-25T23:01:24.042 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:24.043 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.044 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.045 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:24.046 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.047 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.048 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.154024325000002, 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:24.049 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.050 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.051 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:24.052 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:24.053 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.153952439000001, 2024-04-25T23:01:24.054 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.055 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:24.056 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:24.057 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:24.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:24.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:24.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:24.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:24.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:24.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.062 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.062 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.062 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.062 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.153918058999999, 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.065 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:24.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.068 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.153888301999999, 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.074 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.146621617999998, 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.075 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:24.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:24.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:24.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.136694273000003, 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.085 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.133374293000003, 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:24.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:24.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:24.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.090 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.133226231000002, 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:24.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:24.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:24.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.132683399999998, 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:24.096 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:24.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.101 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 32.126691749999999, 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:24.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 19.318587090000001, 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:24.107 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.703506140000002, 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.112 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:24.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:24.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:24.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.116 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 17.701277080000001, 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:24.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:24.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:24.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:24.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:24.121 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:24.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:24.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:24.124 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:24.119+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:24.224 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:24.222+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:24.254 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:24.255 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:24.255 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:24.255 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:24.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:24.287 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:24.288 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:24.311 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:24.311 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:24.311 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:24.315 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:24.315 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:24.325 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:24.319+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:24.376 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:01:24.397 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:24.397 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:24.411 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:24.426 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:24.422+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:24.526 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:24.522+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:24.577 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:24.577 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:24.591 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:24.627 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:24.623+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:24.722 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:24.722 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:24.728 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:24.723+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:24.736 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:24.829 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:24.823+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:24.857 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:24.857 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:24.872 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:24.929 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:24.926+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.024 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:25.024 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:25.030 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.026+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.047 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:25.131 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.130+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.180 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:25.180 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:25.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:25.232 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.230+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.324 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:25.324 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:25.333 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.330+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:25.434 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:25.427+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:25.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-04-25T23:01:25.464 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:25.464 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:25.479 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:25.537 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.534+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.608 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:25.608 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:25.623 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:25.671 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.670+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.736 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:25.731+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:25.793 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:25.793 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:25.807 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:25.855 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.854+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.937 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:25.934+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:25.941 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:25.941 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:25.960 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:26.038 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:26.034+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:26.126 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:26.127 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:26.139 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:26.138+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:26.141 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:26.240 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:26.238+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:26.266 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:26.267 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:26.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:26.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:26.341 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:26.335+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:26.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:01:26.407 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:26.407 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:26.422 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:26.461 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:26.462 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:26.467 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:26.466+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:26.481 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:26.482 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:26.482 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:26.485 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:26.485 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:26.543 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:26.539+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:26.558 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:26.558 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:26.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:26.558 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:26.573 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:26.643 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:26.639+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:26.744 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:26.739+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:26.744 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:26.745 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:26.745 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:26.745 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:26.745 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:26.759 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:26.845 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:26.839+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.034068294999997, 2024-04-25T23:01:26.888 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.889 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:26.890 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.891 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.892 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.893 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033993956000003, 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:26.894 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:26.895 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:26.896 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:26.897 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.898 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033960583000002, 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.899 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.900 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.901 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.902 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.903 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033882679999998, 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.904 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.905 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.906 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:26.907 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.908 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033831394000003, 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:26.909 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:26.910 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.911 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.913 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033801361000002, 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.914 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:26.915 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.916 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.917 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033761788, 2024-04-25T23:01:26.918 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.919 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.920 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.921 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.922 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033732094999998, 2024-04-25T23:01:26.923 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.924 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.925 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.926 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.927 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.928 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033660208999997, 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:26.929 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:26.930 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:26.931 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.932 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.933 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033625829000002, 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.934 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.935 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.936 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.937 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.938 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.033596072000002, 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.939 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:26.940 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:26.941 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.942 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.943 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.026329388000001, 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:26.944 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.945 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.946 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.947 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.948 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.016402042999999, 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:26.949 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.950 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.951 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.952 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.953 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.013082062999999, 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.954 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.955 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:26.956 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.012934000999998, 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.960 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.961 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.962 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.963 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.012391170000001, 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.964 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:26.965 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.966 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:26.967 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:26.968 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 35.006399520000002, 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:26.969 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.970 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:26.971 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:26.972 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.973 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.974 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 22.198294860000001, 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.975 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.976 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:26.978 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 20.583213910000001, 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:26.979 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.980 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.981 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:26.982 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:26.983 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 20.58098485, 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:26.984 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:26.985 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.986 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:26.987 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:26.988 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:26.989 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:26.991 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:26.983+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:27.090 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:27.086+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:27.143 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:27.144 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:27.144 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:27.144 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:27.157 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:27.202 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:27.199+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:27.278 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:27.279 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:27.279 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:27.279 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:27.279 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:27.292 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:27.293 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:27.290+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:27.393 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:01:27.393 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:27.387+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.603567593000001, 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.603536606999999, 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.603494184999999, 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.603463366, 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.603433686999999, 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:27.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.484 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.589176687999998, 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:27.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:27.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:27.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.588766321000001, 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:27.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:27.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.586265623999999, 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.586213022999999, 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.498 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:27.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:27.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.586179576999999, 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:27.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.507 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.578827393000001, 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.578714076000001, 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.512 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:27.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:27.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.516 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.578650132, 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.578605119999999, 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:27.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:27.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.578567874000001, 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.577233974999999, 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:27.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.575073247999999, 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.572927348, 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.572561278999999, 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:27.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.569107438, 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:27.546 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:27.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:27.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:27.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:27.551 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:27.552 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:27.552 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:27.550+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:27.652 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:27.650+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:27.686 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:27.686 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:27.686 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:27.687 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:27.701 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:27.753 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:27.751+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:27.797 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T23:01:27.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T23:01:27.854 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:27.850+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:27.869 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:27.869 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:27.869 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:27.869 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:27.869 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:27.883 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:27.971 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:27.970+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:28.055 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:28.051+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225428383000001, 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.079 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:28.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:28.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.084 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225354043999999, 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:28.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:28.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:28.089 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225320670999999, 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:28.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:28.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:28.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:28.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:28.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225242768000001, 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.096 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:28.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:28.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225191482, 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:28.101 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.105 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.106 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225161448999998, 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:28.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.111 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225121876000003, 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225092183000001, 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:28.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:28.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.121 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.225020297, 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:28.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:28.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:28.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.128 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.224985916999998, 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:28.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:28.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.133 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.224956159999998, 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:28.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:28.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.138 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.217689475999997, 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.139 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:28.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:28.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:28.144 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.207762131000003, 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:28.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:28.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.204442151000002, 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:28.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:28.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:28.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:28.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:28.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:28.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:28.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.204294089000001, 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:28.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:28.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.160 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.203751257999997, 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:28.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:28.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:28.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 36.197759607999998, 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:28.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:28.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 23.389654948, 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.172 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:28.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.176 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 21.774573998000001, 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:28.181 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 21.772344938, 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.185 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.186 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:28.186 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:28.186 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:28.188 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:28.186+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:28.188 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:28.189 DEBUG:teuthology.parallel:result is None 2024-04-25T23:01:28.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T23:01:28.212 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T23:01:28.212 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T23:01:28.224 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T23:01:28.224 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T23:01:28.224 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T23:01:28.261 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T23:01:28.261 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T23:01:28.288 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:28.283+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:28.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:01:28.322 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:28.322 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:28.322 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:28.323 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:28.336 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:28.388 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:28.386+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:28.486 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:28.489 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:28.486+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:28.501 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:28.501 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:28.501 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:28.501 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:28.501 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:28.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:28.590 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:28.587+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:28.627 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:28.627 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:28.630 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:28.630 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:28.644 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:28.648 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:28.648 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:28.648 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:28.652 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:28.653 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:28.663 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:01:28.663 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":61,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T23:01:27.386494+0000","last_up_change":"2024-04-25T22:59:33.885587+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5399999618530273,"score_stable":1.5399999618530273,"optimal_score":0.67000001668930054,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":21}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:01:28.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:58:56.581519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:59:00.664462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:59:04.692579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:59:05.120185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T23:01:28.683 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T23:01:28.691 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:28.690+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:28.773 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:28.774 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:28.787 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:28.831 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:28.830+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:28.893 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:28.890+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:28.949 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:28.949 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:28.963 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:28.995 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:28.987+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:29.026 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T23:01:29.047 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T23:01:29.094 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:29.090+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:29.161 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:29.203 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:29.202+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:29.289 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:29.289 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:29.295 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:29.291+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:29.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:29.344 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-25T23:01:29.365 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T23:01:29.396 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:29.391+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:29.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T23:01:29.465 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:29.465 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:29.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:29.497 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:29.494+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:29.597 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:29.594+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:29.637 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:29.638 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:29.651 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:29.677 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T23:01:29.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T23:01:29.699 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:29.698+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:29.781 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:29.781 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:29.795 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:29.797 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:29.791+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:29.898 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:29.895+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:29.963 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:29.963 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:29.980 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:30.000 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:29.995+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:30.005 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T23:01:30.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T23:01:30.099 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:30.095+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:30.132 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:30.132 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:30.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:30.200 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:30.198+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:30.275 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:30.275 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:30.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:30.301 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:30.298+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-04-25T23:01:30.361 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T23:01:30.361 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T23:01:30.367 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:01:30.402 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:30.395+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-25T23:01:30.413 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:30.413 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:30.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:30.502 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:30.498+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:30.595 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:30.595 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:30.603 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:30.602+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:30.609 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:30.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:30.704 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:30.702+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:30.714 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:01:30.714 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":62,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T23:01:30.399618+0000","last_up_change":"2024-04-25T22:59:33.885587+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5399999618530273,"score_stable":1.5399999618530273,"optimal_score":0.67000001668930054,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6801","nonce":3449711934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6803","nonce":3449711934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6807","nonce":3449711934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3449711934},{"type":"v1","addr":"172.21.15.172:6805","nonce":3449711934}]},"public_addr":"172.21.15.172:6801/3449711934","cluster_addr":"172.21.15.172:6803/3449711934","heartbeat_back_addr":"172.21.15.172:6807/3449711934","heartbeat_front_addr":"172.21.15.172:6805/3449711934","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":21}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:01:30.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:58:56.581519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:59:00.664462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:59:04.692579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:59:05.120185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T23:01:30.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T23:01:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:30.758 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:30.804 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:30.799+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:30.815 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:30.815 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:30.835 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:30.840 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:30.840 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:30.905 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:30.903+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:30.920 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:30.920 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:30.920 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:30.920 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:30.920 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:30.934 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:31.006 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.002+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.031 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T23:01:31.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T23:01:31.056 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:31.056 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201807950999999, 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:31.057 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.058 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:31.059 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:31.060 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.061 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:31.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:31.062 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.062 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.062 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.062 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:31.062 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:31.063 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.063 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.063 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.063 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:31.063 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:31.064 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.064 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.064 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.064 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.064 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.064 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.065 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:31.065 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201733611999998, 2024-04-25T23:01:31.065 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:31.065 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.065 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.066 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.066 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.066 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.066 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.066 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:31.066 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.067 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.067 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.067 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:31.067 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.067 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.068 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.068 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.068 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:31.068 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:31.068 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.069 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.069 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:31.069 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:31.069 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.069 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.070 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.070 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:31.070 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:31.070 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.070 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:31.071 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:31.071 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.071 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.071 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.071 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:31.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:31.072 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.072 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.072 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.072 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:31.072 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:31.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.073 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.073 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.073 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:31.073 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:31.073 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.074 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.074 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.074 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:31.074 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:31.074 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.075 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.075 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:31.075 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:31.075 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.075 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.076 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:31.076 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:31.076 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.076 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.076 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.077 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:31.077 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:31.077 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.077 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.077 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.077 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.078 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.078 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.078 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:31.078 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201700238999997, 2024-04-25T23:01:31.078 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:31.078 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.079 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.079 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.079 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.079 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.079 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:31.080 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.080 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.080 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.080 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.080 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:31.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.081 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.081 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.081 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:31.081 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:31.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.082 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.082 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.082 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:31.082 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:31.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:31.083 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:31.084 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:31.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:31.086 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201622336, 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.087 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.088 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:31.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:31.089 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.089 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.089 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.089 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:31.089 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.090 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:31.091 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:31.092 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201571049999998, 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:31.093 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.094 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.095 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:31.096 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:31.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.097 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.097 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:31.097 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:31.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.097 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.098 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.099 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201541016999997, 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:31.100 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:31.101 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:31.102 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:31.103 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:31.104 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201501444000002, 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.105 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.106 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.107 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.108 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.109 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.110 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201471751, 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:31.111 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:31.112 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:31.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.114 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.114 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.114 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:31.114 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:31.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.115 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.115 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:31.115 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:31.115 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.115 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:31.116 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:31.117 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.117 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.117 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.117 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:31.117 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.118 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201399864999999, 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:31.119 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:31.120 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:31.121 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.122 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.123 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201365484999997, 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.124 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.125 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.126 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.127 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:31.128 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.201335727999997, 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.129 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.130 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:31.131 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.132 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:31.133 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.134 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.194069044000003, 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.135 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:31.136 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:31.137 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.139 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.184141699000001, 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:31.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.180821719000001, 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:31.145 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.149 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.180673657, 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:31.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.155 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.180130826000003, 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:31.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:31.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:31.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 39.174139175999997, 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.161 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:31.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 26.366034515999999, 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:31.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 24.750953566, 2024-04-25T23:01:31.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:31.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:31.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:31.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:31.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:31.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:31.176 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 24.748724505999999, 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:31.177 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:31.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:31.181 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:31.184 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.182+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:31.283 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.282+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.314 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:31.314 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:31.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:31.361 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-25T23:01:31.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T23:01:31.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-04-25T23:01:31.384 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.382+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.451 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:31.451 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:31.451 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:31.451 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:31.451 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:31.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:31.484 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.482+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.585 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.582+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.588 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:31.588 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:31.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:31.588 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:31.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 1895825~1423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.730946506000002, 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069087603999999997, 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:31.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855639+0000", 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855640+0000", 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855645+0000", 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.023e-06 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855653+0000", 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9269999999999994e-06 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855661+0000", 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4059999999999999e-06 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917670+0000", 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062009164999999998 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.917859+0000", 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189304 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924430+0000", 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065710719999999999 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924572+0000", 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014202799999999999 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924726+0000", 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153979 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.593 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 1897248~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.730915520000003, 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069328529, 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855670+0000", 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855671+0000", 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855681+0000", 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-05 2024-04-25T23:01:31.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855695+0000", 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855703+0000", 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6799999999999993e-06 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919493+0000", 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063789955999999995 2024-04-25T23:01:31.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.919631+0000", 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138116 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924748+0000", 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051171660000000002 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924886+0000", 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013758600000000001 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.924998+0000", 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011283899999999999 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 1898653~1420 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.730873098000004, 2024-04-25T23:01:31.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069494274999999994, 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855712+0000", 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855713+0000", 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9999999999999997e-07 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855718+0000", 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9030000000000003e-06 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855727+0000", 2024-04-25T23:01:31.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7329999999999992e-06 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855734+0000", 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4429999999999997e-06 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920452+0000", 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064717775000000005 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.920566+0000", 2024-04-25T23:01:31.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114277 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925017+0000", 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004450463 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925097+0000", 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0370000000000005e-05 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.925207+0000", 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109611 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 1900073~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.730842279000001, 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072413020999999994, 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.603 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855743+0000", 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855744+0000", 2024-04-25T23:01:31.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855748+0000", 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1400000000000002e-06 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855757+0000", 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7700000000000007e-06 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855764+0000", 2024-04-25T23:01:31.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.43e-06 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.921886+0000", 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066121637999999996 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.922003+0000", 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117169 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927775+0000", 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057725600000000004 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.927932+0000", 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156231 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928156+0000", 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022437299999999999 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 1901474~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.7308126, 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072831906000000002, 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855773+0000", 2024-04-25T23:01:31.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855783+0000", 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9969999999999993e-06 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855792+0000", 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0629999999999995e-06 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.855800+0000", 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5299999999999999e-06 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923045+0000", 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067245466000000004 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.923346+0000", 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000300425 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928201+0000", 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048549270000000002 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928370+0000", 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016880500000000001 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.928605+0000", 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023499999999999999 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 1929946~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.716555601000003, 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069412520000000005, 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:31.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870030+0000", 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870031+0000", 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.646e-06 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870038+0000", 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6630000000000004e-06 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870054+0000", 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.575e-05 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870064+0000", 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9960000000000005e-06 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.930983+0000", 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060918954999999997 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.931148+0000", 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164852 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939098+0000", 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079505219999999998 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939274+0000", 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017613500000000001 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939442+0000", 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016800100000000001 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 1931355~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.617 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.716145234000003, 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069278917999999995, 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870440+0000", 2024-04-25T23:01:31.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870441+0000", 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870447+0000", 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7270000000000004e-06 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870463+0000", 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6045999999999998e-05 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.870473+0000", 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4029999999999996e-06 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.932967+0000", 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062494159000000001 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.933229+0000", 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026208900000000002 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939459+0000", 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062304049999999996 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939566+0000", 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106934 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.939719+0000", 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152795 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:201 3.1d 3:bec1251c:::200.00000007:head [write 1934188~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.713644537, 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070283644000000006, 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872941+0000", 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872942+0000", 2024-04-25T23:01:31.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872963+0000", 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1512e-05 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872974+0000", 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0824e-05 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872982+0000", 2024-04-25T23:01:31.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4300000000000006e-06 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937039+0000", 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064056167999999997 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.937231+0000", 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019218699999999999 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.942997+0000", 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057666000000000002 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943094+0000", 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6720999999999998e-05 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943224+0000", 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013042899999999999 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:202 3.1d 3:bec1251c:::200.00000007:head [write 1935605~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.713591936, 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074477050000000003, 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:31.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872993+0000", 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.872994+0000", 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0999999999999998e-07 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873001+0000", 2024-04-25T23:01:31.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3999999999999997e-06 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873010+0000", 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4169999999999998e-06 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873017+0000", 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.559e-06 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938111+0000", 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065093106999999997 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.938232+0000", 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012167000000000001 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947241+0000", 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090090699999999992 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947343+0000", 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101827 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947470+0000", 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012729000000000001 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 1937530~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.631 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.713558489999997, 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.074635647999999999, 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873027+0000", 2024-04-25T23:01:31.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873028+0000", 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9299999999999997e-07 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873045+0000", 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-05 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873055+0000", 2024-04-25T23:01:31.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0079e-05 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.873063+0000", 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6170000000000001e-06 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940085+0000", 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067022183999999999 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.940312+0000", 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022683299999999999 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947485+0000", 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071731970000000001 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947556+0000", 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1027999999999998e-05 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947663+0000", 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106647 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 1945730~5032 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.706206305999999, 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069710112000000005, 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.636 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880379+0000", 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880382+0000", 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000002e-06 2024-04-25T23:01:31.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880419+0000", 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7069e-05 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880445+0000", 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6225e-05 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880462+0000", 2024-04-25T23:01:31.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7303999999999999e-05 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941712+0000", 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061249420999999998 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.941945+0000", 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023340000000000001 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949779+0000", 2024-04-25T23:01:31.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078335899999999997 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.949923+0000", 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143988 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950089+0000", 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016634500000000001 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:205 3.1d 3:bec1251c:::200.00000007:head [write 1950762~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.706092988999998, 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069817235000000005, 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880492+0000", 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880493+0000", 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260000000000001e-06 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880518+0000", 2024-04-25T23:01:31.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4573e-05 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880531+0000", 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.272e-05 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880542+0000", 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1282e-05 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943363+0000", 2024-04-25T23:01:31.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062820723999999994 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.943511+0000", 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000148622 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950107+0000", 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065953180000000002 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950180+0000", 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3497000000000005e-05 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950310+0000", 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012937300000000001 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:206 3.1d 3:bec1251c:::200.00000007:head [write 1955061~2763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:31.645 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.706029045000001, 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070033982999999994, 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880556+0000", 2024-04-25T23:01:31.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880557+0000", 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0270000000000001e-06 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880569+0000", 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1853e-05 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880582+0000", 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3239e-05 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880591+0000", 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3140000000000004e-06 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944323+0000", 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063732475999999996 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.944424+0000", 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100997 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950346+0000", 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005921557 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950472+0000", 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126513 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950590+0000", 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118007 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 1957824~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.705984033, 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070176505, 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880601+0000", 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880602+0000", 2024-04-25T23:01:31.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8000000000000005e-07 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880607+0000", 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8899999999999998e-06 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880620+0000", 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3093e-05 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880629+0000", 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9830000000000002e-06 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945123+0000", 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064494265999999995 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.945224+0000", 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101029 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950606+0000", 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053811520000000002 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950675+0000", 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9037999999999999e-05 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950778+0000", 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103274 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 1960588~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.705946787000002, 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.072854848999999999, 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880639+0000", 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3600000000000002e-07 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880652+0000", 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2989999999999999e-05 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880670+0000", 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7469000000000002e-05 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.880678+0000", 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9230000000000002e-06 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946053+0000", 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065375535999999998 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.946202+0000", 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953209+0000", 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070068439999999999 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953313+0000", 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010453 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953493+0000", 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018007200000000001 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 1963355~6566 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.659 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.704612888, 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071799501000000002, 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881972+0000", 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881974+0000", 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9889999999999999e-06 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.881994+0000", 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9397000000000001e-05 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882021+0000", 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7005999999999999e-05 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.882036+0000", 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5522000000000001e-05 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947732+0000", 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065695669999999998 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.947831+0000", 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8921999999999999e-05 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953505+0000", 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056739260000000001 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953575+0000", 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0254999999999997e-05 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953772+0000", 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019681399999999999 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 1969921~3884 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.702452160999997, 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.069896149000000005, 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884133+0000", 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884135+0000", 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.703e-06 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884153+0000", 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7719000000000001e-05 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884182+0000", 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9479999999999999e-05 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.884201+0000", 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9326000000000001e-05 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948675+0000", 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064473245999999998 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.948836+0000", 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016145499999999999 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953789+0000", 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049527479999999999 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.953868+0000", 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8733999999999995e-05 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.954029+0000", 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161738 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 1973805~6147 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.700306261000001, 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.070268912000000003, 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:31.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886279+0000", 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886281+0000", 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9199999999999998e-06 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886298+0000", 2024-04-25T23:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6623e-05 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886326+0000", 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8552999999999999e-05 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886346+0000", 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9335999999999999e-05 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950866+0000", 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064520757999999998 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.950993+0000", 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127043 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956339+0000", 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053456420000000003 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956422+0000", 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3071000000000005e-05 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.956548+0000", 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012596600000000001 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bec1251c:::200.00000007:head [write 1979952~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.699940192, 2024-04-25T23:01:31.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.071906861000000002, 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886645+0000", 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886647+0000", 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6300000000000001e-06 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886660+0000", 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3349999999999999e-05 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886677+0000", 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6532999999999999e-05 2024-04-25T23:01:31.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.886687+0000", 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9590000000000007e-06 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952011+0000", 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065324214000000005 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952244+0000", 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322300000000001 2024-04-25T23:01:31.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958164+0000", 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059202040000000001 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958319+0000", 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000154365 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958552+0000", 2024-04-25T23:01:31.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023338300000000001 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4556.0:7753 4.25 4:a5119f79:::10000002347.00000000:head [write 0~2733] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.696486350999997, 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068832195999999998, 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-04-25T23:01:31.678 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4556", 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7753 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890099+0000", 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890101+0000", 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1430000000000001e-06 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890114+0000", 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3076e-05 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890135+0000", 2024-04-25T23:01:31.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0922999999999999e-05 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.890148+0000", 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3016e-05 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.951992+0000", 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061843658000000003 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:31.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.952308+0000", 2024-04-25T23:01:31.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000316583 2024-04-25T23:01:31.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-04-25T23:01:31.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958626+0000", 2024-04-25T23:01:31.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063176760000000004 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958767+0000", 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141089 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:00:56.958931+0000", 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016403199999999999 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:31.684 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:31.684 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:31.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:31.686 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T23:01:31.686 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.682+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.705 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T23:01:31.787 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:31.786+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:31.816 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:31.816 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:31.816 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:31.816 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:31.830 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:31.888 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:31.887+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:31.989 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:31.983+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:32.000 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:32.000 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:32.000 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:32.000 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:32.000 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:32.003 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T23:01:32.014 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:32.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T23:01:32.089 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:32.083+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:32.138 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 1104721~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284600339000001, 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054658407999999999, 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851460+0000", 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851461+0000", 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6729999999999999e-06 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851480+0000", 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8686999999999999e-05 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851498+0000", 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8476999999999999e-05 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851521+0000", 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2362e-05 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.141 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896374+0000", 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.044853174000000003 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896575+0000", 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00020078899999999999 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.896779+0000", 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000204565 2024-04-25T23:01:32.142 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899848+0000", 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030683849999999999 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905982+0000", 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061346600000000001 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.143 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906058+0000", 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5395999999999994e-05 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906118+0000", 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.0239999999999999e-05 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 1106122~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.144 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284526, 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054699804999999997, 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.145 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851534+0000", 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851535+0000", 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.7000000000000004e-07 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851540+0000", 2024-04-25T23:01:32.146 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2599999999999996e-06 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851550+0000", 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0053e-05 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851558+0000", 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.644e-06 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897731+0000", 2024-04-25T23:01:32.147 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.046173585000000003 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.897845+0000", 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000113843 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898024+0000", 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000179295 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.148 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899954+0000", 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019297559999999999 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906132+0000", 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0061776649999999997 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906191+0000", 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9008999999999997e-05 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.149 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906234+0000", 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2925e-05 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 1107525~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284492626999999, 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055684677000000002, 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.150 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851567+0000", 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851568+0000", 2024-04-25T23:01:32.151 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1699999999999997e-07 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851572+0000", 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851581+0000", 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1670000000000005e-06 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.152 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851623+0000", 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.1292999999999999e-05 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898726+0000", 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047103212999999998 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.898843+0000", 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000117323 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.153 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.899038+0000", 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019487399999999999 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902441+0000", 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034030000000000002 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907118+0000", 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.004676815 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.154 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907192+0000", 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4311000000000001e-05 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907252+0000", 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9654000000000002e-05 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 1108929~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:32.155 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284414724000001, 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055729134999999999, 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851645+0000", 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851646+0000", 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.37e-07 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851666+0000", 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0299e-05 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.157 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851678+0000", 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1433999999999999e-05 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851686+0000", 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.0399999999999993e-06 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900343+0000", 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048657082999999997 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.158 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900474+0000", 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013176799999999999 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.900665+0000", 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019041199999999999 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905716+0000", 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0050515209999999998 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.159 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907266+0000", 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00154944 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907326+0000", 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.9710000000000003e-05 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907374+0000", 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8690999999999998e-05 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.160 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 1110334~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284363438, 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055789746000000001, 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.161 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851696+0000", 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851697+0000", 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851701+0000", 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.4170000000000002e-06 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.162 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851711+0000", 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1030000000000008e-06 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851718+0000", 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9369999999999998e-06 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901477+0000", 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049759729000000003 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.163 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901609+0000", 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013172600000000001 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.901797+0000", 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018751799999999999 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905843+0000", 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0040462459999999999 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.164 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907386+0000", 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001543546 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907444+0000", 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7803000000000002e-05 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907486+0000", 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.2051000000000001e-05 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.165 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 1111733~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284333404999998, 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.05589562, 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851726+0000", 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.167 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851727+0000", 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.44e-07 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851736+0000", 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2699999999999993e-06 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851748+0000", 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2129e-05 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.168 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851756+0000", 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.6199999999999999e-06 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902525+0000", 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.050769347999999999 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902685+0000", 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00016001500000000001 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.169 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.902878+0000", 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019205200000000001 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.905964+0000", 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030869309999999998 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907499+0000", 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015343290000000001 2024-04-25T23:01:32.170 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907552+0000", 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3563000000000002e-05 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907622+0000", 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9719000000000001e-05 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.171 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 1113132~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284293832000003, 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.058991173000000001, 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851766+0000", 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.172 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851767+0000", 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.5300000000000004e-07 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851771+0000", 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0570000000000003e-06 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851780+0000", 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9970000000000004e-06 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851787+0000", 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.1400000000000002e-06 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.174 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903477+0000", 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051690058999999997 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903618+0000", 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014130499999999999 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.903806+0000", 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00018762499999999999 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.175 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906321+0000", 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0025156380000000002 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910560+0000", 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0042383170000000001 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910639+0000", 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.9388999999999995e-05 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.176 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910757+0000", 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011799299999999999 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 1114553~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284264139000001, 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060780149999999998, 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.177 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851796+0000", 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1399999999999997e-07 2024-04-25T23:01:32.178 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851805+0000", 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.6200000000000005e-06 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851814+0000", 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2029999999999998e-06 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851854+0000", 2024-04-25T23:01:32.179 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.0235999999999999e-05 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906386+0000", 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054531149000000001 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906487+0000", 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010172500000000001 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.180 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.906653+0000", 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000165253 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910537+0000", 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003884448 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912386+0000", 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001848934 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.181 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912461+0000", 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5161999999999996e-05 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912576+0000", 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000114806 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 1115959~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.182 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284192253000001, 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065482422999999998, 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.183 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851868+0000", 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.3699999999999999e-07 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851874+0000", 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.184 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851885+0000", 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-05 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851893+0000", 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.4529999999999996e-06 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.185 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907690+0000", 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055797009000000002 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907808+0000", 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000118231 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.907958+0000", 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015048199999999999 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.186 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910894+0000", 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0029352599999999999 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917155+0000", 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0062611799999999999 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917243+0000", 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.7808999999999999e-05 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.187 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917350+0000", 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00010734900000000001 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 1117364~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284157872999998, 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065708377999999998, 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.188 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851902+0000", 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851903+0000", 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.3e-07 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.189 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851907+0000", 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.3200000000000001e-06 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851916+0000", 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.0469999999999999e-06 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.190 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851923+0000", 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.9800000000000001e-06 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908725+0000", 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.056802478000000003 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.191 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.192 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.908845+0000", 2024-04-25T23:01:32.194 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000119623 2024-04-25T23:01:32.194 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.194 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.194 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.194 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909044+0000", 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000199054 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.912366+0000", 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00332212 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.195 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917364+0000", 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0049980609999999998 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917435+0000", 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.0852999999999994e-05 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917610+0000", 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175212 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.196 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 1118765~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.284128115999998, 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.065981328000000006, 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.197 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851932+0000", 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7000000000000004e-07 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851945+0000", 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2893e-05 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.199 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851955+0000", 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4329999999999993e-06 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.851962+0000", 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.097e-06 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909837+0000", 2024-04-25T23:01:32.200 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057875493 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.909934+0000", 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.6484000000000007e-05 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910079+0000", 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000145136 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.914660+0000", 2024-04-25T23:01:32.201 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0045806629999999996 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917677+0000", 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.003017044 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917798+0000", 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000121172 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.202 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.203 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917913+0000", 2024-04-25T23:01:32.203 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011524299999999999 2024-04-25T23:01:32.203 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.203 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.203 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.203 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.203 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5287 4.3f 4:fdc7e156:::10000001886.00000000:head [write 0~1032] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.276861431999997, 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060654529999999998, 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5287 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.204 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859198+0000", 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.205 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859201+0000", 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4059999999999999e-06 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859214+0000", 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2777e-05 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859237+0000", 2024-04-25T23:01:32.206 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.3711e-05 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.859256+0000", 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8640000000000001e-05 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.910845+0000", 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051589131000000003 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.207 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.911158+0000", 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031266399999999999 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919477+0000", 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0083187969999999993 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.208 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919633+0000", 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00015607199999999999 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.919853+0000", 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000220332 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 1163301~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.266934087000003, 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053406327000000003, 2024-04-25T23:01:32.209 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.210 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869126+0000", 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.7999999999999995e-07 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869136+0000", 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4469999999999995e-06 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869145+0000", 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.4499999999999993e-06 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.211 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.869155+0000", 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0113e-05 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.917996+0000", 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048840358 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918221+0000", 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022557400000000001 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.918571+0000", 2024-04-25T23:01:32.212 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000350114 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921225+0000", 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0026534520000000002 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922384+0000", 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00115901 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922465+0000", 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.1238999999999999e-05 2024-04-25T23:01:32.213 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922532+0000", 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.6890000000000005e-05 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:5294 4.37 4:eeb50346:::1000000188d.00000000:head [write 0~4329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.263614107000002, 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054074079999999997, 2024-04-25T23:01:32.214 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 5294 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:32.215 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872446+0000", 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872448+0000", 2024-04-25T23:01:32.216 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1110000000000002e-06 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872471+0000", 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2759999999999999e-05 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872496+0000", 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.5287999999999999e-05 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872513+0000", 2024-04-25T23:01:32.217 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7442999999999999e-05 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921192+0000", 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048678922999999999 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921376+0000", 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000183752 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926174+0000", 2024-04-25T23:01:32.218 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0047983870000000003 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926312+0000", 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000137491 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926520+0000", 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000207925 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 1165220~7808 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.219 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.263466045000001, 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.054212692, 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872594+0000", 2024-04-25T23:01:32.220 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872600+0000", 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.2829999999999998e-06 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872621+0000", 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0633e-05 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872649+0000", 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.8717e-05 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.221 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.872674+0000", 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.4130000000000001e-05 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921270+0000", 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.048596113000000003 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921359+0000", 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.9445999999999997e-05 2024-04-25T23:01:32.222 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.921510+0000", 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000150834 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926209+0000", 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0046992470000000001 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926546+0000", 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00033677499999999999 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.223 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926681+0000", 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013476499999999999 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926806+0000", 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00012574900000000001 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 1173028~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:32.224 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.262923213999997, 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055240276999999997, 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873137+0000", 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.225 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873139+0000", 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.2239999999999998e-06 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873156+0000", 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7376000000000001e-05 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873208+0000", 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1440000000000002e-05 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.226 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.873236+0000", 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.7909999999999999e-05 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922569+0000", 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.049333780000000001 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922662+0000", 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.2414e-05 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.227 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.922807+0000", 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00014509899999999999 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.926287+0000", 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0034805460000000002 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928244+0000", 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0019564460000000001 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.228 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928319+0000", 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 7.5102e-05 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928377+0000", 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.7939999999999998e-05 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 1189728~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T23:01:32.229 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 40.256931563999999, 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.055077926999999999, 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.230 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879128+0000", 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879130+0000", 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8929999999999999e-06 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879146+0000", 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5783000000000001e-05 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.231 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879164+0000", 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.838e-05 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.879177+0000", 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3013000000000001e-05 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924585+0000", 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045407601999999998 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.232 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.924810+0000", 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022454500000000001 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "waiting for subops from 0", 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.925164+0000", 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00035447000000000001 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "sub_op_commit_rec", 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.928435+0000", 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0032711900000000002 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.233 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.933940+0000", 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00550492 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934067+0000", 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000126783 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:00:51.934206+0000", 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00013934799999999999 2024-04-25T23:01:32.234 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:10740 4.1b e53/17 4:db8b39f1:::100000030f6.00000000:head v 53'160, mlcod=52'158)", 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 27.448826904000001, 2024-04-25T23:01:32.235 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053383673999999999, 2024-04-25T23:01:32.236 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.236 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.236 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.236 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.236 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.236 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.236 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:32.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.237 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.237 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.237 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.237 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687233+0000", 2024-04-25T23:01:32.237 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.238 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.238 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.238 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.687235+0000", 2024-04-25T23:01:32.238 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7439999999999999e-06 2024-04-25T23:01:32.238 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.239 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.239 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707494+0000", 2024-04-25T23:01:32.239 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020259196 2024-04-25T23:01:32.239 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.239 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.240 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707513+0000", 2024-04-25T23:01:32.240 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9165999999999999e-05 2024-04-25T23:01:32.240 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.240 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.240 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707524+0000", 2024-04-25T23:01:32.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1240000000000001e-05 2024-04-25T23:01:32.241 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.241 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.241 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.241 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707679+0000", 2024-04-25T23:01:32.241 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000154353 2024-04-25T23:01:32.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.242 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.242 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.707737+0000", 2024-04-25T23:01:32.242 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8211999999999998e-05 2024-04-25T23:01:32.242 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.242 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.243 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740532+0000", 2024-04-25T23:01:32.243 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032794904 2024-04-25T23:01:32.243 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.243 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.243 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.244 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:04.740617+0000", 2024-04-25T23:01:32.244 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 8.4858999999999995e-05 2024-04-25T23:01:32.244 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.244 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.244 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.244 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.244 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(client.4556.0:11715 4.1c 4:39a26c70:::10000003303.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.833745954000001, 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.060390152000000002, 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.245 INFO:teuthology.orchestra.run.smithi165.stdout: "client_info": { 2024-04-25T23:01:32.246 INFO:teuthology.orchestra.run.smithi165.stdout: "client": "client.4556", 2024-04-25T23:01:32.246 INFO:teuthology.orchestra.run.smithi165.stdout: "client_addr": "192.168.0.1:0/2081772121", 2024-04-25T23:01:32.246 INFO:teuthology.orchestra.run.smithi165.stdout: "tid": 11715 2024-04-25T23:01:32.246 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302314+0000", 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.247 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.302315+0000", 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.502e-06 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311423+0000", 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0091076230000000005 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311455+0000", 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.1579999999999999e-05 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.248 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.311477+0000", 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1999000000000001e-05 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314565+0000", 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0030884110000000001 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314740+0000", 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000175043 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "op_commit", 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362539+0000", 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047799229999999998 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362592+0000", 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2525000000000003e-05 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362704+0000", 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00011223899999999999 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.250 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_repop(client.4556.0:11707 4.18 e53/17 4:184fae4a:::1000000316d.00000000:head v 53'194, mlcod=53'192)", 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 25.831516894, 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.057839254, 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:32.251 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304543+0000", 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.304544+0000", 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0559999999999999e-06 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:32.252 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313456+0000", 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0089122850000000007 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313733+0000", 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027719399999999998 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.313745+0000", 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1793e-05 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:32.253 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314572+0000", 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00082668800000000001 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.314604+0000", 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 3.2376999999999998e-05 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "commit_sent", 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362291+0000", 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.047686497000000001 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:32.254 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:06.362382+0000", 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.1364000000000001e-05 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:32.255 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:32.257 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:32.254+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:32.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:32.327 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-04-25T23:01:32.345 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2024-04-25T23:01:32.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T23:01:32.345 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T23:01:32.357 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:32.354+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:32.363 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[22872]: fuse finished with error 0 and tester_r 0 2024-04-25T23:01:32.364 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:01:32.407 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19838 4.22 4.57e5c0a2 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368258+0000", 2024-04-25T23:01:32.407 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030838628999999999, 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030860182, 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368258+0000", 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368258+0000", 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368259+0000", 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2130000000000001e-06 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368264+0000", 2024-04-25T23:01:32.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1070000000000004e-06 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368283+0000", 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8802999999999999e-05 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368297+0000", 2024-04-25T23:01:32.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3944000000000001e-05 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19911 4.3 4.6dc4b343 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377225+0000", 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021871596, 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021941281, 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377225+0000", 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377225+0000", 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377229+0000", 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5129999999999998e-06 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377235+0000", 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4770000000000002e-06 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377249+0000", 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4287000000000001e-05 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377263+0000", 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3726e-05 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19979 4.3c 4.369e153c (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020024677000000001, 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020140238000000001, 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379075+0000", 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5499999999999999e-06 2024-04-25T23:01:32.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379081+0000", 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9529999999999996e-06 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379094+0000", 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379108+0000", 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4133e-05 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19844 4.3d 4:be1922a8:::10000000026.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368312+0000", 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030783722999999999, 2024-04-25T23:01:32.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030963933999999999, 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368312+0000", 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368312+0000", 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368314+0000", 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1969999999999999e-06 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368319+0000", 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2870000000000004e-06 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368336+0000", 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6976000000000001e-05 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368350+0000", 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3852999999999999e-05 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369917+0000", 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015674720000000001 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370446+0000", 2024-04-25T23:01:32.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000529168 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19912 4.c 4.7741e78c (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021816563000000001, 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022049926000000001, 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377284+0000", 2024-04-25T23:01:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.357e-06 2024-04-25T23:01:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377290+0000", 2024-04-25T23:01:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-04-25T23:01:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377304+0000", 2024-04-25T23:01:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4403000000000001e-05 2024-04-25T23:01:32.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377317+0000", 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3413e-05 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19980 4.2b 4.5502deeb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.019971391000000002, 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020248190999999999, 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379129+0000", 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0629999999999999e-06 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379135+0000", 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1530000000000002e-06 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379148+0000", 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3213e-05 2024-04-25T23:01:32.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379162+0000", 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4239999999999999e-05 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19845 4.d 4:b0d15537:::10000000027.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368366+0000", 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030729833000000002, 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031050951, 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.429 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368366+0000", 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368366+0000", 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368368+0000", 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2729999999999999e-06 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368373+0000", 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1769999999999997e-06 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368390+0000", 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7212999999999999e-05 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368404+0000", 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3883000000000001e-05 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395254+0000", 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026849959999999999 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395490+0000", 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023635099999999999 2024-04-25T23:01:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19913 4.1d 4.5fac4fdd (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377335+0000", 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021761604, 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022135034000000001, 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377335+0000", 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377335+0000", 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377339+0000", 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4900000000000002e-06 2024-04-25T23:01:32.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377344+0000", 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1240000000000004e-06 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377358+0000", 2024-04-25T23:01:32.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.431e-05 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377373+0000", 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4656e-05 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19981 4.8 4.2a806448 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.019916977999999998, 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020334577999999999, 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379182+0000", 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379188+0000", 2024-04-25T23:01:32.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8159999999999999e-06 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379203+0000", 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4946999999999999e-05 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379217+0000", 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4015999999999999e-05 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19846 4.1d 4:ba3960b0:::10000000028.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368420+0000", 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030676357000000001, 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031140543, 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368420+0000", 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368420+0000", 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368421+0000", 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.257e-06 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368426+0000", 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1930000000000001e-06 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368443+0000", 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6886000000000001e-05 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368457+0000", 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3886999999999999e-05 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374214+0000", 2024-04-25T23:01:32.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057566579999999996 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.375605+0000", 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013915030000000001 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19914 4.2b 4.4eb1f0ab (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377391+0000", 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021704900999999999, 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022222299000000001, 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377391+0000", 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377391+0000", 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377396+0000", 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0470000000000001e-06 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377411+0000", 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4983e-05 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377426+0000", 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4336e-05 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377440+0000", 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19983 4.25 4.458acd25 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379235+0000", 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.019860902999999999, 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020420647, 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379235+0000", 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379235+0000", 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379239+0000", 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-06 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387291+0000", 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080518959999999994 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387307+0000", 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6232999999999999e-05 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387322+0000", 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4263e-05 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19847 4.18 4:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368474+0000", 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030622450999999998, 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031227242999999998, 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368474+0000", 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368474+0000", 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368475+0000", 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368480+0000", 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.916e-06 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368496+0000", 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6727000000000001e-05 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368512+0000", 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5287000000000001e-05 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369535+0000", 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010236399999999999 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369838+0000", 2024-04-25T23:01:32.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030302699999999998 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19918 4.1d 4.7d73829d (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377459+0000", 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021637304999999999, 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022294565999999998, 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377459+0000", 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377459+0000", 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377464+0000", 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1970000000000004e-06 2024-04-25T23:01:32.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377486+0000", 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2272999999999998e-05 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377500+0000", 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3593e-05 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377513+0000", 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2999999999999999e-05 2024-04-25T23:01:32.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19984 4.20 4.37c097a0 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387345+0000", 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011751611, 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012452015, 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387345+0000", 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387345+0000", 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387349+0000", 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1470000000000003e-06 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387355+0000", 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5470000000000002e-06 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387369+0000", 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4266e-05 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387384+0000", 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4406999999999999e-05 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19848 4.3c 4:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368529+0000", 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030567417999999999, 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031312670000000001, 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368529+0000", 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368529+0000", 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368530+0000", 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2869999999999999e-06 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368535+0000", 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4759999999999997e-06 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368552+0000", 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6636000000000001e-05 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368567+0000", 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.526e-05 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368707+0000", 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013935299999999999 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369069+0000", 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036187900000000001 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19921 4.e 4.915d50ce (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377530+0000", 2024-04-25T23:01:32.462 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021566036, 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022364098999999998, 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377530+0000", 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377530+0000", 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377535+0000", 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0669999999999999e-06 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377540+0000", 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.237e-06 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377554+0000", 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3509999999999999e-05 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377567+0000", 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.324e-05 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19985 4.1d 4.4be8bfdd (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387402+0000", 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011694611000000001, 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012534566, 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387402+0000", 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387402+0000", 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387405+0000", 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.546e-06 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387410+0000", 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0540000000000002e-06 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387424+0000", 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4239e-05 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387437+0000", 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2649999999999999e-05 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19850 4.25 4:a622384a:::1000000002c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368597+0000", 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030499631999999999, 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031389721000000002, 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368597+0000", 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368597+0000", 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368598+0000", 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.19e-06 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368604+0000", 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9970000000000004e-06 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368621+0000", 2024-04-25T23:01:32.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7275999999999999e-05 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368637+0000", 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6160000000000001e-05 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395266+0000", 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026628782 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395600+0000", 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033453600000000002 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19922 4.22 4.52804f62 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377604+0000", 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021491982999999999, 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022436896000000001, 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.472 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377604+0000", 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377604+0000", 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377609+0000", 2024-04-25T23:01:32.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3930000000000001e-06 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377614+0000", 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377629+0000", 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377643+0000", 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3837e-05 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19989 4.13 4.38296413 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387455+0000", 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011641357999999999, 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012630644999999999, 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387455+0000", 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387455+0000", 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387459+0000", 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2830000000000003e-06 2024-04-25T23:01:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387465+0000", 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2729999999999999e-06 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387479+0000", 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3654e-05 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387493+0000", 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3566e-05 2024-04-25T23:01:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19854 4.3 4:c1adcc3d:::10000000030.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368659+0000", 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030437519999999999, 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031472638999999997, 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368659+0000", 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368659+0000", 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368660+0000", 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2100000000000001e-06 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368665+0000", 2024-04-25T23:01:32.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9370000000000003e-06 2024-04-25T23:01:32.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368680+0000", 2024-04-25T23:01:32.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5637e-05 2024-04-25T23:01:32.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368693+0000", 2024-04-25T23:01:32.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2943e-05 2024-04-25T23:01:32.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369823+0000", 2024-04-25T23:01:32.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001129761 2024-04-25T23:01:32.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369947+0000", 2024-04-25T23:01:32.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012429100000000001 2024-04-25T23:01:32.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.486 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.486 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19924 4.13 4.e410a53 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.487 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377660+0000", 2024-04-25T23:01:32.487 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021436487000000001, 2024-04-25T23:01:32.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022525762000000001, 2024-04-25T23:01:32.487 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377660+0000", 2024-04-25T23:01:32.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377660+0000", 2024-04-25T23:01:32.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377664+0000", 2024-04-25T23:01:32.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1470000000000003e-06 2024-04-25T23:01:32.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377669+0000", 2024-04-25T23:01:32.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0930000000000002e-06 2024-04-25T23:01:32.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377682+0000", 2024-04-25T23:01:32.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3453e-05 2024-04-25T23:01:32.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377697+0000", 2024-04-25T23:01:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4293e-05 2024-04-25T23:01:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.495 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19991 4.2a 4.7b04b6ea (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.495 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387511+0000", 2024-04-25T23:01:32.495 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011585125999999999, 2024-04-25T23:01:32.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012717045, 2024-04-25T23:01:32.496 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.496 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387511+0000", 2024-04-25T23:01:32.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387511+0000", 2024-04-25T23:01:32.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387515+0000", 2024-04-25T23:01:32.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6969999999999999e-06 2024-04-25T23:01:32.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387520+0000", 2024-04-25T23:01:32.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.49e-06 2024-04-25T23:01:32.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387534+0000", 2024-04-25T23:01:32.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3566e-05 2024-04-25T23:01:32.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387548+0000", 2024-04-25T23:01:32.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4406999999999999e-05 2024-04-25T23:01:32.502 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.502 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.502 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.503 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19855 4.1b 4:d88bb762:::10000000031.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.503 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368722+0000", 2024-04-25T23:01:32.503 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030374539999999998, 2024-04-25T23:01:32.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031550519999999999, 2024-04-25T23:01:32.503 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.504 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368722+0000", 2024-04-25T23:01:32.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368722+0000", 2024-04-25T23:01:32.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368723+0000", 2024-04-25T23:01:32.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.217e-06 2024-04-25T23:01:32.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368728+0000", 2024-04-25T23:01:32.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7029999999999997e-06 2024-04-25T23:01:32.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368743+0000", 2024-04-25T23:01:32.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5823000000000001e-05 2024-04-25T23:01:32.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368756+0000", 2024-04-25T23:01:32.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2706e-05 2024-04-25T23:01:32.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374204+0000", 2024-04-25T23:01:32.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054481850000000004 2024-04-25T23:01:32.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374494+0000", 2024-04-25T23:01:32.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028950999999999998 2024-04-25T23:01:32.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.511 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.512 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19925 4.1d 4.9b380d5d (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.512 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377714+0000", 2024-04-25T23:01:32.512 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021382194, 2024-04-25T23:01:32.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022611254000000001, 2024-04-25T23:01:32.513 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.513 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.513 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377714+0000", 2024-04-25T23:01:32.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377714+0000", 2024-04-25T23:01:32.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377719+0000", 2024-04-25T23:01:32.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9130000000000002e-06 2024-04-25T23:01:32.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377724+0000", 2024-04-25T23:01:32.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1070000000000004e-06 2024-04-25T23:01:32.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377738+0000", 2024-04-25T23:01:32.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.429e-05 2024-04-25T23:01:32.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377753+0000", 2024-04-25T23:01:32.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5163e-05 2024-04-25T23:01:32.519 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.519 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.519 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.520 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19994 4.1d 4.1846c05d (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.520 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387566+0000", 2024-04-25T23:01:32.520 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011530515999999999, 2024-04-25T23:01:32.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012800929000000001, 2024-04-25T23:01:32.520 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.520 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387566+0000", 2024-04-25T23:01:32.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387566+0000", 2024-04-25T23:01:32.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387570+0000", 2024-04-25T23:01:32.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3329999999999998e-06 2024-04-25T23:01:32.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387575+0000", 2024-04-25T23:01:32.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3340000000000001e-06 2024-04-25T23:01:32.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387589+0000", 2024-04-25T23:01:32.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.325e-05 2024-04-25T23:01:32.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387602+0000", 2024-04-25T23:01:32.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3773e-05 2024-04-25T23:01:32.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.526 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.527 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19856 4.31 4:8ea80fc8:::10000000032.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.527 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368771+0000", 2024-04-25T23:01:32.527 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030324957, 2024-04-25T23:01:32.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031641100999999998, 2024-04-25T23:01:32.528 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.528 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368771+0000", 2024-04-25T23:01:32.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368771+0000", 2024-04-25T23:01:32.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368772+0000", 2024-04-25T23:01:32.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1230000000000001e-06 2024-04-25T23:01:32.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368777+0000", 2024-04-25T23:01:32.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8169999999999998e-06 2024-04-25T23:01:32.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368792+0000", 2024-04-25T23:01:32.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4996e-05 2024-04-25T23:01:32.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368804+0000", 2024-04-25T23:01:32.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-04-25T23:01:32.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369551+0000", 2024-04-25T23:01:32.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00074641300000000002 2024-04-25T23:01:32.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369840+0000", 2024-04-25T23:01:32.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028924700000000002 2024-04-25T23:01:32.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.535 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.536 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.536 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19926 4.38 4.4e2fe5b8 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.536 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:32.536 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021325604000000001, 2024-04-25T23:01:32.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022694242, 2024-04-25T23:01:32.537 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.537 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.537 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.537 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:32.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:32.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377775+0000", 2024-04-25T23:01:32.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6299999999999997e-06 2024-04-25T23:01:32.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377780+0000", 2024-04-25T23:01:32.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9060000000000001e-06 2024-04-25T23:01:32.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377794+0000", 2024-04-25T23:01:32.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3833e-05 2024-04-25T23:01:32.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377810+0000", 2024-04-25T23:01:32.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.577e-05 2024-04-25T23:01:32.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.543 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.544 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19995 4.2 4.91cd2dc2 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.544 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387619+0000", 2024-04-25T23:01:32.544 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011476750000000001, 2024-04-25T23:01:32.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012888762999999999, 2024-04-25T23:01:32.544 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.545 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387619+0000", 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387619+0000", 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387624+0000", 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3000000000000003e-06 2024-04-25T23:01:32.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387639+0000", 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5763000000000001e-05 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387654+0000", 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4769999999999999e-05 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387668+0000", 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.403e-05 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19858 4.1 4:81df0dbf:::10000000034.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368835+0000", 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030261000999999999, 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031716648, 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368835+0000", 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368835+0000", 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368836+0000", 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0869999999999999e-06 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368867+0000", 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0658999999999999e-05 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368885+0000", 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7960000000000001e-05 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368899+0000", 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4233000000000001e-05 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395717+0000", 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026817899999999999 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395947+0000", 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023011799999999999 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19928 4.2 4.a8db8842 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377826+0000", 2024-04-25T23:01:32.551 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021269775000000001, 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022778319000000002, 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377826+0000", 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377826+0000", 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377831+0000", 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3499999999999999e-06 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377837+0000", 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8000000000000004e-06 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377851+0000", 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4049999999999999e-05 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377865+0000", 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19996 4.18 4.d4d2b698 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387686+0000", 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.01141029, 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012962234, 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387686+0000", 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387686+0000", 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387690+0000", 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5329999999999996e-06 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387696+0000", 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0800000000000002e-06 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387710+0000", 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3393e-05 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387724+0000", 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4173e-05 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19859 4.38 4:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368924+0000", 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030172612000000001, 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031775668999999999, 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.557 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368924+0000", 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368924+0000", 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368925+0000", 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7269999999999999e-06 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368930+0000", 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.13e-06 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368947+0000", 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6835999999999999e-05 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368961+0000", 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4246e-05 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369555+0000", 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059324599999999996 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369675+0000", 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012016299999999999 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19929 4.a 4.1aa2df8a (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021214395, 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022869917999999999, 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:32.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377886+0000", 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8489999999999999e-06 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377892+0000", 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5100000000000004e-06 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377906+0000", 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3573e-05 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377920+0000", 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3883000000000001e-05 2024-04-25T23:01:32.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19998 4.2 4.a7d42842 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387741+0000", 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011355161000000001, 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013119851, 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387741+0000", 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387741+0000", 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387746+0000", 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6099999999999999e-06 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387751+0000", 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3700000000000003e-06 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387765+0000", 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4070000000000001e-05 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387777+0000", 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1756000000000001e-05 2024-04-25T23:01:32.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19860 4.2b 4:d747f723:::10000000036.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368978+0000", 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030117896000000002, 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031929204000000003, 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368978+0000", 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368978+0000", 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368979+0000", 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1599999999999999e-06 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368987+0000", 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.447e-06 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369004+0000", 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6742999999999999e-05 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369018+0000", 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4217e-05 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395298+0000", 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026280306999999999 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395442+0000", 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014346699999999999 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19930 4.1d 4.68b428dd (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.570 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377937+0000", 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021158946000000001, 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023024005, 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377937+0000", 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377937+0000", 2024-04-25T23:01:32.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377941+0000", 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5530000000000001e-06 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377948+0000", 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377962+0000", 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.419e-05 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377976+0000", 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.416e-05 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19999 4.18 4.73c1d318 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387794+0000", 2024-04-25T23:01:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011302535000000001, 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013210727, 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387794+0000", 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387794+0000", 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387798+0000", 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8729999999999998e-06 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387804+0000", 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4269999999999999e-06 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387818+0000", 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4163e-05 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387832+0000", 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3643e-05 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19863 4.22 4.a8eac822 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.369034+0000", 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030061713, 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032013989, 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369034+0000", 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369034+0000", 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369036+0000", 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369041+0000", 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9799999999999998e-06 2024-04-25T23:01:32.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369059+0000", 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8485999999999999e-05 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369072+0000", 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2643000000000001e-05 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19932 4.3d 4.368440fd (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.579 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377992+0000", 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021103670000000001, 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023101297999999999, 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377992+0000", 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377992+0000", 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377996+0000", 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8399999999999997e-06 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378002+0000", 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8499999999999999e-06 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378016+0000", 2024-04-25T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4289e-05 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378030+0000", 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3179999999999999e-05 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20001 4.1f 4:f8d20c92:::100000000c3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.387849+0000", 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.011246779, 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013289026000000001, 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387849+0000", 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387849+0000", 2024-04-25T23:01:32.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387854+0000", 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1500000000000001e-06 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387860+0000", 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.55e-06 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387874+0000", 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.382e-05 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.387888+0000", 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4053000000000001e-05 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395819+0000", 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079315229999999994 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396131+0000", 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000311611 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19865 4.3c 4:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.369089+0000", 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030007504000000001, 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032107521999999999, 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.586 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369089+0000", 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369089+0000", 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369090+0000", 2024-04-25T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1599999999999999e-06 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369095+0000", 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1100000000000002e-06 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369111+0000", 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6370000000000001e-05 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369124+0000", 2024-04-25T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.238e-05 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374192+0000", 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050683280000000004 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374509+0000", 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031653399999999999 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19933 4.30 4.b7887ff0 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021049907, 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023203855999999998, 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378051+0000", 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3959999999999999e-06 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378056+0000", 2024-04-25T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4040000000000003e-06 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378070+0000", 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4233000000000001e-05 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378083+0000", 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2857000000000001e-05 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20008 4.2 4.7f9ca182 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395296+0000", 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0038000040000000001, 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060000959999999999, 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395296+0000", 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395296+0000", 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395298+0000", 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7400000000000001e-06 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395307+0000", 2024-04-25T23:01:32.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3000000000000007e-06 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395332+0000", 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4366e-05 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395354+0000", 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2799999999999999e-05 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19866 4.8 4:12420646:::1000000003c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.369141+0000", 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.029954920999999999, 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032198517000000003, 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369141+0000", 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369141+0000", 2024-04-25T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369142+0000", 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.074e-06 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369147+0000", 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8930000000000004e-06 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369165+0000", 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7733000000000001e-05 2024-04-25T23:01:32.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369178+0000", 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3446e-05 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374227+0000", 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050490609999999997 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374371+0000", 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014311599999999999 2024-04-25T23:01:32.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19934 4.30 4.cf3222f0 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020995930999999999, 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023295976999999999, 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378105+0000", 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4329999999999997e-06 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378110+0000", 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8470000000000001e-06 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378125+0000", 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4656e-05 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378138+0000", 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3006999999999999e-05 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.601 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20009 4.3a 4.d5a6647a (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395385+0000", 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0037107519999999999, 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060531339999999999, 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395385+0000", 2024-04-25T23:01:32.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395385+0000", 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395387+0000", 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395393+0000", 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0859999999999998e-06 2024-04-25T23:01:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395411+0000", 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7989999999999999e-05 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395425+0000", 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243000000000001e-05 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19868 4.2c 4:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.369198+0000", 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.029898165000000001, 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032285929999999997, 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369198+0000", 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369198+0000", 2024-04-25T23:01:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369199+0000", 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0100000000000001e-06 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369205+0000", 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6699999999999999e-06 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369223+0000", 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8240000000000002e-05 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369237+0000", 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3824e-05 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395291+0000", 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026054359999999999 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395579+0000", 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028786399999999998 2024-04-25T23:01:32.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19935 4.3 4.4c8d3e43 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378156+0000", 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020940052000000001, 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023383706000000001, 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378156+0000", 2024-04-25T23:01:32.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378156+0000", 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378159+0000", 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.337e-06 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378181+0000", 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1177000000000001e-05 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378195+0000", 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3906e-05 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378210+0000", 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5235999999999999e-05 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20014 4.1b 4.3a6ad39b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395446+0000", 2024-04-25T23:01:32.610 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0036504749999999998, 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061378240000000001, 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395446+0000", 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395446+0000", 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395447+0000", 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2359999999999999e-06 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395453+0000", 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0499999999999997e-06 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395471+0000", 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7949999999999999e-05 2024-04-25T23:01:32.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395487+0000", 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6492999999999999e-05 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19810 4.5 4:a367a3e8:::10000000004.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367272+0000", 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031824318999999997, 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034359827000000003, 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.613 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367272+0000", 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367272+0000", 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367274+0000", 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.99e-06 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367284+0000", 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0000000000000001e-05 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367311+0000", 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7466000000000001e-05 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367326+0000", 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.504e-05 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367482+0000", 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156055 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367810+0000", 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032765700000000002 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.616 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19869 4.32 4.edd6d372 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.369253+0000", 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.029843225000000001, 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032430748000000002, 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369253+0000", 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369253+0000", 2024-04-25T23:01:32.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369254+0000", 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.06e-06 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369259+0000", 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7729999999999999e-06 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369275+0000", 2024-04-25T23:01:32.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5976000000000001e-05 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369287+0000", 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2697000000000001e-05 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19936 4.39 4.f7dad579 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020869005999999999, 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023500308000000001, 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378232+0000", 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4429999999999996e-06 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378256+0000", 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4579999999999998e-05 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378269+0000", 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3314e-05 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378283+0000", 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3305999999999999e-05 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20015 4.5 4.d4f389c5 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395506+0000", 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0035900559999999999, 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062651599999999997, 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395506+0000", 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395506+0000", 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395507+0000", 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2529999999999999e-06 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395514+0000", 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395531+0000", 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.789e-05 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395546+0000", 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.431e-05 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19812 4.25 4:a5feb6f3:::10000000006.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367401+0000", 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031695251000000001, 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034416924000000002, 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367401+0000", 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367401+0000", 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367402+0000", 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4640000000000001e-06 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367409+0000", 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6089999999999997e-06 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367424+0000", 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4854e-05 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367433+0000", 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3999999999999998e-06 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367524+0000", 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0989000000000006e-05 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367793+0000", 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026911399999999999 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19871 4.2b 4:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.369305+0000", 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.029791089, 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032566006000000002, 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369305+0000", 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369305+0000", 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369306+0000", 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0470000000000001e-06 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369311+0000", 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369328+0000", 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6633000000000002e-05 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369341+0000", 2024-04-25T23:01:32.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3383e-05 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396486+0000", 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027144481000000002 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397054+0000", 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056823699999999997 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19941 4.8 4.e906c508 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378302+0000", 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020794469999999999, 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023626234999999999, 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378302+0000", 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378302+0000", 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378306+0000", 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9829999999999998e-06 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378312+0000", 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378326+0000", 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4466e-05 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378341+0000", 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4416999999999999e-05 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20016 4.38 4.147e0978 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395563+0000", 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.003533633, 2024-04-25T23:01:32.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064093650000000002, 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395563+0000", 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395563+0000", 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395564+0000", 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.167e-06 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395568+0000", 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7530000000000001e-06 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395590+0000", 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1336e-05 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395605+0000", 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.535e-05 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19813 4.1d 4:bbf5850a:::10000000007.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367448+0000", 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031647733999999997, 2024-04-25T23:01:32.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034572005000000003, 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367448+0000", 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367448+0000", 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367449+0000", 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9599999999999998e-07 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367453+0000", 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.467e-06 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367462+0000", 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7399999999999999e-06 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367472+0000", 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6770000000000007e-06 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368677+0000", 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012052810000000001 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368980+0000", 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030236400000000001 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19874 4.1a 4.e8cacbda (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.028893904000000002, 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031871101999999998, 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:32.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370205+0000", 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0989999999999999e-06 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370214+0000", 2024-04-25T23:01:32.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1969999999999996e-06 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370896+0000", 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068217699999999996 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370913+0000", 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7557000000000001e-05 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19943 4.34 4.6cba8874 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378358+0000", 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.02073825, 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023761951, 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378358+0000", 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378358+0000", 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378362+0000", 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8330000000000004e-06 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378367+0000", 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6099999999999997e-06 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378380+0000", 2024-04-25T23:01:32.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378394+0000", 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.397e-05 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20021 4.18 4.79ddabd8 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395622+0000", 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0034737969999999998, 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065398009999999996, 2024-04-25T23:01:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395622+0000", 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395622+0000", 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395624+0000", 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2160000000000001e-06 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395628+0000", 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395647+0000", 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8870000000000001e-05 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395661+0000", 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4049999999999999e-05 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19877 4.8 4.25e32208 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376455+0000", 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022640884999999999, 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025750131999999998, 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376455+0000", 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376455+0000", 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376461+0000", 2024-04-25T23:01:32.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3199999999999999e-06 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376471+0000", 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0900000000000001e-05 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376503+0000", 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1353000000000003e-05 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376521+0000", 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8116000000000001e-05 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19944 4.35 4.97931175 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378412+0000", 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020684358, 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023842144999999999, 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378412+0000", 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378412+0000", 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378417+0000", 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1340000000000003e-06 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378422+0000", 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.079e-06 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378436+0000", 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.399e-05 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378449+0000", 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2836999999999999e-05 2024-04-25T23:01:32.654 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20026 4.13 4.c19b3213 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395681+0000", 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.003415221, 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066171859999999997, 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395681+0000", 2024-04-25T23:01:32.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395681+0000", 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395682+0000", 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.217e-06 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395687+0000", 2024-04-25T23:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2889999999999997e-06 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395704+0000", 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7010000000000001e-05 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395720+0000", 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5449999999999999e-05 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19815 4.34 4:2eb4da2b:::10000000009.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367556+0000", 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031540078999999999, 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034799793000000002, 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367556+0000", 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367556+0000", 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367557+0000", 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.15e-06 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367562+0000", 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367579+0000", 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367594+0000", 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5082999999999999e-05 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367714+0000", 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119516 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368174+0000", 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000460082 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19881 4.31 4.44633a71 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376569+0000", 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022526956000000001, 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025838495, 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.661 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376569+0000", 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376569+0000", 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376574+0000", 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6430000000000003e-06 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376581+0000", 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7469999999999999e-06 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376596+0000", 2024-04-25T23:01:32.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5642999999999999e-05 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376612+0000", 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5426000000000001e-05 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19945 4.8 4.d1dae4c8 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020629557999999999, 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023985835, 2024-04-25T23:01:32.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378471+0000", 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0600000000000001e-06 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378476+0000", 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.677e-06 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378490+0000", 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3593e-05 2024-04-25T23:01:32.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378503+0000", 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3383e-05 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20030 4.3 4.cd179c43 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.395737+0000", 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0033596250000000002, 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067586829999999997, 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395737+0000", 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395737+0000", 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395737+0000", 2024-04-25T23:01:32.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7000000000000003e-07 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395756+0000", 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8386999999999999e-05 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395773+0000", 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7309e-05 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395787+0000", 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3443e-05 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.669 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19816 4.22 4:45d72e17:::1000000000a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367619+0000", 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031476716000000002, 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034921585999999998, 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367619+0000", 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367619+0000", 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367621+0000", 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-06 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367627+0000", 2024-04-25T23:01:32.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8029999999999999e-06 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367644+0000", 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7093000000000001e-05 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367660+0000", 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5874000000000001e-05 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367777+0000", 2024-04-25T23:01:32.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116929 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368085+0000", 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030776700000000002 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19891 4.32 4.aa4eaeb2 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376634+0000", 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022462553, 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026075653000000001, 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376634+0000", 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376634+0000", 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376638+0000", 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1960000000000001e-06 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376644+0000", 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8540000000000002e-06 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376660+0000", 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5875999999999998e-05 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376673+0000", 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3413e-05 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19946 4.3c 4.169e743c (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020575929, 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024234453999999999, 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378524+0000", 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378530+0000", 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4970000000000001e-06 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378544+0000", 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4143e-05 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378557+0000", 2024-04-25T23:01:32.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.277e-05 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20033 4.1f 4.5031bc9f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.397877+0000", 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.001219447, 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049227309999999996, 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397877+0000", 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397877+0000", 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397879+0000", 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.826e-06 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397887+0000", 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3459999999999994e-06 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397903+0000", 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6082e-05 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397918+0000", 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5e-05 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.681 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19818 4.22 4:46cca9ab:::1000000000c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367699+0000", 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031397383000000001, 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035147593999999997, 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367699+0000", 2024-04-25T23:01:32.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367699+0000", 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367700+0000", 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2330000000000001e-06 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367706+0000", 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2024-04-25T23:01:32.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367723+0000", 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6903000000000001e-05 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367736+0000", 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3823e-05 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369015+0000", 2024-04-25T23:01:32.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001278361 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369312+0000", 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029734100000000001 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19895 4.31 4.4b440ff1 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376691+0000", 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022405437, 2024-04-25T23:01:32.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026210627, 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376691+0000", 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376691+0000", 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376695+0000", 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5759999999999999e-06 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376714+0000", 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8236999999999998e-05 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376728+0000", 2024-04-25T23:01:32.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4250000000000001e-05 2024-04-25T23:01:32.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376742+0000", 2024-04-25T23:01:32.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4003e-05 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19952 4.c 4.2592de8c (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020520951999999999, 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024370517000000001, 2024-04-25T23:01:32.689 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378579+0000", 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8859999999999997e-06 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378584+0000", 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3340000000000001e-06 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378598+0000", 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3976e-05 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378612+0000", 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.692 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20034 4.39 4.d3ef6639 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.397943+0000", 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0011529960000000001, 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050486849999999998, 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397943+0000", 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397943+0000", 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397948+0000", 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5569999999999997e-06 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397953+0000", 2024-04-25T23:01:32.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4770000000000002e-06 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397966+0000", 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3134e-05 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397978+0000", 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1323e-05 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19824 4.d 4:b185e6e8:::10000000012.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367755+0000", 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031340936999999999, 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035282710000000002, 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367755+0000", 2024-04-25T23:01:32.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367755+0000", 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367756+0000", 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1629999999999999e-06 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367761+0000", 2024-04-25T23:01:32.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0170000000000004e-06 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367779+0000", 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7479999999999999e-05 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367793+0000", 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3808999999999999e-05 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368767+0000", 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097426700000000001 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369048+0000", 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028096799999999998 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19896 4.18 4:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376761+0000", 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022335514000000001, 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026334314000000001, 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376761+0000", 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376761+0000", 2024-04-25T23:01:32.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376765+0000", 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1459999999999998e-06 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376771+0000", 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3829999999999997e-06 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376786+0000", 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4610000000000001e-05 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376799+0000", 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3366e-05 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395905+0000", 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019106166000000001 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396035+0000", 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012974199999999999 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19953 4.c 4.9d54bb0c (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.02046568, 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024517138000000001, 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378634+0000", 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5470000000000001e-06 2024-04-25T23:01:32.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378640+0000", 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5729999999999998e-06 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378653+0000", 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3643e-05 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378667+0000", 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3923999999999999e-05 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:20035 4.1d 4.a0b665dd (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.397997+0000", 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0010995989999999999, 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051966850000000004, 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397997+0000", 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397997+0000", 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.398001+0000", 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1819999999999999e-06 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.398006+0000", 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.412e-06 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.398017+0000", 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.13e-05 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.398034+0000", 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6957e-05 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19825 4.22 4:44834937:::10000000013.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367813+0000", 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031283424999999997, 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035424773999999999, 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367813+0000", 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367813+0000", 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367814+0000", 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1069999999999999e-06 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367819+0000", 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9130000000000002e-06 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367836+0000", 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7173e-05 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367851+0000", 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.543e-05 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395277+0000", 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027425387999999998 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395612+0000", 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033531700000000002 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19897 4.39 4.e46123f9 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022279515, 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026479625, 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376821+0000", 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1699999999999999e-06 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376826+0000", 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1599999999999997e-06 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376840+0000", 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4483e-05 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376855+0000", 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4187e-05 2024-04-25T23:01:32.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19954 4.13 4.b1862213 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378683+0000", 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020412860000000001, 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024659695999999998, 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378683+0000", 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378683+0000", 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378688+0000", 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.853e-06 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378694+0000", 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7300000000000002e-06 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378708+0000", 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3847e-05 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378722+0000", 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3825999999999999e-05 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.717 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19828 4.38 4:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367874+0000", 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031222025, 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035514429, 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367874+0000", 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367874+0000", 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367875+0000", 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0470000000000001e-06 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367881+0000", 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1829999999999999e-06 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367898+0000", 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6439999999999998e-05 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367912+0000", 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3746e-05 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368026+0000", 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011401899999999999 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368320+0000", 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029417400000000002 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19898 4.30 4.9efefd30 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376874+0000", 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022222582000000001, 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.02657035, 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376874+0000", 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376874+0000", 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376879+0000", 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2059999999999998e-06 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376885+0000", 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3069999999999999e-06 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376900+0000", 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5259000000000001e-05 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376914+0000", 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.327e-05 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19959 4.32 4.16a79672 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378737+0000", 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020358838000000001, 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024748857999999999, 2024-04-25T23:01:32.724 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378737+0000", 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378737+0000", 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378741+0000", 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3469999999999999e-06 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378747+0000", 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1970000000000001e-06 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378760+0000", 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3346000000000001e-05 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378774+0000", 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.348e-05 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19830 4.1a 4:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.367948+0000", 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031148335999999999, 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035585895999999999, 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367948+0000", 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367948+0000", 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367949+0000", 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.297e-06 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367955+0000", 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0759999999999999e-06 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367974+0000", 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9026999999999999e-05 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.367989+0000", 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4477e-05 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374221+0000", 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062323029999999998 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.374473+0000", 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000252086 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19901 4.2c 4.a9a1a62c (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022164926000000001, 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026655041000000001, 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376936+0000", 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9259999999999999e-06 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376942+0000", 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.48e-06 2024-04-25T23:01:32.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376955+0000", 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3627e-05 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376969+0000", 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3443e-05 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19964 4.e 4.f63c890e (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378792+0000", 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020304024, 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024840230000000001, 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378792+0000", 2024-04-25T23:01:32.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378792+0000", 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378797+0000", 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1889999999999998e-06 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378803+0000", 2024-04-25T23:01:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.31e-06 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378816+0000", 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3546999999999999e-05 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378829+0000", 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19832 4.20 4:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368006+0000", 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031090429999999999, 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035671504, 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368006+0000", 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368006+0000", 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368007+0000", 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1370000000000001e-06 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368012+0000", 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0370000000000002e-06 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368028+0000", 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6322999999999999e-05 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368042+0000", 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3719e-05 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368371+0000", 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032936 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368494+0000", 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012258200000000001 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19902 4.3 4:c001b242:::10000000060.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376995+0000", 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022100703999999999, 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026739973, 2024-04-25T23:01:32.740 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376995+0000", 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376995+0000", 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377001+0000", 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2870000000000004e-06 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377007+0000", 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0730000000000001e-06 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377021+0000", 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4297000000000001e-05 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377036+0000", 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4946000000000001e-05 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396426+0000", 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019390013000000001 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.397542+0000", 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011161089999999999 2024-04-25T23:01:32.743 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19966 4.2b 4.6c7a352b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020250471999999999, 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024941400999999998, 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378850+0000", 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.233e-06 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378863+0000", 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.288e-05 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378876+0000", 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378890+0000", 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3507e-05 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19833 4.8 4:12420902:::1000000001b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368059+0000", 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.031037624, 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035784508999999999, 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368059+0000", 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368059+0000", 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368060+0000", 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.207e-06 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368065+0000", 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1699999999999996e-06 2024-04-25T23:01:32.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368082+0000", 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.664e-05 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368095+0000", 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3509999999999999e-05 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368985+0000", 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00089045300000000003 2024-04-25T23:01:32.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.369119+0000", 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013387699999999999 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19904 4.30 4.a26cecb0 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377053+0000", 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.022042711, 2024-04-25T23:01:32.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026841944, 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377053+0000", 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377053+0000", 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377058+0000", 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4399999999999998e-06 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377064+0000", 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0900000000000001e-06 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377078+0000", 2024-04-25T23:01:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3879999999999999e-05 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377092+0000", 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4343e-05 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19968 4.2a 4.bb0d226a (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378907+0000", 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020189138999999998, 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025030139999999999, 2024-04-25T23:01:32.753 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378907+0000", 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378907+0000", 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378911+0000", 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.357e-06 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378917+0000", 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6890000000000001e-06 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378930+0000", 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3263e-05 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378944+0000", 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3777e-05 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19836 4.32 4:4f7da3cc:::1000000001e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368139+0000", 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030957641000000001, 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035845662, 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368139+0000", 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368139+0000", 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368140+0000", 2024-04-25T23:01:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-06 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368146+0000", 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9869999999999996e-06 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368163+0000", 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7663e-05 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368182+0000", 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8433000000000001e-05 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395283+0000", 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027101245 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.395491+0000", 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000208104 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19906 4.20 4.5ce99960 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377111+0000", 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021985491999999999, 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026925356000000001, 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377111+0000", 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377111+0000", 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377115+0000", 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8040000000000001e-06 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377120+0000", 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0159999999999999e-06 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377134+0000", 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377149+0000", 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4603000000000001e-05 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.762 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19970 4.c 4.2ca416cc (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020134506, 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025119276999999999, 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378967+0000", 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359999999999996e-06 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378973+0000", 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8039999999999998e-06 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378985+0000", 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2763e-05 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378999+0000", 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19837 4.3a 4:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:32.765 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.030893997999999999, 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035923021999999999, 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:32.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368203+0000", 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1230000000000001e-06 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368208+0000", 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1370000000000001e-06 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368226+0000", 2024-04-25T23:01:32.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7393000000000001e-05 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368241+0000", 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4708999999999999e-05 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396238+0000", 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027997261999999998 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396454+0000", 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021643300000000001 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19908 4.38 4.32c6d538 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021929555, 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027018074999999999, 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377171+0000", 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.887e-06 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377177+0000", 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7459999999999997e-06 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377191+0000", 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3995999999999999e-05 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377206+0000", 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4627000000000001e-05 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19972 4.1 4.5fdba341 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379016+0000", 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.020080056999999998, 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025212947999999999, 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:32.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379016+0000", 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379016+0000", 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379020+0000", 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1300000000000003e-06 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379026+0000", 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5230000000000003e-06 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379040+0000", 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243000000000001e-05 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379054+0000", 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3706999999999999e-05 2024-04-25T23:01:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.775 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:32.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:32.775 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-04-25T23:01:32.775 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 103 2024-04-25T23:01:32.775 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:32.775 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T23:01:32.778 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:32.778 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:32.774+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:32.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:32.878 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:32.874+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:32.908 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:32.909 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:32.909 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:32.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:32.978 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:32.978+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:33.022 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:33.023 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:33.038 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:33.038 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:33.043 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:33.043 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:33.043 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:33.047 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:33.047 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:33.053 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:33.079 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:33.075+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:33.180 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:33.178+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:33.183 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:33.183 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:33.197 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:33.287 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:33.286+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:33.365 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:33.365 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:33.379 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:33.381 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:33.375+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:33.420 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-25T23:01:33.482 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:33.478+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:33.544 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:33.545 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:33.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:33.606 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:33.603+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:33.683 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:33.679+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:33.689 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:33.689 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:33.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:33.790 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:33.787+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:33.866 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:33.866 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:33.881 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:33.886 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:33.882+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:33.986 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:33.986+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:34.045 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:34.045 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:34.059 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:34.087 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:34.083+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:34.188 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:34.186+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:34.188 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:34.188 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:34.202 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:34.289 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:34.283+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:34.371 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:34.371 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:34.385 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:34.431 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:34.430+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:34.491 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:34.487+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:34.508 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:34.508 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:34.523 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:34.591 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:34.590+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:34.653 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:34.654 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:34.668 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:34.692 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:34.690+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:34.792 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:34.792 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:34.793 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:34.787+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:34.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:34.895 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:34.891+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:34.973 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:34.974 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:34.987 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:35.035 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:35.034+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:35.048 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T23:01:35.096 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:35.091+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:35.117 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:35.117 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:35.132 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:35.197 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:35.191+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:35.211 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:35.212 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:35.229 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:35.229 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:35.230 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:35.233 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:35.233 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:35.295 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:35.296 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:35.296 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:35.296 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:35.296 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:35.297 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:35.294+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:35.310 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:35.398 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:35.394+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:35.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:01:35.473 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:35.473 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19829 4.1e 4:78cea7f0:::10000000017.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.368153+0000", 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.1042574040000002, 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.098724247000000001, 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.474 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368153+0000", 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368153+0000", 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368154+0000", 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-06 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.475 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368160+0000", 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368178+0000", 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7963000000000001e-05 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368191+0000", 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3763e-05 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.476 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.371753+0000", 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035617909999999999 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.372070+0000", 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031656099999999998 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466877+0000", 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.094807229000000007 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19862 4.26 4:65f9ba37:::10000000038.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.368995+0000", 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.1034152119999998, 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097568718999999998, 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368995+0000", 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368995+0000", 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368996+0000", 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5300000000000002e-07 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.479 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369000+0000", 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.25e-06 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369015+0000", 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4977000000000001e-05 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369027+0000", 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.225e-05 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.480 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379642+0000", 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010615042 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379959+0000", 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031704699999999999 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466564+0000", 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086604200000000006 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.481 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19873 4.16 4:6a415a36:::10000000043.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.369291+0000", 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.103119328, 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097267142000000001, 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369291+0000", 2024-04-25T23:01:35.482 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369291+0000", 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369292+0000", 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2899999999999999e-06 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369297+0000", 2024-04-25T23:01:35.483 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8269999999999997e-06 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369314+0000", 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7076e-05 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369327+0000", 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386572+0000", 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017244443000000002 2024-04-25T23:01:35.484 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386893+0000", 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032107700000000002 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466558+0000", 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.079664895999999999 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.485 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19876 4.26 4:678705fb:::10000000046.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.369401+0000", 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.1030095160000002, 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097469057999999997, 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369401+0000", 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.486 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369401+0000", 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369402+0000", 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.31e-06 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369407+0000", 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4469999999999997e-06 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.487 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369425+0000", 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7572999999999999e-05 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369438+0000", 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3593e-05 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.389693+0000", 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020254613000000001 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.488 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.389990+0000", 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029641999999999998 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466870+0000", 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.076880102000000006 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19886 4.16 4:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.369971+0000", 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.1024388740000002, 2024-04-25T23:01:35.489 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097159191000000006, 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369971+0000", 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369971+0000", 2024-04-25T23:01:35.490 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369972+0000", 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2130000000000001e-06 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369978+0000", 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1730000000000003e-06 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369995+0000", 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7574000000000001e-05 2024-04-25T23:01:35.491 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370009+0000", 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.348e-05 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.391720+0000", 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.021711444999999999 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.392357+0000", 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00063656100000000001 2024-04-25T23:01:35.492 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467130+0000", 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.074773745000000003 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19889 4.16 4:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.370126+0000", 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.1022840889999999, 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.098894255, 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.493 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370126+0000", 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370126+0000", 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.494 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370127+0000", 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.034e-06 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370132+0000", 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.6959999999999996e-06 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370148+0000", 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6189999999999999e-05 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.495 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370161+0000", 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3277e-05 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.395030+0000", 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024869037 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.395331+0000", 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030040500000000001 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.496 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469020+0000", 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.073689615999999999 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19905 4.26 4:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.370597+0000", 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.1018128329999999, 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.096792665, 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.497 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370597+0000", 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370597+0000", 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.498 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370599+0000", 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.657e-06 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370618+0000", 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8819000000000001e-05 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370635+0000", 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7090000000000001e-05 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.499 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370648+0000", 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3263e-05 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.397275+0000", 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.026626918999999999 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.397583+0000", 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030806399999999998 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.500 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467390+0000", 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.069806853000000002 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19931 4.1e 4:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.375693+0000", 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0967168549999999, 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.092054065000000004, 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.501 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375693+0000", 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375693+0000", 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.502 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375694+0000", 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.046e-06 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375700+0000", 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1199999999999999e-06 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375722+0000", 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1236000000000001e-05 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.503 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375735+0000", 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3003000000000001e-05 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.399171+0000", 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.023436077999999999 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.399463+0000", 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029231100000000001 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.504 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467747+0000", 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.068284270999999994 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19937 4.26 4:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.375750+0000", 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0966600999999998, 2024-04-25T23:01:35.505 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.092232585000000006, 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375750+0000", 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375750+0000", 2024-04-25T23:01:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375751+0000", 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3069999999999999e-06 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375767+0000", 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.613e-05 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375784+0000", 2024-04-25T23:01:35.507 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6307000000000002e-05 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375796+0000", 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2673e-05 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.406605+0000", 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.030808272000000001 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.406799+0000", 2024-04-25T23:01:35.508 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019386800000000001 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467983+0000", 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.061184028000000001 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19947 4.26 4:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.376008+0000", 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0964019220000001, 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.092226467000000006, 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.509 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376008+0000", 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376008+0000", 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376009+0000", 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.04e-06 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376014+0000", 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0039999999999999e-06 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376030+0000", 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.511 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376043+0000", 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2758999999999999e-05 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.408747+0000", 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032704444999999999 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.409047+0000", 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029938399999999998 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.512 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.468235+0000", 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.059187824999999999 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19960 4.0 4:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.376566+0000", 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0958445029999999, 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.089473320999999995, 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.513 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376566+0000", 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376566+0000", 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376567+0000", 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.063e-06 2024-04-25T23:01:35.514 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376572+0000", 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0170000000000004e-06 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376589+0000", 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7382999999999999e-05 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376603+0000", 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3570000000000001e-05 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.515 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377149+0000", 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00054655199999999995 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377455+0000", 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000305727 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466039+0000", 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.088584009000000005 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.516 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19978 4.26 4:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.377267+0000", 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0951431129999998, 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.091197419000000002, 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377267+0000", 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.517 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377267+0000", 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377268+0000", 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0139999999999999e-06 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377273+0000", 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.5199999999999999e-06 2024-04-25T23:01:35.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377292+0000", 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9488999999999999e-05 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377307+0000", 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5359999999999999e-05 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.414686+0000", 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.037379123 2024-04-25T23:01:35.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.414946+0000", 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025916600000000002 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.468464+0000", 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053518746999999998 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19987 4.29 4:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.520 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.377457+0000", 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0949532679999998, 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.088662766000000004, 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377457+0000", 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.521 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377457+0000", 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377458+0000", 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2899999999999999e-06 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377463+0000", 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1599999999999997e-06 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.522 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377484+0000", 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0363000000000001e-05 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377500+0000", 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6127e-05 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379077+0000", 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015768830000000001 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.523 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379356+0000", 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027966699999999999 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466120+0000", 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086763276 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20003 4.16 4:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.381166+0000", 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0912436410000002, 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.088408129000000002, 2024-04-25T23:01:35.524 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381166+0000", 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381166+0000", 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.525 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381168+0000", 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.24e-06 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381187+0000", 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9273e-05 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381205+0000", 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8366999999999999e-05 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381220+0000", 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4613000000000001e-05 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.417811+0000", 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.03659072 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.418070+0000", 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025957200000000001 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.527 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469575+0000", 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051504344000000001 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20007 4.11 4:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.381401+0000", 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0910095530000001, 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.084687192999999994, 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.528 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381401+0000", 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381401+0000", 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381402+0000", 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.077e-06 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381407+0000", 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0529999999999997e-06 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381423+0000", 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6633000000000002e-05 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381437+0000", 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3787e-05 2024-04-25T23:01:35.530 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382684+0000", 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012468519999999999 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.384238+0000", 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001553776 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466088+0000", 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.081850014999999998 2024-04-25T23:01:35.531 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20012 4.11 4:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.381585+0000", 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0908249049999998, 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.084689951999999999, 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.532 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381585+0000", 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381585+0000", 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381586+0000", 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2529999999999999e-06 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.533 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381592+0000", 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2769999999999996e-06 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381609+0000", 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7090000000000001e-05 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381629+0000", 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0237e-05 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.534 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.391825+0000", 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010196449 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.392171+0000", 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00034585300000000002 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466275+0000", 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.074103793000000001 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.535 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20019 4.29 4:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.382479+0000", 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0899306260000001, 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.083972020999999994, 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382479+0000", 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382479+0000", 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382481+0000", 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1599999999999999e-06 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382486+0000", 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1930000000000001e-06 2024-04-25T23:01:35.537 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382503+0000", 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6852999999999999e-05 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382519+0000", 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6246999999999999e-05 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.396325+0000", 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.013805997 2024-04-25T23:01:35.538 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.396595+0000", 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027041100000000002 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466451+0000", 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.06985616 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20022 4.1e 4:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.539 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.382614+0000", 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0897963869999998, 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086126444999999996, 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382614+0000", 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382614+0000", 2024-04-25T23:01:35.540 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382615+0000", 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.206e-06 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382620+0000", 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3800000000000002e-06 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382640+0000", 2024-04-25T23:01:35.541 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.986e-05 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382655+0000", 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4377e-05 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.423294+0000", 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.040639010000000003 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.542 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.423514+0000", 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022096799999999999 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.468740+0000", 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045225644000000002 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20027 4.26 4:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.382885+0000", 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0895253729999999, 2024-04-25T23:01:35.543 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086400974000000005, 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382885+0000", 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382885+0000", 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.544 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382886+0000", 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1069999999999999e-06 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382893+0000", 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.8789999999999997e-06 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382910+0000", 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7652999999999999e-05 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.545 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382929+0000", 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8876999999999999e-05 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.423794+0000", 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.040864478000000003 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.424069+0000", 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027483500000000002 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.546 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469286+0000", 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045217145 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20062 4.16 4:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.386038+0000", 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 3.0863723240000001, 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.083718745999999997, 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:35.547 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386038+0000", 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386038+0000", 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386039+0000", 2024-04-25T23:01:35.548 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.44e-06 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386044+0000", 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2000000000000002e-06 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386062+0000", 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7808999999999998e-05 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386076+0000", 2024-04-25T23:01:35.549 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4042999999999999e-05 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.426048+0000", 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039971484000000002 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.426275+0000", 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022741300000000001 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469757+0000", 2024-04-25T23:01:35.550 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.043481356999999998 2024-04-25T23:01:35.551 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.551 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.551 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.551 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:35.551 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:35.551 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:35.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:35.553 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:35.551+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:35.653 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:35.650+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:35.684 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:35.684 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:35.684 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:35.684 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:35.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:35.753 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:35.750+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:35.822 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:35.822 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:35.822 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:35.822 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:35.822 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:35.835 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:35.854 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:35.854+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:35.955 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:35.954+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:35.959 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:35.959 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:35.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:35.959 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19837 4.3a 4:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5901674890000002, 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.095211689000000002, 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368203+0000", 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1230000000000001e-06 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368208+0000", 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1370000000000001e-06 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368226+0000", 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7393000000000001e-05 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368241+0000", 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4708999999999999e-05 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396238+0000", 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027997261999999998 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396454+0000", 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021643300000000001 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.463414+0000", 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066959632000000005 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19874 4.1a 4:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.963 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5881673950000001, 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.093178121000000003, 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370205+0000", 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0989999999999999e-06 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370214+0000", 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1969999999999996e-06 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370896+0000", 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068217699999999996 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370913+0000", 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7557000000000001e-05 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.429967+0000", 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.059053268999999999 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.430119+0000", 2024-04-25T23:01:35.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152948 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.463380+0000", 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033260874000000003 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19897 4.39 4:9fc48627:::1000000005b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.581553006, 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086832125999999996, 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.967 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376821+0000", 2024-04-25T23:01:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1699999999999999e-06 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376826+0000", 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1599999999999997e-06 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376840+0000", 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4483e-05 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376855+0000", 2024-04-25T23:01:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4187e-05 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.415619+0000", 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03876396 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.415738+0000", 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119857 2024-04-25T23:01:35.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.463649+0000", 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.047910308999999998 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19901 4.2c 4:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5814384170000002, 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.089235206999999997, 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376936+0000", 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9259999999999999e-06 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376942+0000", 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.48e-06 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376955+0000", 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3627e-05 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376969+0000", 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3443e-05 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.411269+0000", 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034299927000000001 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.411475+0000", 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020645599999999999 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466166+0000", 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.054691348000000001 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19908 4.38 4:1cab634c:::10000000066.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5812030459999997, 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.089433023, 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.975 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377171+0000", 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.887e-06 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377177+0000", 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7459999999999997e-06 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377191+0000", 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3995999999999999e-05 2024-04-25T23:01:35.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377206+0000", 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4627000000000001e-05 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.413838+0000", 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036632655 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.414005+0000", 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000166241 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466600+0000", 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.052594871000000001 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19912 4.c 4:31e782ee:::1000000006a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5810900540000001, 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.089120208000000006, 2024-04-25T23:01:35.979 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377284+0000", 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.357e-06 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377290+0000", 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377304+0000", 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4403000000000001e-05 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377317+0000", 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3413e-05 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.412800+0000", 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035482568999999999 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.413935+0000", 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011349109999999999 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466400+0000", 2024-04-25T23:01:35.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.052464904999999999 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19926 4.38 4:1da7f472:::10000000078.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5805990950000002, 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088969592, 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377775+0000", 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6299999999999997e-06 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377780+0000", 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9060000000000001e-06 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377794+0000", 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3833e-05 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377810+0000", 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.577e-05 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441784+0000", 2024-04-25T23:01:35.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063974042999999994 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441904+0000", 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120282 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466740+0000", 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024836127999999999 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.986 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19929 4.a 4:51fb4558:::1000000007b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5804878860000002, 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086353412000000004, 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377886+0000", 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8489999999999999e-06 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377892+0000", 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5100000000000004e-06 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377906+0000", 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3573e-05 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377920+0000", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3883000000000001e-05 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442160+0000", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064240065999999998 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442315+0000", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015551900000000001 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.464235+0000", 2024-04-25T23:01:35.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021920011999999999 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19933 4.30 4:0ffe11ed:::1000000007f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.580323398, 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088692382, 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.990 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378051+0000", 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3959999999999999e-06 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378056+0000", 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4040000000000003e-06 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378070+0000", 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4233000000000001e-05 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378083+0000", 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2857000000000001e-05 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442560+0000", 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064477038 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442757+0000", 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019683999999999999 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466739+0000", 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023981613999999998 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19934 4.30 4:0f444cf3:::10000000080.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5802694219999998, 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088845898000000006, 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378105+0000", 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4329999999999997e-06 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378110+0000", 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8470000000000001e-06 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378125+0000", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4656e-05 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378138+0000", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3006999999999999e-05 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.443624+0000", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065485926999999999 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.443730+0000", 2024-04-25T23:01:35.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105943 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466946+0000", 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023216085000000001 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19936 4.39 4:9eab5bef:::10000000082.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5801424969999998, 2024-04-25T23:01:35.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086269907000000007, 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:35.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378232+0000", 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4429999999999996e-06 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378256+0000", 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4579999999999998e-05 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378269+0000", 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3314e-05 2024-04-25T23:01:35.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378283+0000", 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3305999999999999e-05 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439426+0000", 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061143066000000003 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439561+0000", 2024-04-25T23:01:36.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013495099999999999 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.464497+0000", 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024936247000000002 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19945 4.8 4:13275b8b:::1000000008b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5799030489999999, 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088168225000000003, 2024-04-25T23:01:36.001 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378471+0000", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0600000000000001e-06 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378476+0000", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.677e-06 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378490+0000", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3593e-05 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378503+0000", 2024-04-25T23:01:36.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3383e-05 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.446351+0000", 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067847304999999997 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.446475+0000", 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012417600000000001 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466635+0000", 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020160030999999998 2024-04-25T23:01:36.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19946 4.3c 4:3c2e7968:::1000000008c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5798494199999999, 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088043262999999997, 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378524+0000", 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378530+0000", 2024-04-25T23:01:36.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4970000000000001e-06 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378544+0000", 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4143e-05 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378557+0000", 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.277e-05 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439536+0000", 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060979621999999997 2024-04-25T23:01:36.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439668+0000", 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013202999999999999 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466563+0000", 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026894991 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19952 4.c 4:317b49a4:::10000000092.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.008 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5797944429999999, 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088113021999999999, 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:36.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378579+0000", 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8859999999999997e-06 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378584+0000", 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3340000000000001e-06 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378598+0000", 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3976e-05 2024-04-25T23:01:36.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378612+0000", 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.440100+0000", 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061488142000000003 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.440216+0000", 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116179 2024-04-25T23:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466688+0000", 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026471941999999998 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19953 4.c 4:30dd2ab9:::10000000093.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5797391709999999, 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088176929000000001, 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378634+0000", 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5470000000000001e-06 2024-04-25T23:01:36.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378640+0000", 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5729999999999998e-06 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378653+0000", 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3643e-05 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378667+0000", 2024-04-25T23:01:36.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3923999999999999e-05 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441313+0000", 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062645963999999998 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441443+0000", 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012981399999999999 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466807+0000", 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025364464 2024-04-25T23:01:36.015 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19966 4.2b 4:d4ac5e36:::100000000a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5795239629999998, 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086946383000000002, 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378850+0000", 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.233e-06 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378863+0000", 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.288e-05 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378876+0000", 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378890+0000", 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3507e-05 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.420237+0000", 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041347122 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.420397+0000", 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016060900000000001 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.465792+0000", 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.045394715000000002 2024-04-25T23:01:36.019 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19970 4.c 4:33682534:::100000000a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5794079970000001, 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.087985547999999997, 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378967+0000", 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359999999999996e-06 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378973+0000", 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8039999999999998e-06 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378985+0000", 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2763e-05 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378999+0000", 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441820+0000", 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062821415000000005 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441933+0000", 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112587 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466947+0000", 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025014346 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19979 4.3c 4:3ca8796c:::100000000ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5792981680000002, 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.087893338000000001, 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379075+0000", 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5499999999999999e-06 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379081+0000", 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9529999999999996e-06 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379094+0000", 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379108+0000", 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4133e-05 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442256+0000", 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063147809999999999 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442370+0000", 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011401200000000001 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466965+0000", 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024594957000000001 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.027 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19980 4.2b 4:d77b40aa:::100000000ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5792448820000002, 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086778108000000007, 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379129+0000", 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0629999999999999e-06 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379135+0000", 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1530000000000002e-06 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379148+0000", 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3213e-05 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379162+0000", 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4239999999999999e-05 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.444734+0000", 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065572004000000003 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.444852+0000", 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011768 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.465903+0000", 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021050755000000001 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19981 4.8 4:12260154:::100000000af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:36.031 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.5791904690000003, 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.087707529000000006, 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:36.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379182+0000", 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379188+0000", 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8159999999999999e-06 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379203+0000", 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4946999999999999e-05 2024-04-25T23:01:36.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379217+0000", 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4015999999999999e-05 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.447948+0000", 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068730232000000002 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.449854+0000", 2024-04-25T23:01:36.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019068519999999999 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466887+0000", 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017032335999999999 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:36.035 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:36.036 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:36.083 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:36.082+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:36.157 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:36.151+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:36.167 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:36.255 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:36.255 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:36.255 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:36.256 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:36.299 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:36.298+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:36.359 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:36.355+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:36.424 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:36.424 INFO:teuthology.orchestra.run.smithi165.stdout: "complaint_time": 30, 2024-04-25T23:01:36.425 INFO:teuthology.orchestra.run.smithi165.stdout: "num_blocked_ops": 0 2024-04-25T23:01:36.425 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:36.435 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:01:36.439 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:36.459 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:36.455+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:36.560 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "size": 20, 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 600, 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [ 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19829 4.1e 4:78cea7f0:::10000000017.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.368153+0000", 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1914206759999999, 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.098724247000000001, 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368153+0000", 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368153+0000", 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368154+0000", 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.097e-06 2024-04-25T23:01:36.562 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368160+0000", 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.8429999999999998e-06 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368178+0000", 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7963000000000001e-05 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368191+0000", 2024-04-25T23:01:36.563 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3763e-05 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.371753+0000", 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0035617909999999999 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.372070+0000", 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031656099999999998 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.564 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466877+0000", 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.094807229000000007 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19862 4.26 4:65f9ba37:::10000000038.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.368995+0000", 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1905784839999995, 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097568718999999998, 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.565 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368995+0000", 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368995+0000", 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.566 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.368996+0000", 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 9.5300000000000002e-07 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369000+0000", 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.25e-06 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369015+0000", 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4977000000000001e-05 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.567 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369027+0000", 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.225e-05 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379642+0000", 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010615042 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379959+0000", 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00031704699999999999 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.568 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466564+0000", 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086604200000000006 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19873 4.16 4:6a415a36:::10000000043.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.369291+0000", 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1902825999999997, 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097267142000000001, 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.569 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369291+0000", 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369291+0000", 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369292+0000", 2024-04-25T23:01:36.570 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2899999999999999e-06 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369297+0000", 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.8269999999999997e-06 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369314+0000", 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7076e-05 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.571 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369327+0000", 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3533000000000001e-05 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386572+0000", 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.017244443000000002 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386893+0000", 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00032107700000000002 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.572 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466558+0000", 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.079664895999999999 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19876 4.26 4:678705fb:::10000000046.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.369401+0000", 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1901727879999999, 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097469057999999997, 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.573 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369401+0000", 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369401+0000", 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.574 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369402+0000", 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.31e-06 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369407+0000", 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.4469999999999997e-06 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369425+0000", 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7572999999999999e-05 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369438+0000", 2024-04-25T23:01:36.575 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3593e-05 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.389693+0000", 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.020254613000000001 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.389990+0000", 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029641999999999998 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466870+0000", 2024-04-25T23:01:36.576 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.076880102000000006 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19886 4.16 4:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.369971+0000", 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1896021460000004, 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.097159191000000006, 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.577 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369971+0000", 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369971+0000", 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.578 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369972+0000", 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2130000000000001e-06 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369978+0000", 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1730000000000003e-06 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.369995+0000", 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7574000000000001e-05 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.579 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370009+0000", 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.348e-05 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.391720+0000", 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.021711444999999999 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.392357+0000", 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00063656100000000001 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467130+0000", 2024-04-25T23:01:36.580 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.074773745000000003 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19889 4.16 4:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.370126+0000", 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.189447361, 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.098894255, 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.581 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370126+0000", 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370126+0000", 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370127+0000", 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.034e-06 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.582 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370132+0000", 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.6959999999999996e-06 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370148+0000", 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6189999999999999e-05 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370161+0000", 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3277e-05 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.395030+0000", 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.024869037 2024-04-25T23:01:36.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.395331+0000", 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030040500000000001 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469020+0000", 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.073689615999999999 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19905 4.26 4:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.370597+0000", 2024-04-25T23:01:36.584 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1889761050000001, 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.096792665, 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370597+0000", 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370597+0000", 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.585 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370599+0000", 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.657e-06 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370618+0000", 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8819000000000001e-05 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370635+0000", 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7090000000000001e-05 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.586 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.370648+0000", 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3263e-05 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.397275+0000", 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.026626918999999999 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.397583+0000", 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00030806399999999998 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.587 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467390+0000", 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.069806853000000002 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19931 4.1e 4:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.375693+0000", 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1838801270000001, 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.092054065000000004, 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.588 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375693+0000", 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375693+0000", 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375694+0000", 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.046e-06 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.589 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375700+0000", 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.1199999999999999e-06 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375722+0000", 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.1236000000000001e-05 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375735+0000", 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3003000000000001e-05 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.590 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.399171+0000", 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.023436077999999999 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.399463+0000", 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029231100000000001 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467747+0000", 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.068284270999999994 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.591 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19937 4.26 4:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.375750+0000", 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.183823372, 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.092232585000000006, 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375750+0000", 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.592 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375750+0000", 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375751+0000", 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3069999999999999e-06 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375767+0000", 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.613e-05 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.593 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375784+0000", 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6307000000000002e-05 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.375796+0000", 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2673e-05 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.406605+0000", 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.030808272000000001 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.594 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.406799+0000", 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00019386800000000001 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.467983+0000", 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.061184028000000001 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19947 4.26 4:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.376008+0000", 2024-04-25T23:01:36.595 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1835651939999998, 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.092226467000000006, 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376008+0000", 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376008+0000", 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.596 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376009+0000", 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.04e-06 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376014+0000", 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0039999999999999e-06 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376030+0000", 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6010000000000001e-05 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.597 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376043+0000", 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2758999999999999e-05 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.408747+0000", 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.032704444999999999 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.409047+0000", 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00029938399999999998 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.598 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.468235+0000", 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.059187824999999999 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19960 4.0 4:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.376566+0000", 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1830077750000001, 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.089473320999999995, 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.599 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376566+0000", 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376566+0000", 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376567+0000", 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.063e-06 2024-04-25T23:01:36.600 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376572+0000", 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0170000000000004e-06 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376589+0000", 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7382999999999999e-05 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.376603+0000", 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3570000000000001e-05 2024-04-25T23:01:36.601 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377149+0000", 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00054655199999999995 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377455+0000", 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.000305727 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466039+0000", 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.088584009000000005 2024-04-25T23:01:36.602 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19978 4.26 4:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.377267+0000", 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1823063850000004, 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.091197419000000002, 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377267+0000", 2024-04-25T23:01:36.603 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377267+0000", 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377268+0000", 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.0139999999999999e-06 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377273+0000", 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 4.5199999999999999e-06 2024-04-25T23:01:36.604 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377292+0000", 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9488999999999999e-05 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377307+0000", 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.5359999999999999e-05 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.414686+0000", 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.037379123 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.605 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.414946+0000", 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025916600000000002 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.468464+0000", 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.053518746999999998 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:19987 4.29 4:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.606 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.377457+0000", 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.18211654, 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.088662766000000004, 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377457+0000", 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377457+0000", 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377458+0000", 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2899999999999999e-06 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377463+0000", 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1599999999999997e-06 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377484+0000", 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0363000000000001e-05 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.608 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.377500+0000", 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6127e-05 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379077+0000", 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0015768830000000001 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.379356+0000", 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027966699999999999 2024-04-25T23:01:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466120+0000", 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086763276 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20003 4.16 4:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.381166+0000", 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1784069129999999, 2024-04-25T23:01:36.610 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.088408129000000002, 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381166+0000", 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381166+0000", 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.611 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381168+0000", 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.24e-06 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381187+0000", 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.9273e-05 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381205+0000", 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8366999999999999e-05 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.612 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381220+0000", 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4613000000000001e-05 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.417811+0000", 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.03659072 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.418070+0000", 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00025957200000000001 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.613 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469575+0000", 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.051504344000000001 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20007 4.11 4:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.381401+0000", 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1781728249999999, 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.084687192999999994, 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.614 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381401+0000", 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381401+0000", 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.615 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381402+0000", 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.077e-06 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381407+0000", 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.0529999999999997e-06 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381423+0000", 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6633000000000002e-05 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.616 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381437+0000", 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.3787e-05 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382684+0000", 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.0012468519999999999 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.384238+0000", 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.001553776 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466088+0000", 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.081850014999999998 2024-04-25T23:01:36.617 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20012 4.11 4:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.381585+0000", 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1779881769999996, 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.084689951999999999, 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381585+0000", 2024-04-25T23:01:36.618 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381585+0000", 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381586+0000", 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.2529999999999999e-06 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381592+0000", 2024-04-25T23:01:36.619 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2769999999999996e-06 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381609+0000", 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7090000000000001e-05 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.381629+0000", 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 2.0237e-05 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.391825+0000", 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.010196449 2024-04-25T23:01:36.620 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.392171+0000", 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00034585300000000002 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466275+0000", 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.074103793000000001 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.621 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20019 4.29 4:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.382479+0000", 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1770938979999999, 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.083972020999999994, 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382479+0000", 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.622 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382479+0000", 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382481+0000", 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1599999999999999e-06 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382486+0000", 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.1930000000000001e-06 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.623 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382503+0000", 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6852999999999999e-05 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382519+0000", 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.6246999999999999e-05 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.396325+0000", 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.013805997 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.624 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.396595+0000", 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027041100000000002 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.466451+0000", 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.06985616 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20022 4.1e 4:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.382614+0000", 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1769596589999995, 2024-04-25T23:01:36.625 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086126444999999996, 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382614+0000", 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382614+0000", 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.626 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382615+0000", 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.206e-06 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382620+0000", 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.3800000000000002e-06 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382640+0000", 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.986e-05 2024-04-25T23:01:36.627 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382655+0000", 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4377e-05 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.423294+0000", 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.040639010000000003 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.423514+0000", 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022096799999999999 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.628 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.468740+0000", 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045225644000000002 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20027 4.26 4:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.382885+0000", 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1766886449999996, 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.086400974000000005, 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.629 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382885+0000", 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382885+0000", 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382886+0000", 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.1069999999999999e-06 2024-04-25T23:01:36.630 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382893+0000", 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 6.8789999999999997e-06 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382910+0000", 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7652999999999999e-05 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.382929+0000", 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.8876999999999999e-05 2024-04-25T23:01:36.631 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.423794+0000", 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.040864478000000003 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.424069+0000", 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00027483500000000002 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469286+0000", 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.045217145 2024-04-25T23:01:36.632 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "description": "osd_op(mds.0.3:20062 4.16 4:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "initiated_at": "2024-04-25T23:01:32.386038+0000", 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "age": 4.1735355959999998, 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.083718745999999997, 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "continuous": false, 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "type_data": { 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "flag_point": "started", 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "events": [ 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.633 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "initiated", 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386038+0000", 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "header_read", 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386038+0000", 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "throttled", 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386039+0000", 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.44e-06 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "all_read", 2024-04-25T23:01:36.634 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386044+0000", 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 5.2000000000000002e-06 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "dispatched", 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386062+0000", 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.7808999999999998e-05 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "queued_for_pg", 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.386076+0000", 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 1.4042999999999999e-05 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "reached_pg", 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.426048+0000", 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.039971484000000002 2024-04-25T23:01:36.635 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "started", 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.426275+0000", 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.00022741300000000001 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: "event": "done", 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: "time": "2024-04-25T23:01:32.469757+0000", 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: "duration": 0.043481356999999998 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-04-25T23:01:36.636 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:36.637 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:36.558+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:36.638 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:36.679 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:36.678+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:36.762 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:36.755+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:36.774 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:36.775 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:36.775 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-04-25T23:01:36.775 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:36.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:36.874 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:36.871+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:36.952 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-04-25T23:01:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-04-25T23:01:36.952 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-04-25T23:01:36.952 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:36.963 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:36.962+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:36.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:37.064 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:37.062+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19837 4.3a 4:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7666074089999997, 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.095211689000000002, 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368202+0000", 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368203+0000", 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1230000000000001e-06 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368208+0000", 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1370000000000001e-06 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368226+0000", 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7393000000000001e-05 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.368241+0000", 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4708999999999999e-05 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396238+0000", 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027997261999999998 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.396454+0000", 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021643300000000001 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.463414+0000", 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.066959632000000005 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19874 4.1a 4:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7646073150000001, 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.093178121000000003, 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370202+0000", 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370205+0000", 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0989999999999999e-06 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370214+0000", 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1969999999999996e-06 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370896+0000", 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068217699999999996 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.370913+0000", 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7557000000000001e-05 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.429967+0000", 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.059053268999999999 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.430119+0000", 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152948 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.463380+0000", 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033260874000000003 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19897 4.39 4:9fc48627:::1000000005b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.757992926, 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086832125999999996, 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376817+0000", 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376821+0000", 2024-04-25T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1699999999999999e-06 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376826+0000", 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1599999999999997e-06 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376840+0000", 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4483e-05 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376855+0000", 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4187e-05 2024-04-25T23:01:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.415619+0000", 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.03876396 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.415738+0000", 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119857 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.463649+0000", 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.047910308999999998 2024-04-25T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19901 4.2c 4:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7578783370000002, 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.089235206999999997, 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376931+0000", 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376936+0000", 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9259999999999999e-06 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376942+0000", 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.48e-06 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376955+0000", 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3627e-05 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.376969+0000", 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3443e-05 2024-04-25T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.411269+0000", 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034299927000000001 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.411475+0000", 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020645599999999999 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466166+0000", 2024-04-25T23:01:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.054691348000000001 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19908 4.38 4:1cab634c:::10000000066.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7576429659999997, 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.089433023, 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377167+0000", 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377171+0000", 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.887e-06 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377177+0000", 2024-04-25T23:01:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7459999999999997e-06 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377191+0000", 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3995999999999999e-05 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377206+0000", 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4627000000000001e-05 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.413838+0000", 2024-04-25T23:01:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036632655 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.414005+0000", 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000166241 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466600+0000", 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.052594871000000001 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19912 4.c 4:31e782ee:::1000000006a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7575299739999997, 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.089120208000000006, 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377280+0000", 2024-04-25T23:01:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377284+0000", 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.357e-06 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377290+0000", 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377304+0000", 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4403000000000001e-05 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377317+0000", 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3413e-05 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.412800+0000", 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035482568999999999 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.413935+0000", 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011349109999999999 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466400+0000", 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.052464904999999999 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19926 4.38 4:1da7f472:::10000000078.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7570390150000001, 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088969592, 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377771+0000", 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377775+0000", 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6299999999999997e-06 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377780+0000", 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9060000000000001e-06 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377794+0000", 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3833e-05 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377810+0000", 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.577e-05 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441784+0000", 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063974042999999994 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441904+0000", 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120282 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466740+0000", 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024836127999999999 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19929 4.a 4:51fb4558:::1000000007b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7569278060000002, 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086353412000000004, 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377882+0000", 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377886+0000", 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8489999999999999e-06 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377892+0000", 2024-04-25T23:01:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5100000000000004e-06 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377906+0000", 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3573e-05 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.377920+0000", 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3883000000000001e-05 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442160+0000", 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064240065999999998 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442315+0000", 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015551900000000001 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.464235+0000", 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021920011999999999 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19933 4.30 4:0ffe11ed:::1000000007f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.756763318, 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088692382, 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378046+0000", 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378051+0000", 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3959999999999999e-06 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378056+0000", 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4040000000000003e-06 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378070+0000", 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4233000000000001e-05 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378083+0000", 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2857000000000001e-05 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442560+0000", 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.064477038 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442757+0000", 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019683999999999999 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466739+0000", 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023981613999999998 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19934 4.30 4:0f444cf3:::10000000080.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7567093419999997, 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088845898000000006, 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378100+0000", 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378105+0000", 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4329999999999997e-06 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378110+0000", 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8470000000000001e-06 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378125+0000", 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4656e-05 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378138+0000", 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3006999999999999e-05 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.443624+0000", 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065485926999999999 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.443730+0000", 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105943 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466946+0000", 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023216085000000001 2024-04-25T23:01:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19936 4.39 4:9eab5bef:::10000000082.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7565824169999997, 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086269907000000007, 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378227+0000", 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378232+0000", 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4429999999999996e-06 2024-04-25T23:01:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378256+0000", 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4579999999999998e-05 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378269+0000", 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3314e-05 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378283+0000", 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3305999999999999e-05 2024-04-25T23:01:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439426+0000", 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061143066000000003 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439561+0000", 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013495099999999999 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.464497+0000", 2024-04-25T23:01:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024936247000000002 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19945 4.8 4:13275b8b:::1000000008b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7563429690000003, 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088168225000000003, 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378467+0000", 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378471+0000", 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0600000000000001e-06 2024-04-25T23:01:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378476+0000", 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.677e-06 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378490+0000", 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3593e-05 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378503+0000", 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3383e-05 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.446351+0000", 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.067847304999999997 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.446475+0000", 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012417600000000001 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466635+0000", 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020160030999999998 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19946 4.3c 4:3c2e7968:::1000000008c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7562893400000004, 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088043262999999997, 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378520+0000", 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378524+0000", 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2100000000000003e-06 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378530+0000", 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4970000000000001e-06 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378544+0000", 2024-04-25T23:01:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4143e-05 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378557+0000", 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.277e-05 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439536+0000", 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.060979621999999997 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.439668+0000", 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013202999999999999 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466563+0000", 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026894991 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19952 4.c 4:317b49a4:::10000000092.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7562343629999999, 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088113021999999999, 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378575+0000", 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378579+0000", 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8859999999999997e-06 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378584+0000", 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3340000000000001e-06 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378598+0000", 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3976e-05 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378612+0000", 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3563e-05 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.440100+0000", 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.061488142000000003 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.440216+0000", 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116179 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466688+0000", 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026471941999999998 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19953 4.c 4:30dd2ab9:::10000000093.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7561790909999999, 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.088176929000000001, 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378630+0000", 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378634+0000", 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5470000000000001e-06 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378640+0000", 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5729999999999998e-06 2024-04-25T23:01:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378653+0000", 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3643e-05 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378667+0000", 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3923999999999999e-05 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441313+0000", 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062645963999999998 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441443+0000", 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012981399999999999 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466807+0000", 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025364464 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19966 4.2b 4:d4ac5e36:::100000000a0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7559638829999997, 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086946383000000002, 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378846+0000", 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378850+0000", 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.233e-06 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378863+0000", 2024-04-25T23:01:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.288e-05 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378876+0000", 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378890+0000", 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3507e-05 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.420237+0000", 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041347122 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.420397+0000", 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016060900000000001 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.465792+0000", 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.045394715000000002 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19970 4.c 4:33682534:::100000000a4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7558479169999996, 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.087985547999999997, 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378962+0000", 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378967+0000", 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359999999999996e-06 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378973+0000", 2024-04-25T23:01:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8039999999999998e-06 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378985+0000", 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2763e-05 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.378999+0000", 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441820+0000", 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.062821415000000005 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.441933+0000", 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112587 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466947+0000", 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025014346 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19979 4.3c 4:3ca8796c:::100000000ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7557380880000002, 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.087893338000000001, 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379071+0000", 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379075+0000", 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5499999999999999e-06 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379081+0000", 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9529999999999996e-06 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379094+0000", 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379108+0000", 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4133e-05 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442256+0000", 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.063147809999999999 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.442370+0000", 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011401200000000001 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466965+0000", 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024594957000000001 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19980 4.2b 4:d77b40aa:::100000000ae.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7556848020000002, 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.086778108000000007, 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379125+0000", 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379129+0000", 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0629999999999999e-06 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379135+0000", 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1530000000000002e-06 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379148+0000", 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3213e-05 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379162+0000", 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4239999999999999e-05 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.444734+0000", 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.065572004000000003 2024-04-25T23:01:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.444852+0000", 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011768 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.465903+0000", 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021050755000000001 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:19981 4.8 4:12260154:::100000000af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7556303890000002, 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.087707529000000006, 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379179+0000", 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379182+0000", 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379188+0000", 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8159999999999999e-06 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379203+0000", 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4946999999999999e-05 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.379217+0000", 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4015999999999999e-05 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.447948+0000", 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.068730232000000002 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.449854+0000", 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019068519999999999 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-04-25T23:01:32.466887+0000", 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017032335999999999 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-04-25T23:01:37.218 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-04-25T23:01:37.220 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:37.221 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:37.218+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:37.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T23:01:37.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-04-25T23:01:37.320 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:37.318+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:37.352 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T23:01:37.352 INFO:teuthology.orchestra.run.smithi165.stdout: "ops": [], 2024-04-25T23:01:37.352 INFO:teuthology.orchestra.run.smithi165.stdout: "num_ops": 0 2024-04-25T23:01:37.352 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T23:01:37.366 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:37.399 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-25T23:01:37.399 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T23:01:37.418 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-25T23:01:37.418 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T23:01:37.418 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-25T23:01:37.422 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T23:01:37.422 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T23:01:37.455 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:37.454+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:37.522 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:37.518+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:37.534 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:37.534 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:37.549 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:37.622 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:37.619+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:37.712 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:37.712 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:37.723 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:37.722+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:37.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:37.824 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:37.819+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:37.860 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:37.860 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:37.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:37.924 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:37.922+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:38.026 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:38.019+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:38.035 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:38.035 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:38.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:38.134 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:38.131+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:38.211 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:38.211 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:38.227 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:38.227 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:38.226+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:38.327 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:38.326+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:38.357 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:38.357 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:38.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:38.429 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:38.423+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:38.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:01:38.529 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:38.523+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:38.536 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:38.536 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:38.550 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:38.630 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:38.627+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:38.674 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:38.674 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:38.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T23:01:38.731 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:38.730+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:38.776 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T23:01:38.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T23:01:38.777 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T23:01:38.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T23:01:38.797 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T23:01:38.821 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:38.821 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:38.832 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:38.830+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:38.836 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T23:01:38.845 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T23:01:38.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T23:01:38.845 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T23:01:38.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T23:01:38.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-25T23:01:38.932 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-04-25T23:01:38.930+0000 7f38d4221640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21646) UID: 0 2024-04-25T23:01:38.957 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:38.957 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:38.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T23:01:39.034 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-04-25T23:01:39.027+0000 7f7f4ade6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21639) UID: 0 2024-04-25T23:01:39.090 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-25T23:01:39.102 INFO:tasks.thrashosds:joining thrashosds 2024-04-25T23:01:39.103 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:39.103 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:39.109 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T23:01:39.239 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:39.240 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:39.254 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T23:01:39.373 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:39.373 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:39.387 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T23:01:39.446 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:01:39.506 INFO:teuthology.orchestra.run.smithi165.stdout:ERROR: (22) Invalid argument 2024-04-25T23:01:39.506 INFO:teuthology.orchestra.run.smithi165.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T23:01:41.474 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T23:01:42.451 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-25T23:01:42.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T23:01:43.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2024-04-25T23:01:43.466 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-25T23:01:48.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2024-04-25T23:01:54.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~141s 2024-04-25T23:02:00.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~146s 2024-04-25T23:02:05.884 DEBUG:teuthology.orchestra.console.smithi172:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.72 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 7F 91 GUID: 00000000 0000 0000 0000 0CC47AD9172C DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:7f:91)... Configuring (net0 0c:c4:7a:88:7f:91).... Configuring (net0 0c:c4:7a:88:7f:91)..... Configuring (net0 0c:c4:7a:88:7f:91)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.708 MHz processor [ 0.000414] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000595] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001901] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008120] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008136] Using GB pages for direct mapping [ 0.008272] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008278] ACPI: Early table checksum verification disabled [ 0.008281] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008285] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008290] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008295] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008298] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008300] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008303] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008306] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008309] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008312] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008314] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008317] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008320] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008323] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008326] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008328] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008331] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008334] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008337] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008340] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008342] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008345] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008348] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008350] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008352] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008353] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008354] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008355] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008356] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008357] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008358] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008359] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008360] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008361] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008362] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008363] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008364] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008365] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008366] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008367] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008368] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008369] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008370] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008371] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008465] No NUMA configuration found [ 0.008467] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008476] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008805] Zone ranges: [ 0.008806] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008808] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008810] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008811] Device empty [ 0.008812] Movable zone start for each node [ 0.008815] Early memory node ranges [ 0.008816] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008817] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008818] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008822] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008827] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008863] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080428] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080543] ACPI: PM-Timer IO Port: 0x408 [ 0.080551] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080552] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080553] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080554] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080555] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080556] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080557] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080558] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080567] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080571] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080574] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080575] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080579] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080580] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080584] TSC deadline timer available [ 0.080585] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080595] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080597] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080598] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080599] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080600] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080601] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080602] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080603] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080604] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080605] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080605] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080607] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080609] Booting paravirtualized kernel on bare hardware [ 0.080611] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080617] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080829] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080860] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.080861] Policy zone: Normal [ 0.080863] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.080922] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.083077] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084224] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084316] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170446] Memory: 32672716K/33438012K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765036K reserved, 0K cma-reserved) [ 0.170730] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170746] Kernel/User page tables isolation: enabled [ 0.170778] ftrace: allocating 50694 entries in 199 pages [ 0.190431] ftrace: allocated 199 pages with 5 groups [ 0.190551] rcu: Hierarchical RCU implementation. [ 0.190553] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190554] Rude variant of Tasks RCU enabled. [ 0.190555] Tracing variant of Tasks RCU enabled. [ 0.190555] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190556] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194218] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194418] random: crng init done [ 0.199296] Console: colour VGA+ 80x25 [ 0.210701] printk: console [tty0] enabled [ 1.197712] printk: console [ttyS1] enabled [ 1.201971] ACPI: Core revision 20210730 [ 1.206136] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.215362] APIC: Switch to symmetric I/O mode setup [ 1.220400] DMAR: Host address width 46 [ 1.224312] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.230790] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.238882] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.245222] DMAR: ATSR flags: 0x0 [ 1.248605] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.254946] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.261368] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.267792] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.273260] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.273260] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.288445] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.293822] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.300118] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.323370] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32723d995b0, max_idle_ns: 440795369662 ns [ 1.333985] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.41 BogoMIPS (lpj=13998832) [ 1.338000] CPU0: Thermal monitoring enabled (TM1) [ 1.342036] process: using mwait in idle threads [ 1.345984] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.349982] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.353984] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.357983] Spectre V2 : Mitigation: Retpolines [ 1.361982] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.365982] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.369982] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.373983] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.377983] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.381983] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.385986] MDS: Mitigation: Clear CPU buffers [ 1.389983] TAA: Mitigation: Clear CPU buffers [ 1.393982] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.397988] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.401982] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.405982] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.409983] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.413982] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.435673] Freeing SMP alternatives memory: 44K [ 1.437983] pid_max: default: 32768 minimum: 301 [ 1.442003] LSM: Security Framework initializing [ 1.445990] landlock: Up and running. [ 1.449983] Yama: becoming mindful. [ 1.454000] AppArmor: AppArmor initialized [ 1.458044] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.462023] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.466339] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.469988] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.474090] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.477984] ... version: 3 [ 1.481983] ... bit width: 48 [ 1.485983] ... generic registers: 4 [ 1.489983] ... value mask: 0000ffffffffffff [ 1.493983] ... max period: 00007fffffffffff [ 1.497983] ... fixed-purpose events: 3 [ 1.501983] ... event mask: 000000070000000f [ 1.506043] signal: max sigframe size: 1776 [ 1.509997] rcu: Hierarchical SRCU implementation. [ 1.514697] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.518046] smp: Bringing up secondary CPUs ... [ 1.522064] x86: Booting SMP configuration: [ 1.525985] .... node #0, CPUs: #1 #2 #3 #4 [ 1.534064] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.541983] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.545983] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.550081] #5 #6 #7 [ 1.550541] smp: Brought up 1 node, 8 CPUs [ 1.557985] smpboot: Max logical packages: 1 [ 1.561983] smpboot: Total of 8 processors activated (55995.32 BogoMIPS) [ 1.570325] devtmpfs: initialized [ 1.573399] x86/mm: Memory block size: 128MB [ 1.575584] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.578059] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.581993] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.586030] pinctrl core: initialized pinctrl subsystem [ 1.590073] PM: RTC time: 23:01:32, date: 2024-04-25 [ 1.594089] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.598325] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.602280] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.606317] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.609994] audit: initializing netlink subsys (disabled) [ 1.614001] audit: type=2000 audit(1714086090.356:1): state=initialized audit_enabled=0 res=1 [ 1.614100] thermal_sys: Registered thermal governor 'fair_share' [ 1.617984] thermal_sys: Registered thermal governor 'bang_bang' [ 1.621983] thermal_sys: Registered thermal governor 'step_wise' [ 1.625983] thermal_sys: Registered thermal governor 'user_space' [ 1.629983] thermal_sys: Registered thermal governor 'power_allocator' [ 1.633988] EISA bus registered [ 1.641191] cpuidle: using governor ladder [ 1.641985] cpuidle: using governor menu [ 1.645999] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.649984] ACPI: bus type PCI registered [ 1.653984] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.658037] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.661985] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.665996] PCI: Using configuration type 1 for base access [ 1.671009] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.673999] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.677984] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.682058] ACPI: Added _OSI(Module Device) [ 1.685985] ACPI: Added _OSI(Processor Device) [ 1.689990] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.693983] ACPI: Added _OSI(Processor Aggregator Device) [ 1.697983] ACPI: Added _OSI(Linux-Dell-Video) [ 1.701983] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.705983] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.756600] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.761318] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.766133] ACPI: Dynamic OEM Table Load: [ 1.797956] ACPI: Interpreter enabled [ 1.797994] ACPI: PM: (supports S0 S4 S5) [ 1.801983] ACPI: Using IOAPIC for interrupt routing [ 1.806005] HEST: Enabling Firmware First mode for corrected errors. [ 1.810062] HEST: Table parsing has been initialized. [ 1.814135] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.817985] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.821983] PCI: Using E820 reservations for host bridge windows [ 1.826678] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.863266] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.865986] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.871968] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.875037] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.877983] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.882015] PCI host bridge to bus 0000:ff [ 1.885984] pci_bus 0000:ff: root bus resource [bus ff] [ 1.889993] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.894050] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.898035] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.902035] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.906035] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.910037] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.914034] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.918034] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.922038] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.926033] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.930035] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.934033] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.938035] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.942035] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.946035] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.950035] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.954037] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.958033] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.962034] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.966008] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.970044] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.974085] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.978047] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.982046] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.986049] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.990047] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.994044] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.998038] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.002037] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.006049] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.010046] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.014048] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.018048] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.022036] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.026036] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.030036] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.034038] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.038047] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.042047] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.046048] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.050051] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.054040] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.058036] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.062038] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.066039] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.070036] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.074037] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.078036] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.082041] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.086037] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.090035] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.094035] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.098008] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.102036] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.106035] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114449] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.117986] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.122325] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.126457] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.129983] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.134275] PCI host bridge to bus 0000:00 [ 2.137984] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.141983] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.145983] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.149983] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.153983] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.157983] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.161983] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.166090] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.170194] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.174049] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.178155] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.182048] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.186149] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.190048] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.194143] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.198002] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.202178] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.206002] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.210175] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.214002] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.218176] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.222002] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.226174] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.230001] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.234178] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.238002] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.242174] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.246002] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.250175] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.254002] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.258128] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.262204] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.266131] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.270152] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.273997] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.278222] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.282275] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.286004] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.289994] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.293994] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.297994] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.301994] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.305994] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.310023] pci 0000:00:11.4: PME# supported from D3hot [ 2.314138] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.318009] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.322058] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.326131] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.330009] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.334059] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.338127] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.342009] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.346059] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.350141] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.354006] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.358087] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.362144] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.366072] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.370146] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.374075] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.378144] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.382074] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.386153] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.390006] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.394087] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.398140] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.402256] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.406002] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.409993] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.413993] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.417993] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.421993] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.425993] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.430016] pci 0000:00:1f.2: PME# supported from D3hot [ 2.434126] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.438008] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.442014] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.446198] acpiphp: Slot [1] registered [ 2.450000] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.454163] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.458003] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.462024] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.465986] pci 0000:02:00.0: enabling Extended Tags [ 2.470087] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.473985] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.478166] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.482005] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.485992] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.490005] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.493993] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.498023] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.502004] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.505983] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.509996] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.513983] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.518145] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.522004] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.525992] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.530005] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.533992] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.538023] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.542000] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.545983] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.549995] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.553983] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.558116] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.561984] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.565983] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.569984] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.574014] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.578049] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.582071] pci 0000:05:00.0: enabling Extended Tags [ 2.586060] pci 0000:05:00.0: supports D1 D2 [ 2.589983] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.594087] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.597985] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.601984] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.606031] pci_bus 0000:06: extended config space not accessible [ 2.610013] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.614016] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.618000] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.622000] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.626067] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.630024] pci 0000:06:00.0: supports D1 D2 [ 2.633983] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.638092] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.641989] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.645986] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.650084] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.654010] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.658011] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.661997] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.666117] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.670021] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.673983] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.678008] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.681983] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.686158] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.690010] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.694011] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.697997] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.702112] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.706020] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.709983] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.714008] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.717983] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.722138] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.725984] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.729984] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.733986] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.738896] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.742033] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.746031] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.750031] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.754032] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.757983] ACPI: PCI: Interrupt link LNKE disabled [ 2.762031] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.765983] ACPI: PCI: Interrupt link LNKF disabled [ 2.770031] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.773983] ACPI: PCI: Interrupt link LNKG disabled [ 2.778031] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.781983] ACPI: PCI: Interrupt link LNKH disabled [ 2.786171] iommu: Default domain type: Translated [ 2.789984] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.794110] SCSI subsystem initialized [ 2.797993] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.801982] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.801983] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.805983] vgaarb: loaded [ 2.808763] ACPI: bus type USB registered [ 2.809993] usbcore: registered new interface driver usbfs [ 2.813987] usbcore: registered new interface driver hub [ 2.817988] usbcore: registered new device driver usb [ 2.821998] pps_core: LinuxPPS API ver. 1 registered [ 2.825983] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.829986] PTP clock support registered [ 2.833997] EDAC MC: Ver: 3.0.0 [ 2.837293] NetLabel: Initializing [ 2.837984] NetLabel: domain hash size = 128 [ 2.841983] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.845994] NetLabel: unlabeled traffic allowed by default [ 2.849992] PCI: Using ACPI for IRQ routing [ 2.859210] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.861983] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.868022] clocksource: Switched to clocksource tsc-early [ 2.880250] VFS: Disk quotas dquot_6.6.0 [ 2.884255] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.891299] AppArmor: AppArmor Filesystem Enabled [ 2.896097] pnp: PnP ACPI init [ 2.899685] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.905673] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.911664] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.917651] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.923640] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.929630] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.935618] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.942301] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.948986] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.955669] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.962352] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.969034] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.975718] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.982609] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.988596] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.994585] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.000572] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.006554] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.013503] pnp: PnP ACPI: found 5 devices [ 3.023058] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.032058] NET: Registered PF_INET protocol family [ 3.037172] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.046463] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.055282] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.063281] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.071690] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.079228] TCP: Hash tables configured (established 262144 bind 65536) [ 3.086043] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.093827] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.100853] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.108309] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.114037] NET: Registered PF_XDP protocol family [ 3.118915] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.130487] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.138401] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.143447] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.148480] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.155348] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.162999] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.171002] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.178741] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.186829] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.194480] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.202483] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.210222] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.218310] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.225961] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.233963] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.241702] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.249790] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.257441] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.265444] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.273183] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.281270] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.286298] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.292459] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.299315] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.307151] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.312197] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.317226] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.323396] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.330264] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.335558] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.341726] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.348592] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.356422] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.364343] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.372178] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.380093] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.385127] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.391287] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.398143] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.413710] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.419954] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.426197] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.433139] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.440084] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.447024] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.453969] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.460303] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.465945] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.472283] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.479591] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.485230] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.491568] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.497209] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.503547] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.509187] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.515517] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.523032] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.551720] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20888 usecs [ 3.583715] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23918 usecs [ 3.591215] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.597766] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.597772] Trying to unpack rootfs image as initramfs... [ 3.604273] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.618235] Initialise system trusted keyrings [ 3.622758] Key type blacklist registered [ 3.626877] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.634351] zbud: loaded [ 3.637155] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.643220] fuse: init (API version 7.34) [ 3.647448] integrity: Platform Keyring initialized [ 3.660297] Key type asymmetric registered [ 3.664470] Asymmetric key parser 'x509' registered [ 3.669440] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.676967] io scheduler mq-deadline registered [ 3.681972] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.688016] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.694044] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.700013] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.705997] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.711957] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.717928] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.724839] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.730617] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.739084] ACPI: button: Power Button [PWRB] [ 3.743542] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.751062] ACPI: button: Power Button [PWRF] [ 3.756716] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.764294] pstore: Registered erst as persistent store backend [ 3.770415] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.797347] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.826282] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.835908] Linux agpgart interface v0.103 [ 3.841800] loop: module loaded [ 3.845238] tun: Universal TUN/TAP device driver, 1.6 [ 3.850380] PPP generic driver version 2.4.2 [ 3.854769] VFIO - User Level meta-driver version: 0.3 [ 3.860099] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.866700] ehci-pci: EHCI PCI platform driver [ 3.871377] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.876674] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.884171] ehci-pci 0000:00:1a.0: debug port 2 [ 3.892681] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.911605] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.917468] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.925825] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.933137] usb usb1: Product: EHCI Host Controller [ 3.938087] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.944603] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.949437] hub 1-0:1.0: USB hub found [ 3.951702] Freeing initrd memory: 65088K [ 3.953264] hub 1-0:1.0: 2 ports detected [ 3.961676] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.966972] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.974463] ehci-pci 0000:00:1d.0: debug port 2 [ 3.982948] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.003615] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.009463] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.017820] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.025122] usb usb2: Product: EHCI Host Controller [ 4.030065] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.036571] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.041369] hub 2-0:1.0: USB hub found [ 4.045182] hub 2-0:1.0: 2 ports detected [ 4.049372] ehci-platform: EHCI generic platform driver [ 4.054680] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.060928] ohci-pci: OHCI PCI platform driver [ 4.065456] ohci-platform: OHCI generic platform driver [ 4.070748] uhci_hcd: USB Universal Host Controller Interface driver [ 4.077218] i8042: PNP: No PS/2 controller found. [ 4.082049] mousedev: PS/2 mouse device common for all mice [ 4.087762] rtc_cmos 00:00: RTC can wake from S4 [ 4.092664] rtc_cmos 00:00: registered as rtc0 [ 4.097199] rtc_cmos 00:00: setting system clock to 2024-04-25T23:01:35 UTC (1714086095) [ 4.105406] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.112184] i2c_dev: i2c /dev entries driver [ 4.116687] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.128969] device-mapper: uevent: version 1.0.3 [ 4.133717] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.142260] platform eisa.0: Probing EISA bus 0 [ 4.146853] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.153707] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.160212] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.166723] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.173232] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.179740] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.186251] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.192761] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.199268] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.205779] platform eisa.0: EISA: Detected 0 cards [ 4.210729] intel_pstate: Intel P-state driver initializing [ 4.217433] ledtrig-cpu: registered to indicate activity on CPUs [ 4.223660] drop_monitor: Initializing network drop monitor service [ 4.230115] NET: Registered PF_INET6 protocol family [ 4.242573] Segment Routing with IPv6 [ 4.246328] In-situ OAM (IOAM) with IPv6 [ 4.250349] NET: Registered PF_PACKET protocol family [ 4.255625] Key type dns_resolver registered [ 4.260494] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.266478] microcode: Microcode Update Driver: v2.2. [ 4.266552] resctrl: L3 allocation detected [ 4.275935] resctrl: L3 monitoring detected [ 4.280188] IPI shorthand broadcast: enabled [ 4.284531] sched_clock: Marking stable (3220946687, 1063570617)->(5273935093, -989417789) [ 4.293139] registered taskstats version 1 [ 4.295607] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.304035] Loading compiled-in X.509 certificates [ 4.309523] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.319992] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.330235] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.340327] blacklist: Loading compiled-in revocation X.509 certificates [ 4.347109] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.357030] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.367560] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.378439] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.383613] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.388990] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.406387] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.417176] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.427982] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.439799] zswap: loaded using pool lzo/zbud [ 4.444543] Key type .fscrypt registered [ 4.448536] Key type fscrypt-provisioning registered [ 4.453619] pstore: Using crash dump compression: deflate [ 4.462227] Key type encrypted registered [ 4.464124] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.466306] AppArmor: AppArmor sha1 policy hashing enabled [ 4.482338] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.487940] ima: No TPM chip found, activating TPM-bypass! [ 4.500701] Loading compiled-in module X.509 certificates [ 4.500935] hub 1-1:1.0: USB hub found [ 4.506641] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.520015] ima: Allocated hash algorithm: sha1 [ 4.520278] hub 1-1:1.0: 6 ports detected [ 4.524633] ima: No architecture policies found [ 4.533324] evm: Initialising EVM extended attributes: [ 4.538526] evm: security.selinux [ 4.541917] evm: security.SMACK64 [ 4.545299] evm: security.SMACK64EXEC [ 4.549026] evm: security.SMACK64TRANSMUTE [ 4.553189] evm: security.SMACK64MMAP [ 4.556914] evm: security.apparmor [ 4.560004] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.560380] evm: security.ima [ 4.568656] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.571707] evm: security.capability [ 4.571708] evm: HMAC attrs: 0x1 [ 4.571960] PM: Magic number: 4:270:50 [ 4.582815] hub 2-1:1.0: USB hub found [ 4.585866] platform platform-framebuffer.0: hash matches [ 4.593910] hub 2-1:1.0: 8 ports detected [ 4.599317] memory memory215: hash matches [ 4.607443] memory memory82: hash matches [ 4.611779] RAS: Correctable Errors collector initialized. [ 4.618306] Freeing unused decrypted memory: 2036K [ 4.623655] Freeing unused kernel image (initmem) memory: 3352K [ 4.643626] Write protecting the kernel read-only data: 30720k [ 4.649547] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 4.655794] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 4.665936] clocksource: Switched to clocksource tsc [ 4.671334] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.678248] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.723205] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.729711] x86/mm: Checking user space page tables [ 4.771429] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.777936] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.931557] dca service started, version 1.12.1 [ 4.943545] nvme nvme0: pci function 0000:02:00.0 [ 4.948585] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.948809] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.951269] nvme nvme0: 8/0/0 default/read/poll queues [ 4.956110] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.959798] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.964999] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.987677] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.988639] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.988893] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.988897] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.988899] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.988945] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.988947] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.988948] usb usb3: Product: xHCI Host Controller [ 4.988949] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 4.988951] usb usb3: SerialNumber: 0000:00:14.0 [ 4.989061] hub 3-0:1.0: USB hub found [ 4.989090] hub 3-0:1.0: 15 ports detected [ 4.992039] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 4.992042] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.992043] usb usb4: Product: xHCI Host Controller [ 4.992044] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 4.992045] usb usb4: SerialNumber: 0000:00:14.0 [ 4.992138] hub 4-0:1.0: USB hub found [ 4.992154] hub 4-0:1.0: 6 ports detected [ 4.993855] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.003298] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.070455] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.077614] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.082556] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.123911] scsi host0: ahci [ 5.137491] scsi host1: ahci [ 5.140536] scsi host2: ahci [ 5.143596] scsi host3: ahci [ 5.146590] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 5.154075] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 5.161593] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 5.169075] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 5.176756] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.184243] igb 0000:07:00.0: added PHC on eth0 [ 5.185024] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.189646] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.204238] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2c [ 5.211515] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.216717] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.256150] scsi host4: ahci [ 5.259237] scsi host5: ahci [ 5.262263] scsi host6: ahci [ 5.265335] scsi host7: ahci [ 5.268414] scsi host8: ahci [ 5.271488] scsi host9: ahci [ 5.274472] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.280148] igb 0000:07:00.1: added PHC on eth1 [ 5.281953] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.286590] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.294040] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.300998] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2d [ 5.308489] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.315779] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.323188] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.328391] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.335884] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.339577] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.490699] ata3: SATA link down (SStatus 0 SControl 300) [ 5.496184] ata4: SATA link down (SStatus 0 SControl 300) [ 5.501698] ata2: SATA link down (SStatus 0 SControl 300) [ 5.501834] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.507213] ata1: SATA link down (SStatus 0 SControl 300) [ 5.515542] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.528681] hub 3-12:1.0: USB hub found [ 5.532675] hub 3-12:1.0: 4 ports detected [ 5.670764] ata9: SATA link down (SStatus 0 SControl 300) [ 5.676273] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.682553] ata10: SATA link down (SStatus 0 SControl 300) [ 5.688132] ata6: SATA link down (SStatus 0 SControl 300) [ 5.693630] ata8: SATA link down (SStatus 0 SControl 300) [ 5.699136] ata7: SATA link down (SStatus 0 SControl 300) [ 5.790172] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.797057] ata5.00: NCQ Send/Recv Log not supported [ 5.802113] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.810705] ata5.00: NCQ Send/Recv Log not supported [ 5.815767] ata5.00: configured for UDMA/133 [ 5.820336] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.828835] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.828951] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.841997] sd 4:0:0:0: [sda] Write Protect is off [ 5.846867] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.847606] ache: enabled, rupport DPO or FU[ 5.892781] sda: sda1 [ 5.895455] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.902844] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.944166] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.979994] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.988530] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.004669] hid: raw HID events driver (C) Jiri Kosina [ 6.012468] usbcore: registered new interface driver usbhid [ 6.018129] usbhid: USB HID core driver [ 6.023564] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.091809] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.103785] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.115683] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.195922] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.206298] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.214902] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.221151] ixgbe 0000:03:00.0: 0c:c4:7a:88:7f:90 [ 6.228970] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.400103] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.410490] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.419101] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.426225] ixgbe 0000:03:00.1: 0c:c4:7a:88:7f:91 [ 6.434268] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.443444] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.467809] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 198143/61054976 files, 6507389/244190336 blocks done. [ 13.723791] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.603764] systemd[1]: Inserted module 'autofs4' [ 14.687346] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.739767] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.776618] systemd[1]: Hostname set to . [ 16.219988] systemd[1]: Queued start job for default target Graphical Interface. [ 16.228730] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.252050] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.275956] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.295780] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.315841] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.340056] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.367770] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.395731] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.423734] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.451713] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.479716] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.507723] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.535801] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.559755] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.579746] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.603856] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.627977] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.653834] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.675993] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.695938] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.719838] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.744152] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.763946] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.783994] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.804087] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.827997] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.847917] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.869423] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.889333] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.913184] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.937366] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.958715] systemd[1]: Mounting Kernel Trace File System... [ 16.962314] RPC: Registered named UNIX socket transport module. [ 16.970452] RPC: Registered udp transport module. [ 16.970453] RPC: Registered tcp transport module. [ 16.970454] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 17.003020] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.023870] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.035211] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.060751] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.084756] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.112547] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.136402] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.156364] systemd[1]: Starting Load Kernel Module drm... Starting Load [ 17.164221] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). Kernel Module drm... [ 17.184666] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.208516] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.228376] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.252335] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.276529] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.295634] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.305381] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.315800] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.336641] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.355114] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.364438] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.385347] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.429721] lp: driver loaded but no devices found [ OK ] Mounted NFSD configuration filesystem. [ 17.455502] Loading iSCSI transport class v2.0-870. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.723082] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed[ 17.808623] systemd-journald[368]: Received client request to flush runtime journal. ... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 17.971702] systemd-journald[368]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. Mounting RPC Pipe File System... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Listening on Docker Socket for the API. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Reached target RPC Port Mapper. [ OK ] Started ifup for enp3s0f1. Starting RPC Remote Quota Server... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started User Login Management. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for…k to be Configured (7s / no limit) M [** ] (1 of 2) A start job is running for…k to be Configured (8s / no limit) M [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. Starting containerd container runtime... Starting Network Time Service... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started Network Time Service. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Reached target Network is Online. Starting NFS Mount Daemon... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting Ubuntu FAN network setup... [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... + myips=172.21.15.172 + attempts=1 + sleep 1 [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started (i)SCSI target daemon. + '[' 172.21.15.172 '!=' '' ']' + set -e + '[' -n 172.21.15.172 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.172 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.172 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started The Apache HTTP Server. + newhostname=smithi172.front.sepia.ceph.com + '[' -n smithi172.front.sepia.ceph.com ']' + hostname smithi172.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi172 + echo smithi172 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.172 smithi172.front.sepia.ceph.com smithi172/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi172.front.sepia.ceph.com ttyS1 2024-04-25T23:02:05.885 DEBUG:teuthology.orchestra.console.smithi172:expect after: smithi172 login: 2024-04-25T23:02:05.939 DEBUG:teuthology.orchestra.console.smithi172:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.72 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 7F 91 GUID: 00000000 0000 0000 0000 0CC47AD9172C DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:7f:91)... Configuring (net0 0c:c4:7a:88:7f:91).... Configuring (net0 0c:c4:7a:88:7f:91)..... Configuring (net0 0c:c4:7a:88:7f:91)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.708 MHz processor [ 0.000414] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000595] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001901] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008120] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008136] Using GB pages for direct mapping [ 0.008272] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008278] ACPI: Early table checksum verification disabled [ 0.008281] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008285] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008290] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008295] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008298] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008300] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008303] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008306] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008309] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008312] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008314] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008317] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008320] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008323] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008326] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008328] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008331] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008334] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008337] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008340] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008342] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008345] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008348] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008350] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008352] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008353] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008354] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008355] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008356] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008357] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008358] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008359] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008360] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008361] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008362] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008363] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008364] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008365] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008366] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008367] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008368] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008369] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008370] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008371] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008465] No NUMA configuration found [ 0.008467] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008476] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008805] Zone ranges: [ 0.008806] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008808] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008810] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008811] Device empty [ 0.008812] Movable zone start for each node [ 0.008815] Early memory node ranges [ 0.008816] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008817] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008818] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008822] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008827] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008863] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080428] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080543] ACPI: PM-Timer IO Port: 0x408 [ 0.080551] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080552] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080553] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080554] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080555] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080556] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080557] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080558] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080567] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080571] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080574] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080575] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080579] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080580] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080584] TSC deadline timer available [ 0.080585] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080595] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080597] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080598] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080599] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080600] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080601] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080602] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080603] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080604] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080605] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080605] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080607] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080609] Booting paravirtualized kernel on bare hardware [ 0.080611] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080617] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080829] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080860] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.080861] Policy zone: Normal [ 0.080863] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.080922] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.083077] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084224] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084316] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170446] Memory: 32672716K/33438012K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765036K reserved, 0K cma-reserved) [ 0.170730] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170746] Kernel/User page tables isolation: enabled [ 0.170778] ftrace: allocating 50694 entries in 199 pages [ 0.190431] ftrace: allocated 199 pages with 5 groups [ 0.190551] rcu: Hierarchical RCU implementation. [ 0.190553] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190554] Rude variant of Tasks RCU enabled. [ 0.190555] Tracing variant of Tasks RCU enabled. [ 0.190555] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190556] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194218] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194418] random: crng init done [ 0.199296] Console: colour VGA+ 80x25 [ 0.210701] printk: console [tty0] enabled [ 1.197712] printk: console [ttyS1] enabled [ 1.201971] ACPI: Core revision 20210730 [ 1.206136] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.215362] APIC: Switch to symmetric I/O mode setup [ 1.220400] DMAR: Host address width 46 [ 1.224312] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.230790] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.238882] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.245222] DMAR: ATSR flags: 0x0 [ 1.248605] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.254946] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.261368] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.267792] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.273260] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.273260] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.288445] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.293822] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.300118] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.323370] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32723d995b0, max_idle_ns: 440795369662 ns [ 1.333985] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.41 BogoMIPS (lpj=13998832) [ 1.338000] CPU0: Thermal monitoring enabled (TM1) [ 1.342036] process: using mwait in idle threads [ 1.345984] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.349982] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.353984] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.357983] Spectre V2 : Mitigation: Retpolines [ 1.361982] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.365982] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.369982] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.373983] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.377983] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.381983] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.385986] MDS: Mitigation: Clear CPU buffers [ 1.389983] TAA: Mitigation: Clear CPU buffers [ 1.393982] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.397988] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.401982] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.405982] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.409983] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.413982] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.435673] Freeing SMP alternatives memory: 44K [ 1.437983] pid_max: default: 32768 minimum: 301 [ 1.442003] LSM: Security Framework initializing [ 1.445990] landlock: Up and running. [ 1.449983] Yama: becoming mindful. [ 1.454000] AppArmor: AppArmor initialized [ 1.458044] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.462023] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.466339] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.469988] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.474090] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.477984] ... version: 3 [ 1.481983] ... bit width: 48 [ 1.485983] ... generic registers: 4 [ 1.489983] ... value mask: 0000ffffffffffff [ 1.493983] ... max period: 00007fffffffffff [ 1.497983] ... fixed-purpose events: 3 [ 1.501983] ... event mask: 000000070000000f [ 1.506043] signal: max sigframe size: 1776 [ 1.509997] rcu: Hierarchical SRCU implementation. [ 1.514697] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.518046] smp: Bringing up secondary CPUs ... [ 1.522064] x86: Booting SMP configuration: [ 1.525985] .... node #0, CPUs: #1 #2 #3 #4 [ 1.534064] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.541983] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.545983] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.550081] #5 #6 #7 [ 1.550541] smp: Brought up 1 node, 8 CPUs [ 1.557985] smpboot: Max logical packages: 1 [ 1.561983] smpboot: Total of 8 processors activated (55995.32 BogoMIPS) [ 1.570325] devtmpfs: initialized [ 1.573399] x86/mm: Memory block size: 128MB [ 1.575584] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.578059] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.581993] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.586030] pinctrl core: initialized pinctrl subsystem [ 1.590073] PM: RTC time: 23:01:32, date: 2024-04-25 [ 1.594089] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.598325] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.602280] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.606317] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.609994] audit: initializing netlink subsys (disabled) [ 1.614001] audit: type=2000 audit(1714086090.356:1): state=initialized audit_enabled=0 res=1 [ 1.614100] thermal_sys: Registered thermal governor 'fair_share' [ 1.617984] thermal_sys: Registered thermal governor 'bang_bang' [ 1.621983] thermal_sys: Registered thermal governor 'step_wise' [ 1.625983] thermal_sys: Registered thermal governor 'user_space' [ 1.629983] thermal_sys: Registered thermal governor 'power_allocator' [ 1.633988] EISA bus registered [ 1.641191] cpuidle: using governor ladder [ 1.641985] cpuidle: using governor menu [ 1.645999] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.649984] ACPI: bus type PCI registered [ 1.653984] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.658037] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.661985] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.665996] PCI: Using configuration type 1 for base access [ 1.671009] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.673999] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.677984] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.682058] ACPI: Added _OSI(Module Device) [ 1.685985] ACPI: Added _OSI(Processor Device) [ 1.689990] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.693983] ACPI: Added _OSI(Processor Aggregator Device) [ 1.697983] ACPI: Added _OSI(Linux-Dell-Video) [ 1.701983] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.705983] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.756600] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.761318] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.766133] ACPI: Dynamic OEM Table Load: [ 1.797956] ACPI: Interpreter enabled [ 1.797994] ACPI: PM: (supports S0 S4 S5) [ 1.801983] ACPI: Using IOAPIC for interrupt routing [ 1.806005] HEST: Enabling Firmware First mode for corrected errors. [ 1.810062] HEST: Table parsing has been initialized. [ 1.814135] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.817985] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.821983] PCI: Using E820 reservations for host bridge windows [ 1.826678] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.863266] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.865986] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.871968] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.875037] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.877983] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.882015] PCI host bridge to bus 0000:ff [ 1.885984] pci_bus 0000:ff: root bus resource [bus ff] [ 1.889993] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.894050] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.898035] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.902035] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.906035] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.910037] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.914034] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.918034] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.922038] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.926033] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.930035] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.934033] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.938035] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.942035] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.946035] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.950035] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.954037] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.958033] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.962034] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.966008] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.970044] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.974085] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.978047] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.982046] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.986049] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.990047] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.994044] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.998038] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.002037] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.006049] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.010046] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.014048] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.018048] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.022036] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.026036] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.030036] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.034038] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.038047] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.042047] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.046048] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.050051] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.054040] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.058036] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.062038] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.066039] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.070036] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.074037] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.078036] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.082041] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.086037] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.090035] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.094035] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.098008] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.102036] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.106035] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114449] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.117986] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.122325] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.126457] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.129983] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.134275] PCI host bridge to bus 0000:00 [ 2.137984] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.141983] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.145983] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.149983] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.153983] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.157983] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.161983] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.166090] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.170194] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.174049] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.178155] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.182048] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.186149] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.190048] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.194143] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.198002] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.202178] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.206002] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.210175] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.214002] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.218176] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.222002] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.226174] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.230001] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.234178] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.238002] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.242174] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.246002] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.250175] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.254002] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.258128] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.262204] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.266131] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.270152] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.273997] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.278222] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.282275] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.286004] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.289994] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.293994] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.297994] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.301994] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.305994] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.310023] pci 0000:00:11.4: PME# supported from D3hot [ 2.314138] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.318009] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.322058] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.326131] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.330009] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.334059] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.338127] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.342009] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.346059] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.350141] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.354006] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.358087] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.362144] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.366072] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.370146] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.374075] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.378144] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.382074] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.386153] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.390006] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.394087] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.398140] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.402256] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.406002] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.409993] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.413993] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.417993] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.421993] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.425993] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.430016] pci 0000:00:1f.2: PME# supported from D3hot [ 2.434126] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.438008] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.442014] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.446198] acpiphp: Slot [1] registered [ 2.450000] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.454163] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.458003] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.462024] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.465986] pci 0000:02:00.0: enabling Extended Tags [ 2.470087] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.473985] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.478166] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.482005] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.485992] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.490005] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.493993] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.498023] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.502004] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.505983] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.509996] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.513983] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.518145] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.522004] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.525992] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.530005] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.533992] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.538023] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.542000] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.545983] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.549995] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.553983] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.558116] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.561984] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.565983] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.569984] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.574014] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.578049] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.582071] pci 0000:05:00.0: enabling Extended Tags [ 2.586060] pci 0000:05:00.0: supports D1 D2 [ 2.589983] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.594087] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.597985] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.601984] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.606031] pci_bus 0000:06: extended config space not accessible [ 2.610013] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.614016] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.618000] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.622000] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.626067] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.630024] pci 0000:06:00.0: supports D1 D2 [ 2.633983] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.638092] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.641989] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.645986] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.650084] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.654010] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.658011] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.661997] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.666117] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.670021] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.673983] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.678008] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.681983] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.686158] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.690010] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.694011] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.697997] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.702112] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.706020] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.709983] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.714008] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.717983] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.722138] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.725984] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.729984] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.733986] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.738896] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.742033] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.746031] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.750031] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.754032] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.757983] ACPI: PCI: Interrupt link LNKE disabled [ 2.762031] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.765983] ACPI: PCI: Interrupt link LNKF disabled [ 2.770031] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.773983] ACPI: PCI: Interrupt link LNKG disabled [ 2.778031] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.781983] ACPI: PCI: Interrupt link LNKH disabled [ 2.786171] iommu: Default domain type: Translated [ 2.789984] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.794110] SCSI subsystem initialized [ 2.797993] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.801982] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.801983] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.805983] vgaarb: loaded [ 2.808763] ACPI: bus type USB registered [ 2.809993] usbcore: registered new interface driver usbfs [ 2.813987] usbcore: registered new interface driver hub [ 2.817988] usbcore: registered new device driver usb [ 2.821998] pps_core: LinuxPPS API ver. 1 registered [ 2.825983] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.829986] PTP clock support registered [ 2.833997] EDAC MC: Ver: 3.0.0 [ 2.837293] NetLabel: Initializing [ 2.837984] NetLabel: domain hash size = 128 [ 2.841983] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.845994] NetLabel: unlabeled traffic allowed by default [ 2.849992] PCI: Using ACPI for IRQ routing [ 2.859210] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.861983] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.868022] clocksource: Switched to clocksource tsc-early [ 2.880250] VFS: Disk quotas dquot_6.6.0 [ 2.884255] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.891299] AppArmor: AppArmor Filesystem Enabled [ 2.896097] pnp: PnP ACPI init [ 2.899685] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.905673] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.911664] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.917651] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.923640] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.929630] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.935618] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.942301] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.948986] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.955669] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.962352] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.969034] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.975718] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.982609] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.988596] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.994585] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.000572] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.006554] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.013503] pnp: PnP ACPI: found 5 devices [ 3.023058] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.032058] NET: Registered PF_INET protocol family [ 3.037172] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.046463] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.055282] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.063281] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.071690] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.079228] TCP: Hash tables configured (established 262144 bind 65536) [ 3.086043] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.093827] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.100853] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.108309] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.114037] NET: Registered PF_XDP protocol family [ 3.118915] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.130487] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.138401] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.143447] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.148480] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.155348] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.162999] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.171002] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.178741] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.186829] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.194480] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.202483] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.210222] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.218310] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.225961] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.233963] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.241702] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.249790] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.257441] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.265444] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.273183] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.281270] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.286298] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.292459] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.299315] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.307151] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.312197] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.317226] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.323396] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.330264] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.335558] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.341726] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.348592] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.356422] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.364343] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.372178] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.380093] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.385127] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.391287] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.398143] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.413710] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.419954] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.426197] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.433139] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.440084] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.447024] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.453969] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.460303] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.465945] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.472283] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.479591] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.485230] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.491568] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.497209] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.503547] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.509187] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.515517] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.523032] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.551720] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20888 usecs [ 3.583715] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23918 usecs [ 3.591215] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.597766] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.597772] Trying to unpack rootfs image as initramfs... [ 3.604273] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.618235] Initialise system trusted keyrings [ 3.622758] Key type blacklist registered [ 3.626877] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.634351] zbud: loaded [ 3.637155] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.643220] fuse: init (API version 7.34) [ 3.647448] integrity: Platform Keyring initialized [ 3.660297] Key type asymmetric registered [ 3.664470] Asymmetric key parser 'x509' registered [ 3.669440] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.676967] io scheduler mq-deadline registered [ 3.681972] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.688016] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.694044] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.700013] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.705997] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.711957] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.717928] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.724839] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.730617] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.739084] ACPI: button: Power Button [PWRB] [ 3.743542] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.751062] ACPI: button: Power Button [PWRF] [ 3.756716] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.764294] pstore: Registered erst as persistent store backend [ 3.770415] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.797347] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.826282] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.835908] Linux agpgart interface v0.103 [ 3.841800] loop: module loaded [ 3.845238] tun: Universal TUN/TAP device driver, 1.6 [ 3.850380] PPP generic driver version 2.4.2 [ 3.854769] VFIO - User Level meta-driver version: 0.3 [ 3.860099] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.866700] ehci-pci: EHCI PCI platform driver [ 3.871377] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.876674] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.884171] ehci-pci 0000:00:1a.0: debug port 2 [ 3.892681] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.911605] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.917468] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.925825] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.933137] usb usb1: Product: EHCI Host Controller [ 3.938087] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.944603] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.949437] hub 1-0:1.0: USB hub found [ 3.951702] Freeing initrd memory: 65088K [ 3.953264] hub 1-0:1.0: 2 ports detected [ 3.961676] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.966972] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.974463] ehci-pci 0000:00:1d.0: debug port 2 [ 3.982948] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.003615] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.009463] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.017820] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.025122] usb usb2: Product: EHCI Host Controller [ 4.030065] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.036571] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.041369] hub 2-0:1.0: USB hub found [ 4.045182] hub 2-0:1.0: 2 ports detected [ 4.049372] ehci-platform: EHCI generic platform driver [ 4.054680] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.060928] ohci-pci: OHCI PCI platform driver [ 4.065456] ohci-platform: OHCI generic platform driver [ 4.070748] uhci_hcd: USB Universal Host Controller Interface driver [ 4.077218] i8042: PNP: No PS/2 controller found. [ 4.082049] mousedev: PS/2 mouse device common for all mice [ 4.087762] rtc_cmos 00:00: RTC can wake from S4 [ 4.092664] rtc_cmos 00:00: registered as rtc0 [ 4.097199] rtc_cmos 00:00: setting system clock to 2024-04-25T23:01:35 UTC (1714086095) [ 4.105406] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.112184] i2c_dev: i2c /dev entries driver [ 4.116687] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.128969] device-mapper: uevent: version 1.0.3 [ 4.133717] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.142260] platform eisa.0: Probing EISA bus 0 [ 4.146853] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.153707] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.160212] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.166723] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.173232] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.179740] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.186251] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.192761] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.199268] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.205779] platform eisa.0: EISA: Detected 0 cards [ 4.210729] intel_pstate: Intel P-state driver initializing [ 4.217433] ledtrig-cpu: registered to indicate activity on CPUs [ 4.223660] drop_monitor: Initializing network drop monitor service [ 4.230115] NET: Registered PF_INET6 protocol family [ 4.242573] Segment Routing with IPv6 [ 4.246328] In-situ OAM (IOAM) with IPv6 [ 4.250349] NET: Registered PF_PACKET protocol family [ 4.255625] Key type dns_resolver registered [ 4.260494] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.266478] microcode: Microcode Update Driver: v2.2. [ 4.266552] resctrl: L3 allocation detected [ 4.275935] resctrl: L3 monitoring detected [ 4.280188] IPI shorthand broadcast: enabled [ 4.284531] sched_clock: Marking stable (3220946687, 1063570617)->(5273935093, -989417789) [ 4.293139] registered taskstats version 1 [ 4.295607] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.304035] Loading compiled-in X.509 certificates [ 4.309523] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.319992] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.330235] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.340327] blacklist: Loading compiled-in revocation X.509 certificates [ 4.347109] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.357030] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.367560] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.378439] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.383613] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.388990] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.406387] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.417176] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.427982] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.439799] zswap: loaded using pool lzo/zbud [ 4.444543] Key type .fscrypt registered [ 4.448536] Key type fscrypt-provisioning registered [ 4.453619] pstore: Using crash dump compression: deflate [ 4.462227] Key type encrypted registered [ 4.464124] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.466306] AppArmor: AppArmor sha1 policy hashing enabled [ 4.482338] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.487940] ima: No TPM chip found, activating TPM-bypass! [ 4.500701] Loading compiled-in module X.509 certificates [ 4.500935] hub 1-1:1.0: USB hub found [ 4.506641] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.520015] ima: Allocated hash algorithm: sha1 [ 4.520278] hub 1-1:1.0: 6 ports detected [ 4.524633] ima: No architecture policies found [ 4.533324] evm: Initialising EVM extended attributes: [ 4.538526] evm: security.selinux [ 4.541917] evm: security.SMACK64 [ 4.545299] evm: security.SMACK64EXEC [ 4.549026] evm: security.SMACK64TRANSMUTE [ 4.553189] evm: security.SMACK64MMAP [ 4.556914] evm: security.apparmor [ 4.560004] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.560380] evm: security.ima [ 4.568656] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.571707] evm: security.capability [ 4.571708] evm: HMAC attrs: 0x1 [ 4.571960] PM: Magic number: 4:270:50 [ 4.582815] hub 2-1:1.0: USB hub found [ 4.585866] platform platform-framebuffer.0: hash matches [ 4.593910] hub 2-1:1.0: 8 ports detected [ 4.599317] memory memory215: hash matches [ 4.607443] memory memory82: hash matches [ 4.611779] RAS: Correctable Errors collector initialized. [ 4.618306] Freeing unused decrypted memory: 2036K [ 4.623655] Freeing unused kernel image (initmem) memory: 3352K [ 4.643626] Write protecting the kernel read-only data: 30720k [ 4.649547] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 4.655794] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 4.665936] clocksource: Switched to clocksource tsc [ 4.671334] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.678248] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.723205] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.729711] x86/mm: Checking user space page tables [ 4.771429] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.777936] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.931557] dca service started, version 1.12.1 [ 4.943545] nvme nvme0: pci function 0000:02:00.0 [ 4.948585] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.948809] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.951269] nvme nvme0: 8/0/0 default/read/poll queues [ 4.956110] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.959798] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.964999] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.987677] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.988639] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.988893] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.988897] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.988899] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.988945] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.988947] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.988948] usb usb3: Product: xHCI Host Controller [ 4.988949] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 4.988951] usb usb3: SerialNumber: 0000:00:14.0 [ 4.989061] hub 3-0:1.0: USB hub found [ 4.989090] hub 3-0:1.0: 15 ports detected [ 4.992039] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 4.992042] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.992043] usb usb4: Product: xHCI Host Controller [ 4.992044] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 4.992045] usb usb4: SerialNumber: 0000:00:14.0 [ 4.992138] hub 4-0:1.0: USB hub found [ 4.992154] hub 4-0:1.0: 6 ports detected [ 4.993855] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.003298] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.070455] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.077614] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.082556] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.123911] scsi host0: ahci [ 5.137491] scsi host1: ahci [ 5.140536] scsi host2: ahci [ 5.143596] scsi host3: ahci [ 5.146590] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 5.154075] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 5.161593] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 5.169075] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 5.176756] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.184243] igb 0000:07:00.0: added PHC on eth0 [ 5.185024] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.189646] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.204238] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2c [ 5.211515] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.216717] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.256150] scsi host4: ahci [ 5.259237] scsi host5: ahci [ 5.262263] scsi host6: ahci [ 5.265335] scsi host7: ahci [ 5.268414] scsi host8: ahci [ 5.271488] scsi host9: ahci [ 5.274472] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.280148] igb 0000:07:00.1: added PHC on eth1 [ 5.281953] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.286590] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.294040] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.300998] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2d [ 5.308489] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.315779] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.323188] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.328391] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.335884] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.339577] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.490699] ata3: SATA link down (SStatus 0 SControl 300) [ 5.496184] ata4: SATA link down (SStatus 0 SControl 300) [ 5.501698] ata2: SATA link down (SStatus 0 SControl 300) [ 5.501834] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.507213] ata1: SATA link down (SStatus 0 SControl 300) [ 5.515542] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.528681] hub 3-12:1.0: USB hub found [ 5.532675] hub 3-12:1.0: 4 ports detected [ 5.670764] ata9: SATA link down (SStatus 0 SControl 300) [ 5.676273] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.682553] ata10: SATA link down (SStatus 0 SControl 300) [ 5.688132] ata6: SATA link down (SStatus 0 SControl 300) [ 5.693630] ata8: SATA link down (SStatus 0 SControl 300) [ 5.699136] ata7: SATA link down (SStatus 0 SControl 300) [ 5.790172] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.797057] ata5.00: NCQ Send/Recv Log not supported [ 5.802113] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.810705] ata5.00: NCQ Send/Recv Log not supported [ 5.815767] ata5.00: configured for UDMA/133 [ 5.820336] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.828835] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.828951] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.841997] sd 4:0:0:0: [sda] Write Protect is off [ 5.846867] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.847606] ache: enabled, rupport DPO or FU[ 5.892781] sda: sda1 [ 5.895455] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.902844] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.944166] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.979994] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.988530] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.004669] hid: raw HID events driver (C) Jiri Kosina [ 6.012468] usbcore: registered new interface driver usbhid [ 6.018129] usbhid: USB HID core driver [ 6.023564] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.091809] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.103785] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.115683] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.195922] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.206298] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.214902] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.221151] ixgbe 0000:03:00.0: 0c:c4:7a:88:7f:90 [ 6.228970] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.400103] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.410490] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.419101] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.426225] ixgbe 0000:03:00.1: 0c:c4:7a:88:7f:91 [ 6.434268] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.443444] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.467809] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 198143/61054976 files, 6507389/244190336 blocks done. [ 13.723791] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.603764] systemd[1]: Inserted module 'autofs4' [ 14.687346] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.739767] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.776618] systemd[1]: Hostname set to . [ 16.219988] systemd[1]: Queued start job for default target Graphical Interface. [ 16.228730] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.252050] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.275956] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.295780] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.315841] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.340056] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.367770] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.395731] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.423734] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.451713] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.479716] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.507723] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.535801] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.559755] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.579746] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.603856] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.627977] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.653834] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.675993] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.695938] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.719838] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.744152] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.763946] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.783994] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.804087] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.827997] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.847917] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.869423] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.889333] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.913184] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.937366] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.958715] systemd[1]: Mounting Kernel Trace File System... [ 16.962314] RPC: Registered named UNIX socket transport module. [ 16.970452] RPC: Registered udp transport module. [ 16.970453] RPC: Registered tcp transport module. [ 16.970454] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 17.003020] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.023870] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.035211] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.060751] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.084756] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.112547] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.136402] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.156364] systemd[1]: Starting Load Kernel Module drm... Starting Load [ 17.164221] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). Kernel Module drm... [ 17.184666] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.208516] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.228376] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.252335] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.276529] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.295634] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.305381] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.315800] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.336641] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.355114] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.364438] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.385347] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.429721] lp: driver loaded but no devices found [ OK ] Mounted NFSD configuration filesystem. [ 17.455502] Loading iSCSI transport class v2.0-870. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.723082] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed[ 17.808623] systemd-journald[368]: Received client request to flush runtime journal. ... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 17.971702] systemd-journald[368]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. Mounting RPC Pipe File System... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Listening on Docker Socket for the API. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Reached target RPC Port Mapper. [ OK ] Started ifup for enp3s0f1. Starting RPC Remote Quota Server... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started User Login Management. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for…k to be Configured (7s / no limit) M [** ] (1 of 2) A start job is running for…k to be Configured (8s / no limit) M [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. Starting containerd container runtime... Starting Network Time Service... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started Network Time Service. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Reached target Network is Online. Starting NFS Mount Daemon... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting Ubuntu FAN network setup... [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... + myips=172.21.15.172 + attempts=1 + sleep 1 [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started (i)SCSI target daemon. + '[' 172.21.15.172 '!=' '' ']' + set -e + '[' -n 172.21.15.172 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.172 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.172 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started The Apache HTTP Server. + newhostname=smithi172.front.sepia.ceph.com + '[' -n smithi172.front.sepia.ceph.com ']' + hostname smithi172.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi172 + echo smithi172 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.172 smithi172.front.sepia.ceph.com smithi172/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi172.front.sepia.ceph.com ttyS1 smithi172 login: [disconnect] 2024-04-25T23:02:06.041 INFO:teuthology.misc:Re-opening connections... 2024-04-25T23:02:06.041 INFO:teuthology.misc:trying to connect to ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T23:02:06.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T23:02:06.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:02:06.314 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-25T23:02:06.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2024-04-25T23:02:06.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T23:02:06.793 DEBUG:teuthology.misc:waited 0.7521371841430664 2024-04-25T23:02:07.793 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T23:02:07.794 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi172.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-04-25T23:02:07.794 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-25T23:02:07.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T23:02:07.918 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T23:02:07.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T23:02:07.961 INFO:tasks.ceph.osd.2:Started 2024-04-25T23:02:07.961 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T23:02:08.096 INFO:teuthology.orchestra.run.smithi172.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-25T23:02:08.099 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T23:02:08.099 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-25T23:02:09.006 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T23:02:08.912+0000 7fcbbf54b7c0 -1 Falling back to public interface 2024-04-25T23:02:12.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-25T23:02:12.980 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T23:02:12.888+0000 7fcbbf54b7c0 -1 osd.2 21 log_to_monitors true 2024-04-25T23:02:13.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T23:02:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2024-04-25T23:02:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:0 2024-04-25T23:02:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:1 2024-04-25T23:02:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:2 2024-04-25T23:02:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:abort 2024-04-25T23:02:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:assert 2024-04-25T23:02:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:bluefs debug_inject_read_zeros 2024-04-25T23:02:13.225 INFO:teuthology.orchestra.run.smithi172.stderr:bluefs files list 2024-04-25T23:02:13.225 INFO:teuthology.orchestra.run.smithi172.stderr:bluefs stats 2024-04-25T23:02:13.225 INFO:teuthology.orchestra.run.smithi172.stderr:bluestore allocator dump block 2024-04-25T23:02:13.225 INFO:teuthology.orchestra.run.smithi172.stderr:bluestore allocator fragmentation block 2024-04-25T23:02:13.225 INFO:teuthology.orchestra.run.smithi172.stderr:admin_socket: invalid command 2024-04-25T23:02:13.227 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T23:02:13.227 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-25T23:02:13.736 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T23:02:13.644+0000 7fcbb3329640 -1 osd.2 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T23:02:18.228 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T23:02:18.371 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T23:02:18.371 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-25T23:02:18.371 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-25T23:02:18.371 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T23:02:23.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-25T23:02:23.533 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a: {} 2024-04-25T23:02:23.533 INFO:teuthology.orchestra.run.smithi043.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T23:02:23.542 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b: {} 2024-04-25T23:02:23.542 INFO:teuthology.orchestra.run.smithi043.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T23:02:23.551 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c: {} 2024-04-25T23:02:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T23:02:23.568 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T23:02:24.192 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T23:02:24.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-25T23:02:25.157 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-25T23:02:25.185 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T23:02:26.160 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T23:02:26.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-25T23:02:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-25T23:02:27.197 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T23:02:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T23:02:28.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-25T23:02:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-25T23:02:29.202 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-25T23:02:29.202 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-25T23:02:29.202 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-25T23:02:29.202 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-25T23:02:29.202 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T23:02:29.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:02:29.518 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T23:02:29.165313+0000","last_up_change":"2024-04-25T23:02:14.651926+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":21,"up_from":69,"up_thru":83,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6801","nonce":805033024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6803","nonce":805033024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6807","nonce":805033024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6805","nonce":805033024}]},"public_addr":"172.21.15.172:6801/805033024","cluster_addr":"172.21.15.172:6803/805033024","heartbeat_back_addr":"172.21.15.172:6807/805033024","heartbeat_front_addr":"172.21.15.172:6805/805033024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":21}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.5","osds":[0]},{"pgid":"4.6","osds":[1]},{"pgid":"4.7","osds":[1]},{"pgid":"4.d","osds":[0]},{"pgid":"4.f","osds":[1]},{"pgid":"4.10","osds":[1]},{"pgid":"4.1d","osds":[0]},{"pgid":"4.24","osds":[0]},{"pgid":"4.25","osds":[0]},{"pgid":"4.27","osds":[0]},{"pgid":"4.28","osds":[1]},{"pgid":"4.2a","osds":[0]},{"pgid":"4.2e","osds":[1]},{"pgid":"4.2f","osds":[1]},{"pgid":"4.33","osds":[1]},{"pgid":"4.36","osds":[1]},{"pgid":"4.37","osds":[1]},{"pgid":"4.3d","osds":[0]},{"pgid":"4.3e","osds":[1]},{"pgid":"4.3f","osds":[1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:02:29.537 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T23:02:29.537 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:02:29.831 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:29.831 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T23:02:29.165313+0000","last_up_change":"2024-04-25T23:02:14.651926+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":21,"up_from":69,"up_thru":83,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6801","nonce":805033024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6803","nonce":805033024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6807","nonce":805033024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6805","nonce":805033024}]},"public_addr":"172.21.15.172:6801/805033024","cluster_addr":"172.21.15.172:6803/805033024","heartbeat_back_addr":"172.21.15.172:6807/805033024","heartbeat_front_addr":"172.21.15.172:6805/805033024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":21}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.5","osds":[0]},{"pgid":"4.6","osds":[1]},{"pgid":"4.7","osds":[1]},{"pgid":"4.d","osds":[0]},{"pgid":"4.f","osds":[1]},{"pgid":"4.10","osds":[1]},{"pgid":"4.1d","osds":[0]},{"pgid":"4.24","osds":[0]},{"pgid":"4.25","osds":[0]},{"pgid":"4.27","osds":[0]},{"pgid":"4.28","osds":[1]},{"pgid":"4.2a","osds":[0]},{"pgid":"4.2e","osds":[1]},{"pgid":"4.2f","osds":[1]},{"pgid":"4.33","osds":[1]},{"pgid":"4.36","osds":[1]},{"pgid":"4.37","osds":[1]},{"pgid":"4.3d","osds":[0]},{"pgid":"4.3e","osds":[1]},{"pgid":"4.3f","osds":[1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:02:29.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T23:02:29.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T23:02:29.850 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T23:02:30.004 INFO:teuthology.orchestra.run.smithi043.stdout:34359738416 2024-04-25T23:02:30.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T23:02:30.017 INFO:teuthology.orchestra.run.smithi043.stdout:296352743429 2024-04-25T23:02:30.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T23:02:30.027 INFO:teuthology.orchestra.run.smithi043.stdout:34359738416 2024-04-25T23:02:30.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T23:02:30.326 INFO:teuthology.orchestra.run.smithi043.stdout:34359738415 2024-04-25T23:02:30.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738415 for osd.0 2024-04-25T23:02:30.376 INFO:teuthology.orchestra.run.smithi043.stdout:296352743427 2024-04-25T23:02:30.383 INFO:teuthology.orchestra.run.smithi043.stdout:34359738415 2024-04-25T23:02:30.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 296352743429 got 296352743427 for osd.2 2024-04-25T23:02:30.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738415 for osd.1 2024-04-25T23:02:31.352 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T23:02:31.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T23:02:31.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T23:02:31.678 INFO:teuthology.orchestra.run.smithi043.stdout:34359738416 2024-04-25T23:02:31.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738416 for osd.0 2024-04-25T23:02:31.697 DEBUG:teuthology.parallel:result is None 2024-04-25T23:02:31.724 INFO:teuthology.orchestra.run.smithi043.stdout:296352743429 2024-04-25T23:02:31.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 296352743429 got 296352743429 for osd.2 2024-04-25T23:02:31.743 DEBUG:teuthology.parallel:result is None 2024-04-25T23:02:31.753 INFO:teuthology.orchestra.run.smithi043.stdout:34359738416 2024-04-25T23:02:31.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738416 for osd.1 2024-04-25T23:02:31.771 DEBUG:teuthology.parallel:result is None 2024-04-25T23:02:31.771 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T23:02:31.772 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:32.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:32.129 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:32.146 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-04-25T23:02:31.161842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3033,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4432,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":468096,"kb_used_data":253400,"kb_used_omap":8,"kb_used_meta":214647,"kb_avail":282647424,"statfs":{"total":289910292480,"available":289430962176,"internally_reserved":0,"allocated":259481600,"data_stored":258190415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":219798549},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1949,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2071,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.998102"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":626,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165785+0000","last_change":"2024-04-25T23:02:16.336211+0000","last_active":"2024-04-25T23:02:30.165785+0000","last_peered":"2024-04-25T23:02:30.165785+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329824+0000","last_became_peered":"2024-04-25T23:02:16.329824+0000","last_unstale":"2024-04-25T23:02:30.165785+0000","last_undegraded":"2024-04-25T23:02:16.203747+0000","last_fullsized":"2024-04-25T23:02:16.195496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":613,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166060+0000","last_change":"2024-04-25T23:02:16.328918+0000","last_active":"2024-04-25T23:02:30.166060+0000","last_peered":"2024-04-25T23:02:30.166060+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.323624+0000","last_became_peered":"2024-04-25T23:02:16.323624+0000","last_unstale":"2024-04-25T23:02:30.166060+0000","last_undegraded":"2024-04-25T23:02:16.206461+0000","last_fullsized":"2024-04-25T23:02:16.185275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":542,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164829+0000","last_change":"2024-04-25T23:02:16.342187+0000","last_active":"2024-04-25T23:02:30.164829+0000","last_peered":"2024-04-25T23:02:30.164829+0000","last_clean":"2024-04-25T22:59:33.271539+0000","last_became_active":"2024-04-25T23:02:16.330924+0000","last_became_peered":"2024-04-25T23:02:16.330924+0000","last_unstale":"2024-04-25T23:02:30.164829+0000","last_undegraded":"2024-04-25T23:02:16.197400+0000","last_fullsized":"2024-04-25T23:02:16.191428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164401+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:30.164401+0000","last_peered":"2024-04-25T23:02:30.164401+0000","last_clean":"2024-04-25T23:02:30.164401+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:30.164401+0000","last_undegraded":"2024-04-25T23:02:30.164401+0000","last_fullsized":"2024-04-25T23:02:30.164401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":626,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083679+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:29.083679+0000","last_peered":"2024-04-25T23:02:29.083679+0000","last_clean":"2024-04-25T23:02:29.083679+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:29.083679+0000","last_undegraded":"2024-04-25T23:02:29.083679+0000","last_fullsized":"2024-04-25T23:02:29.083679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163971+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:30.163971+0000","last_peered":"2024-04-25T23:02:30.163971+0000","last_clean":"2024-04-25T23:02:30.163971+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:30.163971+0000","last_undegraded":"2024-04-25T23:02:30.163971+0000","last_fullsized":"2024-04-25T23:02:30.163971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163333+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:30.163333+0000","last_peered":"2024-04-25T23:02:30.163333+0000","last_clean":"2024-04-25T23:02:30.163333+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:30.163333+0000","last_undegraded":"2024-04-25T23:02:30.163333+0000","last_fullsized":"2024-04-25T23:02:30.163333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":560,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163208+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:30.163208+0000","last_peered":"2024-04-25T23:02:30.163208+0000","last_clean":"2024-04-25T23:02:30.163208+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:30.163208+0000","last_undegraded":"2024-04-25T23:02:30.163208+0000","last_fullsized":"2024-04-25T23:02:30.163208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":551,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164737+0000","last_change":"2024-04-25T23:02:16.335542+0000","last_active":"2024-04-25T23:02:30.164737+0000","last_peered":"2024-04-25T23:02:30.164737+0000","last_clean":"2024-04-25T22:59:32.892759+0000","last_became_active":"2024-04-25T23:02:16.324506+0000","last_became_peered":"2024-04-25T23:02:16.324506+0000","last_unstale":"2024-04-25T23:02:30.164737+0000","last_undegraded":"2024-04-25T23:02:16.192548+0000","last_fullsized":"2024-04-25T23:02:16.163168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":824,"reported_epoch":85,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T23:02:30.665072+0000","last_change":"2024-04-25T23:02:30.226995+0000","last_active":"2024-04-25T23:02:30.665072+0000","last_peered":"2024-04-25T23:02:30.665072+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.318360+0000","last_became_peered":"2024-04-25T23:02:16.318360+0000","last_unstale":"2024-04-25T23:02:30.665072+0000","last_undegraded":"2024-04-25T23:02:30.665072+0000","last_fullsized":"2024-04-25T23:02:16.165027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":574,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165692+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:30.165692+0000","last_peered":"2024-04-25T23:02:30.165692+0000","last_clean":"2024-04-25T23:02:30.165692+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:30.165692+0000","last_undegraded":"2024-04-25T23:02:30.165692+0000","last_fullsized":"2024-04-25T23:02:30.165692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085166+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:29.085166+0000","last_peered":"2024-04-25T23:02:29.085166+0000","last_clean":"2024-04-25T23:02:29.085166+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:29.085166+0000","last_undegraded":"2024-04-25T23:02:29.085166+0000","last_fullsized":"2024-04-25T23:02:29.085166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":509,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163262+0000","last_change":"2024-04-25T23:02:16.889283+0000","last_active":"2024-04-25T23:02:30.163262+0000","last_peered":"2024-04-25T23:02:30.163262+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.264824+0000","last_became_peered":"2024-04-25T23:02:16.264824+0000","last_unstale":"2024-04-25T23:02:30.163262+0000","last_undegraded":"2024-04-25T23:02:16.888989+0000","last_fullsized":"2024-04-25T23:02:16.163698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1006,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164294+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:30.164294+0000","last_peered":"2024-04-25T23:02:30.164294+0000","last_clean":"2024-04-25T23:02:30.164294+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:30.164294+0000","last_undegraded":"2024-04-25T23:02:30.164294+0000","last_fullsized":"2024-04-25T23:02:30.164294+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":954,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163351+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:30.163351+0000","last_peered":"2024-04-25T23:02:30.163351+0000","last_clean":"2024-04-25T23:02:30.163351+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:30.163351+0000","last_undegraded":"2024-04-25T23:02:30.163351+0000","last_fullsized":"2024-04-25T23:02:30.163351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":605,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163394+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:30.163394+0000","last_peered":"2024-04-25T23:02:30.163394+0000","last_clean":"2024-04-25T23:02:30.163394+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:30.163394+0000","last_undegraded":"2024-04-25T23:02:30.163394+0000","last_fullsized":"2024-04-25T23:02:30.163394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":665,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166129+0000","last_change":"2024-04-25T23:02:16.339646+0000","last_active":"2024-04-25T23:02:30.166129+0000","last_peered":"2024-04-25T23:02:30.166129+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:30.166129+0000","last_undegraded":"2024-04-25T23:02:16.208021+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":605,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166890+0000","last_change":"2024-04-25T23:02:16.326630+0000","last_active":"2024-04-25T23:02:30.166890+0000","last_peered":"2024-04-25T23:02:30.166890+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.321704+0000","last_became_peered":"2024-04-25T23:02:16.321704+0000","last_unstale":"2024-04-25T23:02:30.166890+0000","last_undegraded":"2024-04-25T23:02:16.201718+0000","last_fullsized":"2024-04-25T23:02:16.189024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1083,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164823+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:30.164823+0000","last_peered":"2024-04-25T23:02:30.164823+0000","last_clean":"2024-04-25T23:02:30.164823+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:30.164823+0000","last_undegraded":"2024-04-25T23:02:30.164823+0000","last_fullsized":"2024-04-25T23:02:30.164823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":576,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164687+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:30.164687+0000","last_peered":"2024-04-25T23:02:30.164687+0000","last_clean":"2024-04-25T23:02:30.164687+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:30.164687+0000","last_undegraded":"2024-04-25T23:02:30.164687+0000","last_fullsized":"2024-04-25T23:02:30.164687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":619,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164498+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:30.164498+0000","last_peered":"2024-04-25T23:02:30.164498+0000","last_clean":"2024-04-25T23:02:30.164498+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:30.164498+0000","last_undegraded":"2024-04-25T23:02:30.164498+0000","last_fullsized":"2024-04-25T23:02:30.164498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":1060,"reported_epoch":85,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:30.222658+0000","last_change":"2024-04-25T23:02:30.223078+0000","last_active":"2024-04-25T23:02:30.222658+0000","last_peered":"2024-04-25T23:02:30.222658+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.335323+0000","last_became_peered":"2024-04-25T23:02:16.335323+0000","last_unstale":"2024-04-25T23:02:30.222658+0000","last_undegraded":"2024-04-25T23:02:30.222658+0000","last_fullsized":"2024-04-25T23:02:16.174423+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":557,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162671+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:30.162671+0000","last_peered":"2024-04-25T23:02:30.162671+0000","last_clean":"2024-04-25T23:02:30.162671+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:30.162671+0000","last_undegraded":"2024-04-25T23:02:30.162671+0000","last_fullsized":"2024-04-25T23:02:30.162671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":655,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.162911+0000","last_change":"2024-04-25T23:02:16.326683+0000","last_active":"2024-04-25T23:02:30.162911+0000","last_peered":"2024-04-25T23:02:30.162911+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.320738+0000","last_became_peered":"2024-04-25T23:02:16.320738+0000","last_unstale":"2024-04-25T23:02:30.162911+0000","last_undegraded":"2024-04-25T23:02:16.182673+0000","last_fullsized":"2024-04-25T23:02:16.162015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":629,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165365+0000","last_change":"2024-04-25T23:02:16.341114+0000","last_active":"2024-04-25T23:02:30.165365+0000","last_peered":"2024-04-25T23:02:30.165365+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.332838+0000","last_became_peered":"2024-04-25T23:02:16.332838+0000","last_unstale":"2024-04-25T23:02:30.165365+0000","last_undegraded":"2024-04-25T23:02:16.188689+0000","last_fullsized":"2024-04-25T23:02:16.167898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":638,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166608+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:30.166608+0000","last_peered":"2024-04-25T23:02:30.166608+0000","last_clean":"2024-04-25T23:02:30.166608+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:30.166608+0000","last_undegraded":"2024-04-25T23:02:30.166608+0000","last_fullsized":"2024-04-25T23:02:30.166608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":577,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165975+0000","last_change":"2024-04-25T23:02:16.343238+0000","last_active":"2024-04-25T23:02:30.165975+0000","last_peered":"2024-04-25T23:02:30.165975+0000","last_clean":"2024-04-25T22:59:33.272585+0000","last_became_active":"2024-04-25T23:02:16.337943+0000","last_became_peered":"2024-04-25T23:02:16.337943+0000","last_unstale":"2024-04-25T23:02:30.165975+0000","last_undegraded":"2024-04-25T23:02:16.196378+0000","last_fullsized":"2024-04-25T23:02:16.191698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":592,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163913+0000","last_change":"2024-04-25T23:02:16.857958+0000","last_active":"2024-04-25T23:02:30.163913+0000","last_peered":"2024-04-25T23:02:30.163913+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.316513+0000","last_became_peered":"2024-04-25T23:02:16.316513+0000","last_unstale":"2024-04-25T23:02:30.163913+0000","last_undegraded":"2024-04-25T23:02:16.857683+0000","last_fullsized":"2024-04-25T23:02:16.165883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163758+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:30.163758+0000","last_peered":"2024-04-25T23:02:30.163758+0000","last_clean":"2024-04-25T23:02:30.163758+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:30.163758+0000","last_undegraded":"2024-04-25T23:02:30.163758+0000","last_fullsized":"2024-04-25T23:02:30.163758+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":599,"reported_epoch":84,"state":"peering","last_fresh":"2024-04-25T23:02:28.918197+0000","last_change":"2024-04-25T23:02:29.909540+0000","last_active":"2024-04-25T23:02:29.909540+0000","last_peered":"2024-04-25T23:02:28.918197+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.330883+0000","last_became_peered":"2024-04-25T23:02:16.330883+0000","last_unstale":"2024-04-25T23:02:28.918197+0000","last_undegraded":"2024-04-25T23:02:28.918197+0000","last_fullsized":"2024-04-25T23:02:16.165409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1016,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162848+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:30.162848+0000","last_peered":"2024-04-25T23:02:30.162848+0000","last_clean":"2024-04-25T23:02:30.162848+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:30.162848+0000","last_undegraded":"2024-04-25T23:02:30.162848+0000","last_fullsized":"2024-04-25T23:02:30.162848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165462+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:30.165462+0000","last_peered":"2024-04-25T23:02:30.165462+0000","last_clean":"2024-04-25T23:02:30.165462+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:30.165462+0000","last_undegraded":"2024-04-25T23:02:30.165462+0000","last_fullsized":"2024-04-25T23:02:30.165462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084056+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:29.084056+0000","last_peered":"2024-04-25T23:02:29.084056+0000","last_clean":"2024-04-25T23:02:29.084056+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:29.084056+0000","last_undegraded":"2024-04-25T23:02:29.084056+0000","last_fullsized":"2024-04-25T23:02:29.084056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":694,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164822+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:30.164822+0000","last_peered":"2024-04-25T23:02:30.164822+0000","last_clean":"2024-04-25T23:02:30.164822+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:30.164822+0000","last_undegraded":"2024-04-25T23:02:30.164822+0000","last_fullsized":"2024-04-25T23:02:30.164822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":552,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084521+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:29.084521+0000","last_peered":"2024-04-25T23:02:29.084521+0000","last_clean":"2024-04-25T23:02:29.084521+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:29.084521+0000","last_undegraded":"2024-04-25T23:02:29.084521+0000","last_fullsized":"2024-04-25T23:02:29.084521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":194,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163444+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:30.163444+0000","last_peered":"2024-04-25T23:02:30.163444+0000","last_clean":"2024-04-25T23:02:30.163444+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:30.163444+0000","last_undegraded":"2024-04-25T23:02:30.163444+0000","last_fullsized":"2024-04-25T23:02:30.163444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":646,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167353+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:30.167353+0000","last_peered":"2024-04-25T23:02:30.167353+0000","last_clean":"2024-04-25T23:02:30.167353+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:30.167353+0000","last_undegraded":"2024-04-25T23:02:30.167353+0000","last_fullsized":"2024-04-25T23:02:30.167353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083450+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:29.083450+0000","last_peered":"2024-04-25T23:02:29.083450+0000","last_clean":"2024-04-25T23:02:29.083450+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:29.083450+0000","last_undegraded":"2024-04-25T23:02:29.083450+0000","last_fullsized":"2024-04-25T23:02:29.083450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":605,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164747+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:30.164747+0000","last_peered":"2024-04-25T23:02:30.164747+0000","last_clean":"2024-04-25T23:02:30.164747+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:30.164747+0000","last_undegraded":"2024-04-25T23:02:30.164747+0000","last_fullsized":"2024-04-25T23:02:30.164747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163718+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:30.163718+0000","last_peered":"2024-04-25T23:02:30.163718+0000","last_clean":"2024-04-25T23:02:30.163718+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:30.163718+0000","last_undegraded":"2024-04-25T23:02:30.163718+0000","last_fullsized":"2024-04-25T23:02:30.163718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":313,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166137+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:30.166137+0000","last_peered":"2024-04-25T23:02:30.166137+0000","last_clean":"2024-04-25T23:02:30.166137+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:30.166137+0000","last_undegraded":"2024-04-25T23:02:30.166137+0000","last_fullsized":"2024-04-25T23:02:30.166137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":601,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.095907+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:29.095907+0000","last_peered":"2024-04-25T23:02:29.095907+0000","last_clean":"2024-04-25T23:02:29.095907+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:29.095907+0000","last_undegraded":"2024-04-25T23:02:29.095907+0000","last_fullsized":"2024-04-25T23:02:29.095907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":421,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084674+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:29.084674+0000","last_peered":"2024-04-25T23:02:29.084674+0000","last_clean":"2024-04-25T23:02:29.084674+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:29.084674+0000","last_undegraded":"2024-04-25T23:02:29.084674+0000","last_fullsized":"2024-04-25T23:02:29.084674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":633,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083006+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:29.083006+0000","last_peered":"2024-04-25T23:02:29.083006+0000","last_clean":"2024-04-25T23:02:29.083006+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:29.083006+0000","last_undegraded":"2024-04-25T23:02:29.083006+0000","last_fullsized":"2024-04-25T23:02:29.083006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":647,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166871+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:30.166871+0000","last_peered":"2024-04-25T23:02:30.166871+0000","last_clean":"2024-04-25T23:02:30.166871+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:30.166871+0000","last_undegraded":"2024-04-25T23:02:30.166871+0000","last_fullsized":"2024-04-25T23:02:30.166871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":592,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164627+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:30.164627+0000","last_peered":"2024-04-25T23:02:30.164627+0000","last_clean":"2024-04-25T23:02:30.164627+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:30.164627+0000","last_undegraded":"2024-04-25T23:02:30.164627+0000","last_fullsized":"2024-04-25T23:02:30.164627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":217,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166076+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:30.166076+0000","last_peered":"2024-04-25T23:02:30.166076+0000","last_clean":"2024-04-25T23:02:30.166076+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:30.166076+0000","last_undegraded":"2024-04-25T23:02:30.166076+0000","last_fullsized":"2024-04-25T23:02:30.166076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":658,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163999+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:30.163999+0000","last_peered":"2024-04-25T23:02:30.163999+0000","last_clean":"2024-04-25T23:02:30.163999+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:30.163999+0000","last_undegraded":"2024-04-25T23:02:30.163999+0000","last_fullsized":"2024-04-25T23:02:30.163999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":284,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164193+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:30.164193+0000","last_peered":"2024-04-25T23:02:30.164193+0000","last_clean":"2024-04-25T23:02:30.164193+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:30.164193+0000","last_undegraded":"2024-04-25T23:02:30.164193+0000","last_fullsized":"2024-04-25T23:02:30.164193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165640+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:30.165640+0000","last_peered":"2024-04-25T23:02:30.165640+0000","last_clean":"2024-04-25T23:02:30.165640+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:30.165640+0000","last_undegraded":"2024-04-25T23:02:30.165640+0000","last_fullsized":"2024-04-25T23:02:30.165640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":271,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164981+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:30.164981+0000","last_peered":"2024-04-25T23:02:30.164981+0000","last_clean":"2024-04-25T23:02:30.164981+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:30.164981+0000","last_undegraded":"2024-04-25T23:02:30.164981+0000","last_fullsized":"2024-04-25T23:02:30.164981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":595,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166380+0000","last_change":"2024-04-25T23:02:16.343420+0000","last_active":"2024-04-25T23:02:30.166380+0000","last_peered":"2024-04-25T23:02:30.166380+0000","last_clean":"2024-04-25T22:59:33.272608+0000","last_became_active":"2024-04-25T23:02:16.338558+0000","last_became_peered":"2024-04-25T23:02:16.338558+0000","last_unstale":"2024-04-25T23:02:30.166380+0000","last_undegraded":"2024-04-25T23:02:16.200530+0000","last_fullsized":"2024-04-25T23:02:16.197751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.082927+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:29.082927+0000","last_peered":"2024-04-25T23:02:29.082927+0000","last_clean":"2024-04-25T23:02:29.082927+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:29.082927+0000","last_undegraded":"2024-04-25T23:02:29.082927+0000","last_fullsized":"2024-04-25T23:02:29.082927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":883,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164365+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:30.164365+0000","last_peered":"2024-04-25T23:02:30.164365+0000","last_clean":"2024-04-25T23:02:30.164365+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:30.164365+0000","last_undegraded":"2024-04-25T23:02:30.164365+0000","last_fullsized":"2024-04-25T23:02:30.164365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":608,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083201+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:29.083201+0000","last_peered":"2024-04-25T23:02:29.083201+0000","last_clean":"2024-04-25T23:02:29.083201+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:29.083201+0000","last_undegraded":"2024-04-25T23:02:29.083201+0000","last_fullsized":"2024-04-25T23:02:29.083201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":560,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165104+0000","last_change":"2024-04-25T23:02:16.335886+0000","last_active":"2024-04-25T23:02:30.165104+0000","last_peered":"2024-04-25T23:02:30.165104+0000","last_clean":"2024-04-25T22:59:32.892903+0000","last_became_active":"2024-04-25T23:02:16.325195+0000","last_became_peered":"2024-04-25T23:02:16.325195+0000","last_unstale":"2024-04-25T23:02:30.165104+0000","last_undegraded":"2024-04-25T23:02:16.191750+0000","last_fullsized":"2024-04-25T23:02:16.173053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":362,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165545+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:30.165545+0000","last_peered":"2024-04-25T23:02:30.165545+0000","last_clean":"2024-04-25T23:02:30.165545+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:30.165545+0000","last_undegraded":"2024-04-25T23:02:30.165545+0000","last_fullsized":"2024-04-25T23:02:30.165545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165886+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:30.165886+0000","last_peered":"2024-04-25T23:02:30.165886+0000","last_clean":"2024-04-25T23:02:30.165886+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:30.165886+0000","last_undegraded":"2024-04-25T23:02:30.165886+0000","last_fullsized":"2024-04-25T23:02:30.165886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":787,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163679+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:30.163679+0000","last_peered":"2024-04-25T23:02:30.163679+0000","last_clean":"2024-04-25T23:02:30.163679+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:30.163679+0000","last_undegraded":"2024-04-25T23:02:30.163679+0000","last_fullsized":"2024-04-25T23:02:30.163679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":645,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166605+0000","last_change":"2024-04-25T23:02:16.345583+0000","last_active":"2024-04-25T23:02:30.166605+0000","last_peered":"2024-04-25T23:02:30.166605+0000","last_clean":"2024-04-25T22:59:33.272809+0000","last_became_active":"2024-04-25T23:02:16.342554+0000","last_became_peered":"2024-04-25T23:02:16.342554+0000","last_unstale":"2024-04-25T23:02:30.166605+0000","last_undegraded":"2024-04-25T23:02:16.202781+0000","last_fullsized":"2024-04-25T23:02:16.198394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165291+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:30.165291+0000","last_peered":"2024-04-25T23:02:30.165291+0000","last_clean":"2024-04-25T23:02:30.165291+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:30.165291+0000","last_undegraded":"2024-04-25T23:02:30.165291+0000","last_fullsized":"2024-04-25T23:02:30.165291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":339,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163318+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:30.163318+0000","last_peered":"2024-04-25T23:02:30.163318+0000","last_clean":"2024-04-25T23:02:30.163318+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:30.163318+0000","last_undegraded":"2024-04-25T23:02:30.163318+0000","last_fullsized":"2024-04-25T23:02:30.163318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":982,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:29.561481+0000","last_change":"2024-04-25T23:02:29.562004+0000","last_active":"2024-04-25T23:02:29.561481+0000","last_peered":"2024-04-25T23:02:29.561481+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.318001+0000","last_became_peered":"2024-04-25T23:02:16.318001+0000","last_unstale":"2024-04-25T23:02:29.561481+0000","last_undegraded":"2024-04-25T23:02:29.561481+0000","last_fullsized":"2024-04-25T23:02:16.167634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163664+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:30.163664+0000","last_peered":"2024-04-25T23:02:30.163664+0000","last_clean":"2024-04-25T23:02:30.163664+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:30.163664+0000","last_undegraded":"2024-04-25T23:02:30.163664+0000","last_fullsized":"2024-04-25T23:02:30.163664+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":471,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.082682+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:29.082682+0000","last_peered":"2024-04-25T23:02:29.082682+0000","last_clean":"2024-04-25T23:02:29.082682+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:29.082682+0000","last_undegraded":"2024-04-25T23:02:29.082682+0000","last_fullsized":"2024-04-25T23:02:29.082682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":545,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165324+0000","last_change":"2024-04-25T23:02:16.336587+0000","last_active":"2024-04-25T23:02:30.165324+0000","last_peered":"2024-04-25T23:02:30.165324+0000","last_clean":"2024-04-25T22:59:32.893156+0000","last_became_active":"2024-04-25T23:02:16.330744+0000","last_became_peered":"2024-04-25T23:02:16.330744+0000","last_unstale":"2024-04-25T23:02:30.165324+0000","last_undegraded":"2024-04-25T23:02:16.203382+0000","last_fullsized":"2024-04-25T23:02:16.192794+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165189+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:30.165189+0000","last_peered":"2024-04-25T23:02:30.165189+0000","last_clean":"2024-04-25T23:02:30.165189+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:30.165189+0000","last_undegraded":"2024-04-25T23:02:30.165189+0000","last_fullsized":"2024-04-25T23:02:30.165189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165103+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:30.165103+0000","last_peered":"2024-04-25T23:02:30.165103+0000","last_clean":"2024-04-25T23:02:30.165103+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:30.165103+0000","last_undegraded":"2024-04-25T23:02:30.165103+0000","last_fullsized":"2024-04-25T23:02:30.165103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":909,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.173119+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:30.173119+0000","last_peered":"2024-04-25T23:02:30.173119+0000","last_clean":"2024-04-25T23:02:30.173119+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:30.173119+0000","last_undegraded":"2024-04-25T23:02:30.173119+0000","last_fullsized":"2024-04-25T23:02:30.173119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":426,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167014+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:30.167014+0000","last_peered":"2024-04-25T23:02:30.167014+0000","last_clean":"2024-04-25T23:02:30.167014+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:30.167014+0000","last_undegraded":"2024-04-25T23:02:30.167014+0000","last_fullsized":"2024-04-25T23:02:30.167014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165139+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:30.165139+0000","last_peered":"2024-04-25T23:02:30.165139+0000","last_clean":"2024-04-25T23:02:30.165139+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:30.165139+0000","last_undegraded":"2024-04-25T23:02:30.165139+0000","last_fullsized":"2024-04-25T23:02:30.165139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.086087+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:29.086087+0000","last_peered":"2024-04-25T23:02:29.086087+0000","last_clean":"2024-04-25T23:02:29.086087+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:29.086087+0000","last_undegraded":"2024-04-25T23:02:29.086087+0000","last_fullsized":"2024-04-25T23:02:29.086087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":203,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164826+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:30.164826+0000","last_peered":"2024-04-25T23:02:30.164826+0000","last_clean":"2024-04-25T23:02:30.164826+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:30.164826+0000","last_undegraded":"2024-04-25T23:02:30.164826+0000","last_fullsized":"2024-04-25T23:02:30.164826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085540+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:29.085540+0000","last_peered":"2024-04-25T23:02:29.085540+0000","last_clean":"2024-04-25T23:02:29.085540+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:29.085540+0000","last_undegraded":"2024-04-25T23:02:29.085540+0000","last_fullsized":"2024-04-25T23:02:29.085540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":582,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083398+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:29.083398+0000","last_peered":"2024-04-25T23:02:29.083398+0000","last_clean":"2024-04-25T23:02:29.083398+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:29.083398+0000","last_undegraded":"2024-04-25T23:02:29.083398+0000","last_fullsized":"2024-04-25T23:02:29.083398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":214,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166182+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:30.166182+0000","last_peered":"2024-04-25T23:02:30.166182+0000","last_clean":"2024-04-25T23:02:30.166182+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:30.166182+0000","last_undegraded":"2024-04-25T23:02:30.166182+0000","last_fullsized":"2024-04-25T23:02:30.166182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167629+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:30.167629+0000","last_peered":"2024-04-25T23:02:30.167629+0000","last_clean":"2024-04-25T23:02:30.167629+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:30.167629+0000","last_undegraded":"2024-04-25T23:02:30.167629+0000","last_fullsized":"2024-04-25T23:02:30.167629+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163666+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:30.163666+0000","last_peered":"2024-04-25T23:02:30.163666+0000","last_clean":"2024-04-25T23:02:30.163666+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:30.163666+0000","last_undegraded":"2024-04-25T23:02:30.163666+0000","last_fullsized":"2024-04-25T23:02:30.163666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167483+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:30.167483+0000","last_peered":"2024-04-25T23:02:30.167483+0000","last_clean":"2024-04-25T23:02:30.167483+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:30.167483+0000","last_undegraded":"2024-04-25T23:02:30.167483+0000","last_fullsized":"2024-04-25T23:02:30.167483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166389+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:30.166389+0000","last_peered":"2024-04-25T23:02:30.166389+0000","last_clean":"2024-04-25T23:02:30.166389+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:30.166389+0000","last_undegraded":"2024-04-25T23:02:30.166389+0000","last_fullsized":"2024-04-25T23:02:30.166389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083681+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:29.083681+0000","last_peered":"2024-04-25T23:02:29.083681+0000","last_clean":"2024-04-25T23:02:29.083681+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:29.083681+0000","last_undegraded":"2024-04-25T23:02:29.083681+0000","last_fullsized":"2024-04-25T23:02:29.083681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164344+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:30.164344+0000","last_peered":"2024-04-25T23:02:30.164344+0000","last_clean":"2024-04-25T23:02:30.164344+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:30.164344+0000","last_undegraded":"2024-04-25T23:02:30.164344+0000","last_fullsized":"2024-04-25T23:02:30.164344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":413,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165791+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:30.165791+0000","last_peered":"2024-04-25T23:02:30.165791+0000","last_clean":"2024-04-25T23:02:30.165791+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:30.165791+0000","last_undegraded":"2024-04-25T23:02:30.165791+0000","last_fullsized":"2024-04-25T23:02:30.165791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":972,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163132+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:30.163132+0000","last_peered":"2024-04-25T23:02:30.163132+0000","last_clean":"2024-04-25T23:02:30.163132+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:30.163132+0000","last_undegraded":"2024-04-25T23:02:30.163132+0000","last_fullsized":"2024-04-25T23:02:30.163132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084819+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:29.084819+0000","last_peered":"2024-04-25T23:02:29.084819+0000","last_clean":"2024-04-25T23:02:29.084819+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:29.084819+0000","last_undegraded":"2024-04-25T23:02:29.084819+0000","last_fullsized":"2024-04-25T23:02:29.084819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165471+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:30.165471+0000","last_peered":"2024-04-25T23:02:30.165471+0000","last_clean":"2024-04-25T23:02:30.165471+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:30.165471+0000","last_undegraded":"2024-04-25T23:02:30.165471+0000","last_fullsized":"2024-04-25T23:02:30.165471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":652,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162972+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:30.162972+0000","last_peered":"2024-04-25T23:02:30.162972+0000","last_clean":"2024-04-25T23:02:30.162972+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:30.162972+0000","last_undegraded":"2024-04-25T23:02:30.162972+0000","last_fullsized":"2024-04-25T23:02:30.162972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165944+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:30.165944+0000","last_peered":"2024-04-25T23:02:30.165944+0000","last_clean":"2024-04-25T23:02:30.165944+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:30.165944+0000","last_undegraded":"2024-04-25T23:02:30.165944+0000","last_fullsized":"2024-04-25T23:02:30.165944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":616,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163052+0000","last_change":"2024-04-25T23:02:16.326390+0000","last_active":"2024-04-25T23:02:30.163052+0000","last_peered":"2024-04-25T23:02:30.163052+0000","last_clean":"2024-04-25T22:59:32.891227+0000","last_became_active":"2024-04-25T23:02:16.320796+0000","last_became_peered":"2024-04-25T23:02:16.320796+0000","last_unstale":"2024-04-25T23:02:30.163052+0000","last_undegraded":"2024-04-25T23:02:16.200450+0000","last_fullsized":"2024-04-25T23:02:16.183515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085396+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:29.085396+0000","last_peered":"2024-04-25T23:02:29.085396+0000","last_clean":"2024-04-25T23:02:29.085396+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:29.085396+0000","last_undegraded":"2024-04-25T23:02:29.085396+0000","last_fullsized":"2024-04-25T23:02:29.085396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":731,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163988+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:30.163988+0000","last_peered":"2024-04-25T23:02:30.163988+0000","last_clean":"2024-04-25T23:02:30.163988+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:30.163988+0000","last_undegraded":"2024-04-25T23:02:30.163988+0000","last_fullsized":"2024-04-25T23:02:30.163988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166451+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:30.166451+0000","last_peered":"2024-04-25T23:02:30.166451+0000","last_clean":"2024-04-25T23:02:30.166451+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:30.166451+0000","last_undegraded":"2024-04-25T23:02:30.166451+0000","last_fullsized":"2024-04-25T23:02:30.166451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":349,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163265+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:30.163265+0000","last_peered":"2024-04-25T23:02:30.163265+0000","last_clean":"2024-04-25T23:02:30.163265+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:30.163265+0000","last_undegraded":"2024-04-25T23:02:30.163265+0000","last_fullsized":"2024-04-25T23:02:30.163265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":596,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164160+0000","last_change":"2024-04-25T23:02:16.342038+0000","last_active":"2024-04-25T23:02:30.164160+0000","last_peered":"2024-04-25T23:02:30.164160+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329576+0000","last_became_peered":"2024-04-25T23:02:16.329576+0000","last_unstale":"2024-04-25T23:02:30.164160+0000","last_undegraded":"2024-04-25T23:02:16.182696+0000","last_fullsized":"2024-04-25T23:02:16.166712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083505+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:29.083505+0000","last_peered":"2024-04-25T23:02:29.083505+0000","last_clean":"2024-04-25T23:02:29.083505+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:29.083505+0000","last_undegraded":"2024-04-25T23:02:29.083505+0000","last_fullsized":"2024-04-25T23:02:29.083505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":517,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.094226+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:29.094226+0000","last_peered":"2024-04-25T23:02:29.094226+0000","last_clean":"2024-04-25T23:02:29.094226+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:29.094226+0000","last_undegraded":"2024-04-25T23:02:29.094226+0000","last_fullsized":"2024-04-25T23:02:29.094226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083578+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:29.083578+0000","last_peered":"2024-04-25T23:02:29.083578+0000","last_clean":"2024-04-25T23:02:29.083578+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:29.083578+0000","last_undegraded":"2024-04-25T23:02:29.083578+0000","last_fullsized":"2024-04-25T23:02:29.083578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":572,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164042+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:30.164042+0000","last_peered":"2024-04-25T23:02:30.164042+0000","last_clean":"2024-04-25T23:02:30.164042+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:30.164042+0000","last_undegraded":"2024-04-25T23:02:30.164042+0000","last_fullsized":"2024-04-25T23:02:30.164042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":349,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165496+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:30.165496+0000","last_peered":"2024-04-25T23:02:30.165496+0000","last_clean":"2024-04-25T23:02:30.165496+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:30.165496+0000","last_undegraded":"2024-04-25T23:02:30.165496+0000","last_fullsized":"2024-04-25T23:02:30.165496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164648+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:30.164648+0000","last_peered":"2024-04-25T23:02:30.164648+0000","last_clean":"2024-04-25T23:02:30.164648+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:30.164648+0000","last_undegraded":"2024-04-25T23:02:30.164648+0000","last_fullsized":"2024-04-25T23:02:30.164648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":418,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084297+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:29.084297+0000","last_peered":"2024-04-25T23:02:29.084297+0000","last_clean":"2024-04-25T23:02:29.084297+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:29.084297+0000","last_undegraded":"2024-04-25T23:02:29.084297+0000","last_fullsized":"2024-04-25T23:02:29.084297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":619,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083341+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:29.083341+0000","last_peered":"2024-04-25T23:02:29.083341+0000","last_clean":"2024-04-25T23:02:29.083341+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:29.083341+0000","last_undegraded":"2024-04-25T23:02:29.083341+0000","last_fullsized":"2024-04-25T23:02:29.083341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":218,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167213+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:30.167213+0000","last_peered":"2024-04-25T23:02:30.167213+0000","last_clean":"2024-04-25T23:02:30.167213+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:30.167213+0000","last_undegraded":"2024-04-25T23:02:30.167213+0000","last_fullsized":"2024-04-25T23:02:30.167213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":633,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164037+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:30.164037+0000","last_peered":"2024-04-25T23:02:30.164037+0000","last_clean":"2024-04-25T23:02:30.164037+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:30.164037+0000","last_undegraded":"2024-04-25T23:02:30.164037+0000","last_fullsized":"2024-04-25T23:02:30.164037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165774+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:30.165774+0000","last_peered":"2024-04-25T23:02:30.165774+0000","last_clean":"2024-04-25T23:02:30.165774+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:30.165774+0000","last_undegraded":"2024-04-25T23:02:30.165774+0000","last_fullsized":"2024-04-25T23:02:30.165774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3033,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4409,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":108,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111468,"kb_used_data":83932,"kb_used_omap":5,"kb_used_meta":27514,"kb_avail":94260372,"statfs":{"total":96636764160,"available":96522620928,"internally_reserved":0,"allocated":85946368,"data_stored":85511015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":28174475},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177744,"kb_used_data":80004,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94194096,"statfs":{"total":96636764160,"available":96454754304,"internally_reserved":0,"allocated":81924096,"data_stored":81508258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178884,"kb_used_data":89464,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192956,"statfs":{"total":96636764160,"available":96453586944,"internally_reserved":0,"allocated":91611136,"data_stored":91171142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:32.151 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:32.509 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:32.511 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:32.526 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-25T23:02:32.162916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3033,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4432,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":468096,"kb_used_data":253400,"kb_used_omap":8,"kb_used_meta":214647,"kb_avail":282647424,"statfs":{"total":289910292480,"available":289430962176,"internally_reserved":0,"allocated":259481600,"data_stored":258190415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":219798549},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1949,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2071,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.996453"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":626,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165785+0000","last_change":"2024-04-25T23:02:16.336211+0000","last_active":"2024-04-25T23:02:30.165785+0000","last_peered":"2024-04-25T23:02:30.165785+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329824+0000","last_became_peered":"2024-04-25T23:02:16.329824+0000","last_unstale":"2024-04-25T23:02:30.165785+0000","last_undegraded":"2024-04-25T23:02:16.203747+0000","last_fullsized":"2024-04-25T23:02:16.195496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":613,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166060+0000","last_change":"2024-04-25T23:02:16.328918+0000","last_active":"2024-04-25T23:02:30.166060+0000","last_peered":"2024-04-25T23:02:30.166060+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.323624+0000","last_became_peered":"2024-04-25T23:02:16.323624+0000","last_unstale":"2024-04-25T23:02:30.166060+0000","last_undegraded":"2024-04-25T23:02:16.206461+0000","last_fullsized":"2024-04-25T23:02:16.185275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":542,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164829+0000","last_change":"2024-04-25T23:02:16.342187+0000","last_active":"2024-04-25T23:02:30.164829+0000","last_peered":"2024-04-25T23:02:30.164829+0000","last_clean":"2024-04-25T22:59:33.271539+0000","last_became_active":"2024-04-25T23:02:16.330924+0000","last_became_peered":"2024-04-25T23:02:16.330924+0000","last_unstale":"2024-04-25T23:02:30.164829+0000","last_undegraded":"2024-04-25T23:02:16.197400+0000","last_fullsized":"2024-04-25T23:02:16.191428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164401+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:30.164401+0000","last_peered":"2024-04-25T23:02:30.164401+0000","last_clean":"2024-04-25T23:02:30.164401+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:30.164401+0000","last_undegraded":"2024-04-25T23:02:30.164401+0000","last_fullsized":"2024-04-25T23:02:30.164401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":626,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083679+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:29.083679+0000","last_peered":"2024-04-25T23:02:29.083679+0000","last_clean":"2024-04-25T23:02:29.083679+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:29.083679+0000","last_undegraded":"2024-04-25T23:02:29.083679+0000","last_fullsized":"2024-04-25T23:02:29.083679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163971+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:30.163971+0000","last_peered":"2024-04-25T23:02:30.163971+0000","last_clean":"2024-04-25T23:02:30.163971+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:30.163971+0000","last_undegraded":"2024-04-25T23:02:30.163971+0000","last_fullsized":"2024-04-25T23:02:30.163971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163333+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:30.163333+0000","last_peered":"2024-04-25T23:02:30.163333+0000","last_clean":"2024-04-25T23:02:30.163333+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:30.163333+0000","last_undegraded":"2024-04-25T23:02:30.163333+0000","last_fullsized":"2024-04-25T23:02:30.163333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":560,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163208+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:30.163208+0000","last_peered":"2024-04-25T23:02:30.163208+0000","last_clean":"2024-04-25T23:02:30.163208+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:30.163208+0000","last_undegraded":"2024-04-25T23:02:30.163208+0000","last_fullsized":"2024-04-25T23:02:30.163208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":551,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164737+0000","last_change":"2024-04-25T23:02:16.335542+0000","last_active":"2024-04-25T23:02:30.164737+0000","last_peered":"2024-04-25T23:02:30.164737+0000","last_clean":"2024-04-25T22:59:32.892759+0000","last_became_active":"2024-04-25T23:02:16.324506+0000","last_became_peered":"2024-04-25T23:02:16.324506+0000","last_unstale":"2024-04-25T23:02:30.164737+0000","last_undegraded":"2024-04-25T23:02:16.192548+0000","last_fullsized":"2024-04-25T23:02:16.163168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":824,"reported_epoch":85,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T23:02:30.665072+0000","last_change":"2024-04-25T23:02:30.226995+0000","last_active":"2024-04-25T23:02:30.665072+0000","last_peered":"2024-04-25T23:02:30.665072+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.318360+0000","last_became_peered":"2024-04-25T23:02:16.318360+0000","last_unstale":"2024-04-25T23:02:30.665072+0000","last_undegraded":"2024-04-25T23:02:30.665072+0000","last_fullsized":"2024-04-25T23:02:16.165027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":574,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165692+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:30.165692+0000","last_peered":"2024-04-25T23:02:30.165692+0000","last_clean":"2024-04-25T23:02:30.165692+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:30.165692+0000","last_undegraded":"2024-04-25T23:02:30.165692+0000","last_fullsized":"2024-04-25T23:02:30.165692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085166+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:29.085166+0000","last_peered":"2024-04-25T23:02:29.085166+0000","last_clean":"2024-04-25T23:02:29.085166+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:29.085166+0000","last_undegraded":"2024-04-25T23:02:29.085166+0000","last_fullsized":"2024-04-25T23:02:29.085166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":509,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163262+0000","last_change":"2024-04-25T23:02:16.889283+0000","last_active":"2024-04-25T23:02:30.163262+0000","last_peered":"2024-04-25T23:02:30.163262+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.264824+0000","last_became_peered":"2024-04-25T23:02:16.264824+0000","last_unstale":"2024-04-25T23:02:30.163262+0000","last_undegraded":"2024-04-25T23:02:16.888989+0000","last_fullsized":"2024-04-25T23:02:16.163698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1006,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164294+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:30.164294+0000","last_peered":"2024-04-25T23:02:30.164294+0000","last_clean":"2024-04-25T23:02:30.164294+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:30.164294+0000","last_undegraded":"2024-04-25T23:02:30.164294+0000","last_fullsized":"2024-04-25T23:02:30.164294+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":954,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163351+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:30.163351+0000","last_peered":"2024-04-25T23:02:30.163351+0000","last_clean":"2024-04-25T23:02:30.163351+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:30.163351+0000","last_undegraded":"2024-04-25T23:02:30.163351+0000","last_fullsized":"2024-04-25T23:02:30.163351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":605,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163394+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:30.163394+0000","last_peered":"2024-04-25T23:02:30.163394+0000","last_clean":"2024-04-25T23:02:30.163394+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:30.163394+0000","last_undegraded":"2024-04-25T23:02:30.163394+0000","last_fullsized":"2024-04-25T23:02:30.163394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":665,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166129+0000","last_change":"2024-04-25T23:02:16.339646+0000","last_active":"2024-04-25T23:02:30.166129+0000","last_peered":"2024-04-25T23:02:30.166129+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:30.166129+0000","last_undegraded":"2024-04-25T23:02:16.208021+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":605,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166890+0000","last_change":"2024-04-25T23:02:16.326630+0000","last_active":"2024-04-25T23:02:30.166890+0000","last_peered":"2024-04-25T23:02:30.166890+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.321704+0000","last_became_peered":"2024-04-25T23:02:16.321704+0000","last_unstale":"2024-04-25T23:02:30.166890+0000","last_undegraded":"2024-04-25T23:02:16.201718+0000","last_fullsized":"2024-04-25T23:02:16.189024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1083,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164823+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:30.164823+0000","last_peered":"2024-04-25T23:02:30.164823+0000","last_clean":"2024-04-25T23:02:30.164823+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:30.164823+0000","last_undegraded":"2024-04-25T23:02:30.164823+0000","last_fullsized":"2024-04-25T23:02:30.164823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":576,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164687+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:30.164687+0000","last_peered":"2024-04-25T23:02:30.164687+0000","last_clean":"2024-04-25T23:02:30.164687+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:30.164687+0000","last_undegraded":"2024-04-25T23:02:30.164687+0000","last_fullsized":"2024-04-25T23:02:30.164687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":619,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164498+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:30.164498+0000","last_peered":"2024-04-25T23:02:30.164498+0000","last_clean":"2024-04-25T23:02:30.164498+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:30.164498+0000","last_undegraded":"2024-04-25T23:02:30.164498+0000","last_fullsized":"2024-04-25T23:02:30.164498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":1060,"reported_epoch":85,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:30.222658+0000","last_change":"2024-04-25T23:02:30.223078+0000","last_active":"2024-04-25T23:02:30.222658+0000","last_peered":"2024-04-25T23:02:30.222658+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.335323+0000","last_became_peered":"2024-04-25T23:02:16.335323+0000","last_unstale":"2024-04-25T23:02:30.222658+0000","last_undegraded":"2024-04-25T23:02:30.222658+0000","last_fullsized":"2024-04-25T23:02:16.174423+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":557,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162671+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:30.162671+0000","last_peered":"2024-04-25T23:02:30.162671+0000","last_clean":"2024-04-25T23:02:30.162671+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:30.162671+0000","last_undegraded":"2024-04-25T23:02:30.162671+0000","last_fullsized":"2024-04-25T23:02:30.162671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":655,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.162911+0000","last_change":"2024-04-25T23:02:16.326683+0000","last_active":"2024-04-25T23:02:30.162911+0000","last_peered":"2024-04-25T23:02:30.162911+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.320738+0000","last_became_peered":"2024-04-25T23:02:16.320738+0000","last_unstale":"2024-04-25T23:02:30.162911+0000","last_undegraded":"2024-04-25T23:02:16.182673+0000","last_fullsized":"2024-04-25T23:02:16.162015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":629,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165365+0000","last_change":"2024-04-25T23:02:16.341114+0000","last_active":"2024-04-25T23:02:30.165365+0000","last_peered":"2024-04-25T23:02:30.165365+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.332838+0000","last_became_peered":"2024-04-25T23:02:16.332838+0000","last_unstale":"2024-04-25T23:02:30.165365+0000","last_undegraded":"2024-04-25T23:02:16.188689+0000","last_fullsized":"2024-04-25T23:02:16.167898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":638,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166608+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:30.166608+0000","last_peered":"2024-04-25T23:02:30.166608+0000","last_clean":"2024-04-25T23:02:30.166608+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:30.166608+0000","last_undegraded":"2024-04-25T23:02:30.166608+0000","last_fullsized":"2024-04-25T23:02:30.166608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":577,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165975+0000","last_change":"2024-04-25T23:02:16.343238+0000","last_active":"2024-04-25T23:02:30.165975+0000","last_peered":"2024-04-25T23:02:30.165975+0000","last_clean":"2024-04-25T22:59:33.272585+0000","last_became_active":"2024-04-25T23:02:16.337943+0000","last_became_peered":"2024-04-25T23:02:16.337943+0000","last_unstale":"2024-04-25T23:02:30.165975+0000","last_undegraded":"2024-04-25T23:02:16.196378+0000","last_fullsized":"2024-04-25T23:02:16.191698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":592,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163913+0000","last_change":"2024-04-25T23:02:16.857958+0000","last_active":"2024-04-25T23:02:30.163913+0000","last_peered":"2024-04-25T23:02:30.163913+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.316513+0000","last_became_peered":"2024-04-25T23:02:16.316513+0000","last_unstale":"2024-04-25T23:02:30.163913+0000","last_undegraded":"2024-04-25T23:02:16.857683+0000","last_fullsized":"2024-04-25T23:02:16.165883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163758+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:30.163758+0000","last_peered":"2024-04-25T23:02:30.163758+0000","last_clean":"2024-04-25T23:02:30.163758+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:30.163758+0000","last_undegraded":"2024-04-25T23:02:30.163758+0000","last_fullsized":"2024-04-25T23:02:30.163758+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":599,"reported_epoch":84,"state":"peering","last_fresh":"2024-04-25T23:02:28.918197+0000","last_change":"2024-04-25T23:02:29.909540+0000","last_active":"2024-04-25T23:02:29.909540+0000","last_peered":"2024-04-25T23:02:28.918197+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.330883+0000","last_became_peered":"2024-04-25T23:02:16.330883+0000","last_unstale":"2024-04-25T23:02:28.918197+0000","last_undegraded":"2024-04-25T23:02:28.918197+0000","last_fullsized":"2024-04-25T23:02:16.165409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1016,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162848+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:30.162848+0000","last_peered":"2024-04-25T23:02:30.162848+0000","last_clean":"2024-04-25T23:02:30.162848+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:30.162848+0000","last_undegraded":"2024-04-25T23:02:30.162848+0000","last_fullsized":"2024-04-25T23:02:30.162848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165462+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:30.165462+0000","last_peered":"2024-04-25T23:02:30.165462+0000","last_clean":"2024-04-25T23:02:30.165462+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:30.165462+0000","last_undegraded":"2024-04-25T23:02:30.165462+0000","last_fullsized":"2024-04-25T23:02:30.165462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084056+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:29.084056+0000","last_peered":"2024-04-25T23:02:29.084056+0000","last_clean":"2024-04-25T23:02:29.084056+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:29.084056+0000","last_undegraded":"2024-04-25T23:02:29.084056+0000","last_fullsized":"2024-04-25T23:02:29.084056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":694,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164822+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:30.164822+0000","last_peered":"2024-04-25T23:02:30.164822+0000","last_clean":"2024-04-25T23:02:30.164822+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:30.164822+0000","last_undegraded":"2024-04-25T23:02:30.164822+0000","last_fullsized":"2024-04-25T23:02:30.164822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":552,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084521+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:29.084521+0000","last_peered":"2024-04-25T23:02:29.084521+0000","last_clean":"2024-04-25T23:02:29.084521+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:29.084521+0000","last_undegraded":"2024-04-25T23:02:29.084521+0000","last_fullsized":"2024-04-25T23:02:29.084521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":194,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163444+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:30.163444+0000","last_peered":"2024-04-25T23:02:30.163444+0000","last_clean":"2024-04-25T23:02:30.163444+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:30.163444+0000","last_undegraded":"2024-04-25T23:02:30.163444+0000","last_fullsized":"2024-04-25T23:02:30.163444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":646,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167353+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:30.167353+0000","last_peered":"2024-04-25T23:02:30.167353+0000","last_clean":"2024-04-25T23:02:30.167353+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:30.167353+0000","last_undegraded":"2024-04-25T23:02:30.167353+0000","last_fullsized":"2024-04-25T23:02:30.167353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083450+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:29.083450+0000","last_peered":"2024-04-25T23:02:29.083450+0000","last_clean":"2024-04-25T23:02:29.083450+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:29.083450+0000","last_undegraded":"2024-04-25T23:02:29.083450+0000","last_fullsized":"2024-04-25T23:02:29.083450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":605,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164747+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:30.164747+0000","last_peered":"2024-04-25T23:02:30.164747+0000","last_clean":"2024-04-25T23:02:30.164747+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:30.164747+0000","last_undegraded":"2024-04-25T23:02:30.164747+0000","last_fullsized":"2024-04-25T23:02:30.164747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163718+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:30.163718+0000","last_peered":"2024-04-25T23:02:30.163718+0000","last_clean":"2024-04-25T23:02:30.163718+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:30.163718+0000","last_undegraded":"2024-04-25T23:02:30.163718+0000","last_fullsized":"2024-04-25T23:02:30.163718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":313,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166137+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:30.166137+0000","last_peered":"2024-04-25T23:02:30.166137+0000","last_clean":"2024-04-25T23:02:30.166137+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:30.166137+0000","last_undegraded":"2024-04-25T23:02:30.166137+0000","last_fullsized":"2024-04-25T23:02:30.166137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":601,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.095907+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:29.095907+0000","last_peered":"2024-04-25T23:02:29.095907+0000","last_clean":"2024-04-25T23:02:29.095907+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:29.095907+0000","last_undegraded":"2024-04-25T23:02:29.095907+0000","last_fullsized":"2024-04-25T23:02:29.095907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":421,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084674+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:29.084674+0000","last_peered":"2024-04-25T23:02:29.084674+0000","last_clean":"2024-04-25T23:02:29.084674+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:29.084674+0000","last_undegraded":"2024-04-25T23:02:29.084674+0000","last_fullsized":"2024-04-25T23:02:29.084674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":633,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083006+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:29.083006+0000","last_peered":"2024-04-25T23:02:29.083006+0000","last_clean":"2024-04-25T23:02:29.083006+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:29.083006+0000","last_undegraded":"2024-04-25T23:02:29.083006+0000","last_fullsized":"2024-04-25T23:02:29.083006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":647,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166871+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:30.166871+0000","last_peered":"2024-04-25T23:02:30.166871+0000","last_clean":"2024-04-25T23:02:30.166871+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:30.166871+0000","last_undegraded":"2024-04-25T23:02:30.166871+0000","last_fullsized":"2024-04-25T23:02:30.166871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":592,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164627+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:30.164627+0000","last_peered":"2024-04-25T23:02:30.164627+0000","last_clean":"2024-04-25T23:02:30.164627+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:30.164627+0000","last_undegraded":"2024-04-25T23:02:30.164627+0000","last_fullsized":"2024-04-25T23:02:30.164627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":217,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166076+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:30.166076+0000","last_peered":"2024-04-25T23:02:30.166076+0000","last_clean":"2024-04-25T23:02:30.166076+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:30.166076+0000","last_undegraded":"2024-04-25T23:02:30.166076+0000","last_fullsized":"2024-04-25T23:02:30.166076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":658,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163999+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:30.163999+0000","last_peered":"2024-04-25T23:02:30.163999+0000","last_clean":"2024-04-25T23:02:30.163999+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:30.163999+0000","last_undegraded":"2024-04-25T23:02:30.163999+0000","last_fullsized":"2024-04-25T23:02:30.163999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":284,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164193+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:30.164193+0000","last_peered":"2024-04-25T23:02:30.164193+0000","last_clean":"2024-04-25T23:02:30.164193+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:30.164193+0000","last_undegraded":"2024-04-25T23:02:30.164193+0000","last_fullsized":"2024-04-25T23:02:30.164193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165640+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:30.165640+0000","last_peered":"2024-04-25T23:02:30.165640+0000","last_clean":"2024-04-25T23:02:30.165640+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:30.165640+0000","last_undegraded":"2024-04-25T23:02:30.165640+0000","last_fullsized":"2024-04-25T23:02:30.165640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":271,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164981+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:30.164981+0000","last_peered":"2024-04-25T23:02:30.164981+0000","last_clean":"2024-04-25T23:02:30.164981+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:30.164981+0000","last_undegraded":"2024-04-25T23:02:30.164981+0000","last_fullsized":"2024-04-25T23:02:30.164981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":595,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166380+0000","last_change":"2024-04-25T23:02:16.343420+0000","last_active":"2024-04-25T23:02:30.166380+0000","last_peered":"2024-04-25T23:02:30.166380+0000","last_clean":"2024-04-25T22:59:33.272608+0000","last_became_active":"2024-04-25T23:02:16.338558+0000","last_became_peered":"2024-04-25T23:02:16.338558+0000","last_unstale":"2024-04-25T23:02:30.166380+0000","last_undegraded":"2024-04-25T23:02:16.200530+0000","last_fullsized":"2024-04-25T23:02:16.197751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.082927+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:29.082927+0000","last_peered":"2024-04-25T23:02:29.082927+0000","last_clean":"2024-04-25T23:02:29.082927+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:29.082927+0000","last_undegraded":"2024-04-25T23:02:29.082927+0000","last_fullsized":"2024-04-25T23:02:29.082927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":883,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164365+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:30.164365+0000","last_peered":"2024-04-25T23:02:30.164365+0000","last_clean":"2024-04-25T23:02:30.164365+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:30.164365+0000","last_undegraded":"2024-04-25T23:02:30.164365+0000","last_fullsized":"2024-04-25T23:02:30.164365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":608,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083201+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:29.083201+0000","last_peered":"2024-04-25T23:02:29.083201+0000","last_clean":"2024-04-25T23:02:29.083201+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:29.083201+0000","last_undegraded":"2024-04-25T23:02:29.083201+0000","last_fullsized":"2024-04-25T23:02:29.083201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":560,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165104+0000","last_change":"2024-04-25T23:02:16.335886+0000","last_active":"2024-04-25T23:02:30.165104+0000","last_peered":"2024-04-25T23:02:30.165104+0000","last_clean":"2024-04-25T22:59:32.892903+0000","last_became_active":"2024-04-25T23:02:16.325195+0000","last_became_peered":"2024-04-25T23:02:16.325195+0000","last_unstale":"2024-04-25T23:02:30.165104+0000","last_undegraded":"2024-04-25T23:02:16.191750+0000","last_fullsized":"2024-04-25T23:02:16.173053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":362,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165545+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:30.165545+0000","last_peered":"2024-04-25T23:02:30.165545+0000","last_clean":"2024-04-25T23:02:30.165545+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:30.165545+0000","last_undegraded":"2024-04-25T23:02:30.165545+0000","last_fullsized":"2024-04-25T23:02:30.165545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165886+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:30.165886+0000","last_peered":"2024-04-25T23:02:30.165886+0000","last_clean":"2024-04-25T23:02:30.165886+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:30.165886+0000","last_undegraded":"2024-04-25T23:02:30.165886+0000","last_fullsized":"2024-04-25T23:02:30.165886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":787,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163679+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:30.163679+0000","last_peered":"2024-04-25T23:02:30.163679+0000","last_clean":"2024-04-25T23:02:30.163679+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:30.163679+0000","last_undegraded":"2024-04-25T23:02:30.163679+0000","last_fullsized":"2024-04-25T23:02:30.163679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":645,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166605+0000","last_change":"2024-04-25T23:02:16.345583+0000","last_active":"2024-04-25T23:02:30.166605+0000","last_peered":"2024-04-25T23:02:30.166605+0000","last_clean":"2024-04-25T22:59:33.272809+0000","last_became_active":"2024-04-25T23:02:16.342554+0000","last_became_peered":"2024-04-25T23:02:16.342554+0000","last_unstale":"2024-04-25T23:02:30.166605+0000","last_undegraded":"2024-04-25T23:02:16.202781+0000","last_fullsized":"2024-04-25T23:02:16.198394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165291+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:30.165291+0000","last_peered":"2024-04-25T23:02:30.165291+0000","last_clean":"2024-04-25T23:02:30.165291+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:30.165291+0000","last_undegraded":"2024-04-25T23:02:30.165291+0000","last_fullsized":"2024-04-25T23:02:30.165291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":339,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163318+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:30.163318+0000","last_peered":"2024-04-25T23:02:30.163318+0000","last_clean":"2024-04-25T23:02:30.163318+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:30.163318+0000","last_undegraded":"2024-04-25T23:02:30.163318+0000","last_fullsized":"2024-04-25T23:02:30.163318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":982,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:29.561481+0000","last_change":"2024-04-25T23:02:29.562004+0000","last_active":"2024-04-25T23:02:29.561481+0000","last_peered":"2024-04-25T23:02:29.561481+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.318001+0000","last_became_peered":"2024-04-25T23:02:16.318001+0000","last_unstale":"2024-04-25T23:02:29.561481+0000","last_undegraded":"2024-04-25T23:02:29.561481+0000","last_fullsized":"2024-04-25T23:02:16.167634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163664+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:30.163664+0000","last_peered":"2024-04-25T23:02:30.163664+0000","last_clean":"2024-04-25T23:02:30.163664+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:30.163664+0000","last_undegraded":"2024-04-25T23:02:30.163664+0000","last_fullsized":"2024-04-25T23:02:30.163664+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":471,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.082682+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:29.082682+0000","last_peered":"2024-04-25T23:02:29.082682+0000","last_clean":"2024-04-25T23:02:29.082682+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:29.082682+0000","last_undegraded":"2024-04-25T23:02:29.082682+0000","last_fullsized":"2024-04-25T23:02:29.082682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":545,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165324+0000","last_change":"2024-04-25T23:02:16.336587+0000","last_active":"2024-04-25T23:02:30.165324+0000","last_peered":"2024-04-25T23:02:30.165324+0000","last_clean":"2024-04-25T22:59:32.893156+0000","last_became_active":"2024-04-25T23:02:16.330744+0000","last_became_peered":"2024-04-25T23:02:16.330744+0000","last_unstale":"2024-04-25T23:02:30.165324+0000","last_undegraded":"2024-04-25T23:02:16.203382+0000","last_fullsized":"2024-04-25T23:02:16.192794+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165189+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:30.165189+0000","last_peered":"2024-04-25T23:02:30.165189+0000","last_clean":"2024-04-25T23:02:30.165189+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:30.165189+0000","last_undegraded":"2024-04-25T23:02:30.165189+0000","last_fullsized":"2024-04-25T23:02:30.165189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165103+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:30.165103+0000","last_peered":"2024-04-25T23:02:30.165103+0000","last_clean":"2024-04-25T23:02:30.165103+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:30.165103+0000","last_undegraded":"2024-04-25T23:02:30.165103+0000","last_fullsized":"2024-04-25T23:02:30.165103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":909,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.173119+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:30.173119+0000","last_peered":"2024-04-25T23:02:30.173119+0000","last_clean":"2024-04-25T23:02:30.173119+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:30.173119+0000","last_undegraded":"2024-04-25T23:02:30.173119+0000","last_fullsized":"2024-04-25T23:02:30.173119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":426,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167014+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:30.167014+0000","last_peered":"2024-04-25T23:02:30.167014+0000","last_clean":"2024-04-25T23:02:30.167014+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:30.167014+0000","last_undegraded":"2024-04-25T23:02:30.167014+0000","last_fullsized":"2024-04-25T23:02:30.167014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165139+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:30.165139+0000","last_peered":"2024-04-25T23:02:30.165139+0000","last_clean":"2024-04-25T23:02:30.165139+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:30.165139+0000","last_undegraded":"2024-04-25T23:02:30.165139+0000","last_fullsized":"2024-04-25T23:02:30.165139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.086087+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:29.086087+0000","last_peered":"2024-04-25T23:02:29.086087+0000","last_clean":"2024-04-25T23:02:29.086087+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:29.086087+0000","last_undegraded":"2024-04-25T23:02:29.086087+0000","last_fullsized":"2024-04-25T23:02:29.086087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":203,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164826+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:30.164826+0000","last_peered":"2024-04-25T23:02:30.164826+0000","last_clean":"2024-04-25T23:02:30.164826+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:30.164826+0000","last_undegraded":"2024-04-25T23:02:30.164826+0000","last_fullsized":"2024-04-25T23:02:30.164826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085540+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:29.085540+0000","last_peered":"2024-04-25T23:02:29.085540+0000","last_clean":"2024-04-25T23:02:29.085540+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:29.085540+0000","last_undegraded":"2024-04-25T23:02:29.085540+0000","last_fullsized":"2024-04-25T23:02:29.085540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":582,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083398+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:29.083398+0000","last_peered":"2024-04-25T23:02:29.083398+0000","last_clean":"2024-04-25T23:02:29.083398+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:29.083398+0000","last_undegraded":"2024-04-25T23:02:29.083398+0000","last_fullsized":"2024-04-25T23:02:29.083398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":214,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166182+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:30.166182+0000","last_peered":"2024-04-25T23:02:30.166182+0000","last_clean":"2024-04-25T23:02:30.166182+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:30.166182+0000","last_undegraded":"2024-04-25T23:02:30.166182+0000","last_fullsized":"2024-04-25T23:02:30.166182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167629+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:30.167629+0000","last_peered":"2024-04-25T23:02:30.167629+0000","last_clean":"2024-04-25T23:02:30.167629+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:30.167629+0000","last_undegraded":"2024-04-25T23:02:30.167629+0000","last_fullsized":"2024-04-25T23:02:30.167629+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163666+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:30.163666+0000","last_peered":"2024-04-25T23:02:30.163666+0000","last_clean":"2024-04-25T23:02:30.163666+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:30.163666+0000","last_undegraded":"2024-04-25T23:02:30.163666+0000","last_fullsized":"2024-04-25T23:02:30.163666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167483+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:30.167483+0000","last_peered":"2024-04-25T23:02:30.167483+0000","last_clean":"2024-04-25T23:02:30.167483+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:30.167483+0000","last_undegraded":"2024-04-25T23:02:30.167483+0000","last_fullsized":"2024-04-25T23:02:30.167483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166389+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:30.166389+0000","last_peered":"2024-04-25T23:02:30.166389+0000","last_clean":"2024-04-25T23:02:30.166389+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:30.166389+0000","last_undegraded":"2024-04-25T23:02:30.166389+0000","last_fullsized":"2024-04-25T23:02:30.166389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083681+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:29.083681+0000","last_peered":"2024-04-25T23:02:29.083681+0000","last_clean":"2024-04-25T23:02:29.083681+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:29.083681+0000","last_undegraded":"2024-04-25T23:02:29.083681+0000","last_fullsized":"2024-04-25T23:02:29.083681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164344+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:30.164344+0000","last_peered":"2024-04-25T23:02:30.164344+0000","last_clean":"2024-04-25T23:02:30.164344+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:30.164344+0000","last_undegraded":"2024-04-25T23:02:30.164344+0000","last_fullsized":"2024-04-25T23:02:30.164344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":413,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165791+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:30.165791+0000","last_peered":"2024-04-25T23:02:30.165791+0000","last_clean":"2024-04-25T23:02:30.165791+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:30.165791+0000","last_undegraded":"2024-04-25T23:02:30.165791+0000","last_fullsized":"2024-04-25T23:02:30.165791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":972,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163132+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:30.163132+0000","last_peered":"2024-04-25T23:02:30.163132+0000","last_clean":"2024-04-25T23:02:30.163132+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:30.163132+0000","last_undegraded":"2024-04-25T23:02:30.163132+0000","last_fullsized":"2024-04-25T23:02:30.163132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084819+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:29.084819+0000","last_peered":"2024-04-25T23:02:29.084819+0000","last_clean":"2024-04-25T23:02:29.084819+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:29.084819+0000","last_undegraded":"2024-04-25T23:02:29.084819+0000","last_fullsized":"2024-04-25T23:02:29.084819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165471+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:30.165471+0000","last_peered":"2024-04-25T23:02:30.165471+0000","last_clean":"2024-04-25T23:02:30.165471+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:30.165471+0000","last_undegraded":"2024-04-25T23:02:30.165471+0000","last_fullsized":"2024-04-25T23:02:30.165471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":652,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162972+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:30.162972+0000","last_peered":"2024-04-25T23:02:30.162972+0000","last_clean":"2024-04-25T23:02:30.162972+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:30.162972+0000","last_undegraded":"2024-04-25T23:02:30.162972+0000","last_fullsized":"2024-04-25T23:02:30.162972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165944+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:30.165944+0000","last_peered":"2024-04-25T23:02:30.165944+0000","last_clean":"2024-04-25T23:02:30.165944+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:30.165944+0000","last_undegraded":"2024-04-25T23:02:30.165944+0000","last_fullsized":"2024-04-25T23:02:30.165944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":616,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163052+0000","last_change":"2024-04-25T23:02:16.326390+0000","last_active":"2024-04-25T23:02:30.163052+0000","last_peered":"2024-04-25T23:02:30.163052+0000","last_clean":"2024-04-25T22:59:32.891227+0000","last_became_active":"2024-04-25T23:02:16.320796+0000","last_became_peered":"2024-04-25T23:02:16.320796+0000","last_unstale":"2024-04-25T23:02:30.163052+0000","last_undegraded":"2024-04-25T23:02:16.200450+0000","last_fullsized":"2024-04-25T23:02:16.183515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085396+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:29.085396+0000","last_peered":"2024-04-25T23:02:29.085396+0000","last_clean":"2024-04-25T23:02:29.085396+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:29.085396+0000","last_undegraded":"2024-04-25T23:02:29.085396+0000","last_fullsized":"2024-04-25T23:02:29.085396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":731,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163988+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:30.163988+0000","last_peered":"2024-04-25T23:02:30.163988+0000","last_clean":"2024-04-25T23:02:30.163988+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:30.163988+0000","last_undegraded":"2024-04-25T23:02:30.163988+0000","last_fullsized":"2024-04-25T23:02:30.163988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166451+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:30.166451+0000","last_peered":"2024-04-25T23:02:30.166451+0000","last_clean":"2024-04-25T23:02:30.166451+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:30.166451+0000","last_undegraded":"2024-04-25T23:02:30.166451+0000","last_fullsized":"2024-04-25T23:02:30.166451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":349,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163265+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:30.163265+0000","last_peered":"2024-04-25T23:02:30.163265+0000","last_clean":"2024-04-25T23:02:30.163265+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:30.163265+0000","last_undegraded":"2024-04-25T23:02:30.163265+0000","last_fullsized":"2024-04-25T23:02:30.163265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":596,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164160+0000","last_change":"2024-04-25T23:02:16.342038+0000","last_active":"2024-04-25T23:02:30.164160+0000","last_peered":"2024-04-25T23:02:30.164160+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329576+0000","last_became_peered":"2024-04-25T23:02:16.329576+0000","last_unstale":"2024-04-25T23:02:30.164160+0000","last_undegraded":"2024-04-25T23:02:16.182696+0000","last_fullsized":"2024-04-25T23:02:16.166712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083505+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:29.083505+0000","last_peered":"2024-04-25T23:02:29.083505+0000","last_clean":"2024-04-25T23:02:29.083505+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:29.083505+0000","last_undegraded":"2024-04-25T23:02:29.083505+0000","last_fullsized":"2024-04-25T23:02:29.083505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":517,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.094226+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:29.094226+0000","last_peered":"2024-04-25T23:02:29.094226+0000","last_clean":"2024-04-25T23:02:29.094226+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:29.094226+0000","last_undegraded":"2024-04-25T23:02:29.094226+0000","last_fullsized":"2024-04-25T23:02:29.094226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083578+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:29.083578+0000","last_peered":"2024-04-25T23:02:29.083578+0000","last_clean":"2024-04-25T23:02:29.083578+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:29.083578+0000","last_undegraded":"2024-04-25T23:02:29.083578+0000","last_fullsized":"2024-04-25T23:02:29.083578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":572,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164042+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:30.164042+0000","last_peered":"2024-04-25T23:02:30.164042+0000","last_clean":"2024-04-25T23:02:30.164042+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:30.164042+0000","last_undegraded":"2024-04-25T23:02:30.164042+0000","last_fullsized":"2024-04-25T23:02:30.164042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":349,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165496+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:30.165496+0000","last_peered":"2024-04-25T23:02:30.165496+0000","last_clean":"2024-04-25T23:02:30.165496+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:30.165496+0000","last_undegraded":"2024-04-25T23:02:30.165496+0000","last_fullsized":"2024-04-25T23:02:30.165496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164648+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:30.164648+0000","last_peered":"2024-04-25T23:02:30.164648+0000","last_clean":"2024-04-25T23:02:30.164648+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:30.164648+0000","last_undegraded":"2024-04-25T23:02:30.164648+0000","last_fullsized":"2024-04-25T23:02:30.164648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":418,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084297+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:29.084297+0000","last_peered":"2024-04-25T23:02:29.084297+0000","last_clean":"2024-04-25T23:02:29.084297+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:29.084297+0000","last_undegraded":"2024-04-25T23:02:29.084297+0000","last_fullsized":"2024-04-25T23:02:29.084297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":619,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083341+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:29.083341+0000","last_peered":"2024-04-25T23:02:29.083341+0000","last_clean":"2024-04-25T23:02:29.083341+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:29.083341+0000","last_undegraded":"2024-04-25T23:02:29.083341+0000","last_fullsized":"2024-04-25T23:02:29.083341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":218,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167213+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:30.167213+0000","last_peered":"2024-04-25T23:02:30.167213+0000","last_clean":"2024-04-25T23:02:30.167213+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:30.167213+0000","last_undegraded":"2024-04-25T23:02:30.167213+0000","last_fullsized":"2024-04-25T23:02:30.167213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":633,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164037+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:30.164037+0000","last_peered":"2024-04-25T23:02:30.164037+0000","last_clean":"2024-04-25T23:02:30.164037+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:30.164037+0000","last_undegraded":"2024-04-25T23:02:30.164037+0000","last_fullsized":"2024-04-25T23:02:30.164037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165774+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:30.165774+0000","last_peered":"2024-04-25T23:02:30.165774+0000","last_clean":"2024-04-25T23:02:30.165774+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:30.165774+0000","last_undegraded":"2024-04-25T23:02:30.165774+0000","last_fullsized":"2024-04-25T23:02:30.165774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3033,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4409,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":108,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111468,"kb_used_data":83932,"kb_used_omap":5,"kb_used_meta":27514,"kb_avail":94260372,"statfs":{"total":96636764160,"available":96522620928,"internally_reserved":0,"allocated":85946368,"data_stored":85511015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":28174475},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177744,"kb_used_data":80004,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94194096,"statfs":{"total":96636764160,"available":96454754304,"internally_reserved":0,"allocated":81924096,"data_stored":81508258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178884,"kb_used_data":89464,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192956,"statfs":{"total":96636764160,"available":96453586944,"internally_reserved":0,"allocated":91611136,"data_stored":91171142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:32.531 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T23:02:32.915 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3196/110 objects degraded (2905.455%), 18 pgs degraded","count":18},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":227,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":87,"num_osds":3,"num_up_osds":3,"osd_up_since":1714086134,"num_in_osds":3,"osd_in_since":1714085926,"num_remapped_pgs":15},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":18},{"state_name":"peering","count":2},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":128569219,"bytes_used":479322112,"bytes_avail":289430970368,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":3196,"degraded_total":110,"degraded_ratio":29.054545454545455,"recovering_objects_per_sec":464,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1857,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4239}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-25T23:00:12.528425+0000","services":{}},"progress_events":{}} 2024-04-25T23:02:32.933 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T23:02:32.933 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:33.238 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:33.240 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:33.256 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-04-25T23:02:33.165188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3033,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4432,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":468096,"kb_used_data":253400,"kb_used_omap":8,"kb_used_meta":214647,"kb_avail":282647424,"statfs":{"total":289910292480,"available":289430962176,"internally_reserved":0,"allocated":259481600,"data_stored":258190415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":219798549},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1094,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1071,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.996242"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":626,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165785+0000","last_change":"2024-04-25T23:02:16.336211+0000","last_active":"2024-04-25T23:02:30.165785+0000","last_peered":"2024-04-25T23:02:30.165785+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329824+0000","last_became_peered":"2024-04-25T23:02:16.329824+0000","last_unstale":"2024-04-25T23:02:30.165785+0000","last_undegraded":"2024-04-25T23:02:16.203747+0000","last_fullsized":"2024-04-25T23:02:16.195496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":613,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166060+0000","last_change":"2024-04-25T23:02:16.328918+0000","last_active":"2024-04-25T23:02:30.166060+0000","last_peered":"2024-04-25T23:02:30.166060+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.323624+0000","last_became_peered":"2024-04-25T23:02:16.323624+0000","last_unstale":"2024-04-25T23:02:30.166060+0000","last_undegraded":"2024-04-25T23:02:16.206461+0000","last_fullsized":"2024-04-25T23:02:16.185275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":542,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164829+0000","last_change":"2024-04-25T23:02:16.342187+0000","last_active":"2024-04-25T23:02:30.164829+0000","last_peered":"2024-04-25T23:02:30.164829+0000","last_clean":"2024-04-25T22:59:33.271539+0000","last_became_active":"2024-04-25T23:02:16.330924+0000","last_became_peered":"2024-04-25T23:02:16.330924+0000","last_unstale":"2024-04-25T23:02:30.164829+0000","last_undegraded":"2024-04-25T23:02:16.197400+0000","last_fullsized":"2024-04-25T23:02:16.191428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164401+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:30.164401+0000","last_peered":"2024-04-25T23:02:30.164401+0000","last_clean":"2024-04-25T23:02:30.164401+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:30.164401+0000","last_undegraded":"2024-04-25T23:02:30.164401+0000","last_fullsized":"2024-04-25T23:02:30.164401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":626,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083679+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:29.083679+0000","last_peered":"2024-04-25T23:02:29.083679+0000","last_clean":"2024-04-25T23:02:29.083679+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:29.083679+0000","last_undegraded":"2024-04-25T23:02:29.083679+0000","last_fullsized":"2024-04-25T23:02:29.083679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163971+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:30.163971+0000","last_peered":"2024-04-25T23:02:30.163971+0000","last_clean":"2024-04-25T23:02:30.163971+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:30.163971+0000","last_undegraded":"2024-04-25T23:02:30.163971+0000","last_fullsized":"2024-04-25T23:02:30.163971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163333+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:30.163333+0000","last_peered":"2024-04-25T23:02:30.163333+0000","last_clean":"2024-04-25T23:02:30.163333+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:30.163333+0000","last_undegraded":"2024-04-25T23:02:30.163333+0000","last_fullsized":"2024-04-25T23:02:30.163333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":560,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163208+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:30.163208+0000","last_peered":"2024-04-25T23:02:30.163208+0000","last_clean":"2024-04-25T23:02:30.163208+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:30.163208+0000","last_undegraded":"2024-04-25T23:02:30.163208+0000","last_fullsized":"2024-04-25T23:02:30.163208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":551,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164737+0000","last_change":"2024-04-25T23:02:16.335542+0000","last_active":"2024-04-25T23:02:30.164737+0000","last_peered":"2024-04-25T23:02:30.164737+0000","last_clean":"2024-04-25T22:59:32.892759+0000","last_became_active":"2024-04-25T23:02:16.324506+0000","last_became_peered":"2024-04-25T23:02:16.324506+0000","last_unstale":"2024-04-25T23:02:30.164737+0000","last_undegraded":"2024-04-25T23:02:16.192548+0000","last_fullsized":"2024-04-25T23:02:16.163168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":824,"reported_epoch":85,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T23:02:30.665072+0000","last_change":"2024-04-25T23:02:30.226995+0000","last_active":"2024-04-25T23:02:30.665072+0000","last_peered":"2024-04-25T23:02:30.665072+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.318360+0000","last_became_peered":"2024-04-25T23:02:16.318360+0000","last_unstale":"2024-04-25T23:02:30.665072+0000","last_undegraded":"2024-04-25T23:02:30.665072+0000","last_fullsized":"2024-04-25T23:02:16.165027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":574,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165692+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:30.165692+0000","last_peered":"2024-04-25T23:02:30.165692+0000","last_clean":"2024-04-25T23:02:30.165692+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:30.165692+0000","last_undegraded":"2024-04-25T23:02:30.165692+0000","last_fullsized":"2024-04-25T23:02:30.165692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085166+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:29.085166+0000","last_peered":"2024-04-25T23:02:29.085166+0000","last_clean":"2024-04-25T23:02:29.085166+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:29.085166+0000","last_undegraded":"2024-04-25T23:02:29.085166+0000","last_fullsized":"2024-04-25T23:02:29.085166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":509,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163262+0000","last_change":"2024-04-25T23:02:16.889283+0000","last_active":"2024-04-25T23:02:30.163262+0000","last_peered":"2024-04-25T23:02:30.163262+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.264824+0000","last_became_peered":"2024-04-25T23:02:16.264824+0000","last_unstale":"2024-04-25T23:02:30.163262+0000","last_undegraded":"2024-04-25T23:02:16.888989+0000","last_fullsized":"2024-04-25T23:02:16.163698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1006,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164294+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:30.164294+0000","last_peered":"2024-04-25T23:02:30.164294+0000","last_clean":"2024-04-25T23:02:30.164294+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:30.164294+0000","last_undegraded":"2024-04-25T23:02:30.164294+0000","last_fullsized":"2024-04-25T23:02:30.164294+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":954,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163351+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:30.163351+0000","last_peered":"2024-04-25T23:02:30.163351+0000","last_clean":"2024-04-25T23:02:30.163351+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:30.163351+0000","last_undegraded":"2024-04-25T23:02:30.163351+0000","last_fullsized":"2024-04-25T23:02:30.163351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":605,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163394+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:30.163394+0000","last_peered":"2024-04-25T23:02:30.163394+0000","last_clean":"2024-04-25T23:02:30.163394+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:30.163394+0000","last_undegraded":"2024-04-25T23:02:30.163394+0000","last_fullsized":"2024-04-25T23:02:30.163394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":665,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166129+0000","last_change":"2024-04-25T23:02:16.339646+0000","last_active":"2024-04-25T23:02:30.166129+0000","last_peered":"2024-04-25T23:02:30.166129+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:30.166129+0000","last_undegraded":"2024-04-25T23:02:16.208021+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":605,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166890+0000","last_change":"2024-04-25T23:02:16.326630+0000","last_active":"2024-04-25T23:02:30.166890+0000","last_peered":"2024-04-25T23:02:30.166890+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.321704+0000","last_became_peered":"2024-04-25T23:02:16.321704+0000","last_unstale":"2024-04-25T23:02:30.166890+0000","last_undegraded":"2024-04-25T23:02:16.201718+0000","last_fullsized":"2024-04-25T23:02:16.189024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1083,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164823+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:30.164823+0000","last_peered":"2024-04-25T23:02:30.164823+0000","last_clean":"2024-04-25T23:02:30.164823+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:30.164823+0000","last_undegraded":"2024-04-25T23:02:30.164823+0000","last_fullsized":"2024-04-25T23:02:30.164823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":576,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164687+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:30.164687+0000","last_peered":"2024-04-25T23:02:30.164687+0000","last_clean":"2024-04-25T23:02:30.164687+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:30.164687+0000","last_undegraded":"2024-04-25T23:02:30.164687+0000","last_fullsized":"2024-04-25T23:02:30.164687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":619,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164498+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:30.164498+0000","last_peered":"2024-04-25T23:02:30.164498+0000","last_clean":"2024-04-25T23:02:30.164498+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:30.164498+0000","last_undegraded":"2024-04-25T23:02:30.164498+0000","last_fullsized":"2024-04-25T23:02:30.164498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":1060,"reported_epoch":85,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:30.222658+0000","last_change":"2024-04-25T23:02:30.223078+0000","last_active":"2024-04-25T23:02:30.222658+0000","last_peered":"2024-04-25T23:02:30.222658+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.335323+0000","last_became_peered":"2024-04-25T23:02:16.335323+0000","last_unstale":"2024-04-25T23:02:30.222658+0000","last_undegraded":"2024-04-25T23:02:30.222658+0000","last_fullsized":"2024-04-25T23:02:16.174423+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":557,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162671+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:30.162671+0000","last_peered":"2024-04-25T23:02:30.162671+0000","last_clean":"2024-04-25T23:02:30.162671+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:30.162671+0000","last_undegraded":"2024-04-25T23:02:30.162671+0000","last_fullsized":"2024-04-25T23:02:30.162671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":655,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.162911+0000","last_change":"2024-04-25T23:02:16.326683+0000","last_active":"2024-04-25T23:02:30.162911+0000","last_peered":"2024-04-25T23:02:30.162911+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.320738+0000","last_became_peered":"2024-04-25T23:02:16.320738+0000","last_unstale":"2024-04-25T23:02:30.162911+0000","last_undegraded":"2024-04-25T23:02:16.182673+0000","last_fullsized":"2024-04-25T23:02:16.162015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":629,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165365+0000","last_change":"2024-04-25T23:02:16.341114+0000","last_active":"2024-04-25T23:02:30.165365+0000","last_peered":"2024-04-25T23:02:30.165365+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.332838+0000","last_became_peered":"2024-04-25T23:02:16.332838+0000","last_unstale":"2024-04-25T23:02:30.165365+0000","last_undegraded":"2024-04-25T23:02:16.188689+0000","last_fullsized":"2024-04-25T23:02:16.167898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":638,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166608+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:30.166608+0000","last_peered":"2024-04-25T23:02:30.166608+0000","last_clean":"2024-04-25T23:02:30.166608+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:30.166608+0000","last_undegraded":"2024-04-25T23:02:30.166608+0000","last_fullsized":"2024-04-25T23:02:30.166608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":577,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165975+0000","last_change":"2024-04-25T23:02:16.343238+0000","last_active":"2024-04-25T23:02:30.165975+0000","last_peered":"2024-04-25T23:02:30.165975+0000","last_clean":"2024-04-25T22:59:33.272585+0000","last_became_active":"2024-04-25T23:02:16.337943+0000","last_became_peered":"2024-04-25T23:02:16.337943+0000","last_unstale":"2024-04-25T23:02:30.165975+0000","last_undegraded":"2024-04-25T23:02:16.196378+0000","last_fullsized":"2024-04-25T23:02:16.191698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":592,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163913+0000","last_change":"2024-04-25T23:02:16.857958+0000","last_active":"2024-04-25T23:02:30.163913+0000","last_peered":"2024-04-25T23:02:30.163913+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.316513+0000","last_became_peered":"2024-04-25T23:02:16.316513+0000","last_unstale":"2024-04-25T23:02:30.163913+0000","last_undegraded":"2024-04-25T23:02:16.857683+0000","last_fullsized":"2024-04-25T23:02:16.165883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163758+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:30.163758+0000","last_peered":"2024-04-25T23:02:30.163758+0000","last_clean":"2024-04-25T23:02:30.163758+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:30.163758+0000","last_undegraded":"2024-04-25T23:02:30.163758+0000","last_fullsized":"2024-04-25T23:02:30.163758+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":599,"reported_epoch":84,"state":"peering","last_fresh":"2024-04-25T23:02:28.918197+0000","last_change":"2024-04-25T23:02:29.909540+0000","last_active":"2024-04-25T23:02:29.909540+0000","last_peered":"2024-04-25T23:02:28.918197+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.330883+0000","last_became_peered":"2024-04-25T23:02:16.330883+0000","last_unstale":"2024-04-25T23:02:28.918197+0000","last_undegraded":"2024-04-25T23:02:28.918197+0000","last_fullsized":"2024-04-25T23:02:16.165409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1016,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162848+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:30.162848+0000","last_peered":"2024-04-25T23:02:30.162848+0000","last_clean":"2024-04-25T23:02:30.162848+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:30.162848+0000","last_undegraded":"2024-04-25T23:02:30.162848+0000","last_fullsized":"2024-04-25T23:02:30.162848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165462+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:30.165462+0000","last_peered":"2024-04-25T23:02:30.165462+0000","last_clean":"2024-04-25T23:02:30.165462+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:30.165462+0000","last_undegraded":"2024-04-25T23:02:30.165462+0000","last_fullsized":"2024-04-25T23:02:30.165462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084056+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:29.084056+0000","last_peered":"2024-04-25T23:02:29.084056+0000","last_clean":"2024-04-25T23:02:29.084056+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:29.084056+0000","last_undegraded":"2024-04-25T23:02:29.084056+0000","last_fullsized":"2024-04-25T23:02:29.084056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":694,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164822+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:30.164822+0000","last_peered":"2024-04-25T23:02:30.164822+0000","last_clean":"2024-04-25T23:02:30.164822+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:30.164822+0000","last_undegraded":"2024-04-25T23:02:30.164822+0000","last_fullsized":"2024-04-25T23:02:30.164822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":552,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084521+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:29.084521+0000","last_peered":"2024-04-25T23:02:29.084521+0000","last_clean":"2024-04-25T23:02:29.084521+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:29.084521+0000","last_undegraded":"2024-04-25T23:02:29.084521+0000","last_fullsized":"2024-04-25T23:02:29.084521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":194,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163444+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:30.163444+0000","last_peered":"2024-04-25T23:02:30.163444+0000","last_clean":"2024-04-25T23:02:30.163444+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:30.163444+0000","last_undegraded":"2024-04-25T23:02:30.163444+0000","last_fullsized":"2024-04-25T23:02:30.163444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":646,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167353+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:30.167353+0000","last_peered":"2024-04-25T23:02:30.167353+0000","last_clean":"2024-04-25T23:02:30.167353+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:30.167353+0000","last_undegraded":"2024-04-25T23:02:30.167353+0000","last_fullsized":"2024-04-25T23:02:30.167353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083450+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:29.083450+0000","last_peered":"2024-04-25T23:02:29.083450+0000","last_clean":"2024-04-25T23:02:29.083450+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:29.083450+0000","last_undegraded":"2024-04-25T23:02:29.083450+0000","last_fullsized":"2024-04-25T23:02:29.083450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":605,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164747+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:30.164747+0000","last_peered":"2024-04-25T23:02:30.164747+0000","last_clean":"2024-04-25T23:02:30.164747+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:30.164747+0000","last_undegraded":"2024-04-25T23:02:30.164747+0000","last_fullsized":"2024-04-25T23:02:30.164747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163718+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:30.163718+0000","last_peered":"2024-04-25T23:02:30.163718+0000","last_clean":"2024-04-25T23:02:30.163718+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:30.163718+0000","last_undegraded":"2024-04-25T23:02:30.163718+0000","last_fullsized":"2024-04-25T23:02:30.163718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":313,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166137+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:30.166137+0000","last_peered":"2024-04-25T23:02:30.166137+0000","last_clean":"2024-04-25T23:02:30.166137+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:30.166137+0000","last_undegraded":"2024-04-25T23:02:30.166137+0000","last_fullsized":"2024-04-25T23:02:30.166137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":601,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.095907+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:29.095907+0000","last_peered":"2024-04-25T23:02:29.095907+0000","last_clean":"2024-04-25T23:02:29.095907+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:29.095907+0000","last_undegraded":"2024-04-25T23:02:29.095907+0000","last_fullsized":"2024-04-25T23:02:29.095907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":421,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084674+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:29.084674+0000","last_peered":"2024-04-25T23:02:29.084674+0000","last_clean":"2024-04-25T23:02:29.084674+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:29.084674+0000","last_undegraded":"2024-04-25T23:02:29.084674+0000","last_fullsized":"2024-04-25T23:02:29.084674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":633,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083006+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:29.083006+0000","last_peered":"2024-04-25T23:02:29.083006+0000","last_clean":"2024-04-25T23:02:29.083006+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:29.083006+0000","last_undegraded":"2024-04-25T23:02:29.083006+0000","last_fullsized":"2024-04-25T23:02:29.083006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":647,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166871+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:30.166871+0000","last_peered":"2024-04-25T23:02:30.166871+0000","last_clean":"2024-04-25T23:02:30.166871+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:30.166871+0000","last_undegraded":"2024-04-25T23:02:30.166871+0000","last_fullsized":"2024-04-25T23:02:30.166871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":592,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164627+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:30.164627+0000","last_peered":"2024-04-25T23:02:30.164627+0000","last_clean":"2024-04-25T23:02:30.164627+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:30.164627+0000","last_undegraded":"2024-04-25T23:02:30.164627+0000","last_fullsized":"2024-04-25T23:02:30.164627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":217,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166076+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:30.166076+0000","last_peered":"2024-04-25T23:02:30.166076+0000","last_clean":"2024-04-25T23:02:30.166076+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:30.166076+0000","last_undegraded":"2024-04-25T23:02:30.166076+0000","last_fullsized":"2024-04-25T23:02:30.166076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":658,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163999+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:30.163999+0000","last_peered":"2024-04-25T23:02:30.163999+0000","last_clean":"2024-04-25T23:02:30.163999+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:30.163999+0000","last_undegraded":"2024-04-25T23:02:30.163999+0000","last_fullsized":"2024-04-25T23:02:30.163999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":284,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164193+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:30.164193+0000","last_peered":"2024-04-25T23:02:30.164193+0000","last_clean":"2024-04-25T23:02:30.164193+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:30.164193+0000","last_undegraded":"2024-04-25T23:02:30.164193+0000","last_fullsized":"2024-04-25T23:02:30.164193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165640+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:30.165640+0000","last_peered":"2024-04-25T23:02:30.165640+0000","last_clean":"2024-04-25T23:02:30.165640+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:30.165640+0000","last_undegraded":"2024-04-25T23:02:30.165640+0000","last_fullsized":"2024-04-25T23:02:30.165640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":271,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164981+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:30.164981+0000","last_peered":"2024-04-25T23:02:30.164981+0000","last_clean":"2024-04-25T23:02:30.164981+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:30.164981+0000","last_undegraded":"2024-04-25T23:02:30.164981+0000","last_fullsized":"2024-04-25T23:02:30.164981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":595,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166380+0000","last_change":"2024-04-25T23:02:16.343420+0000","last_active":"2024-04-25T23:02:30.166380+0000","last_peered":"2024-04-25T23:02:30.166380+0000","last_clean":"2024-04-25T22:59:33.272608+0000","last_became_active":"2024-04-25T23:02:16.338558+0000","last_became_peered":"2024-04-25T23:02:16.338558+0000","last_unstale":"2024-04-25T23:02:30.166380+0000","last_undegraded":"2024-04-25T23:02:16.200530+0000","last_fullsized":"2024-04-25T23:02:16.197751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.082927+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:29.082927+0000","last_peered":"2024-04-25T23:02:29.082927+0000","last_clean":"2024-04-25T23:02:29.082927+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:29.082927+0000","last_undegraded":"2024-04-25T23:02:29.082927+0000","last_fullsized":"2024-04-25T23:02:29.082927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":883,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164365+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:30.164365+0000","last_peered":"2024-04-25T23:02:30.164365+0000","last_clean":"2024-04-25T23:02:30.164365+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:30.164365+0000","last_undegraded":"2024-04-25T23:02:30.164365+0000","last_fullsized":"2024-04-25T23:02:30.164365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":608,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083201+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:29.083201+0000","last_peered":"2024-04-25T23:02:29.083201+0000","last_clean":"2024-04-25T23:02:29.083201+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:29.083201+0000","last_undegraded":"2024-04-25T23:02:29.083201+0000","last_fullsized":"2024-04-25T23:02:29.083201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":560,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165104+0000","last_change":"2024-04-25T23:02:16.335886+0000","last_active":"2024-04-25T23:02:30.165104+0000","last_peered":"2024-04-25T23:02:30.165104+0000","last_clean":"2024-04-25T22:59:32.892903+0000","last_became_active":"2024-04-25T23:02:16.325195+0000","last_became_peered":"2024-04-25T23:02:16.325195+0000","last_unstale":"2024-04-25T23:02:30.165104+0000","last_undegraded":"2024-04-25T23:02:16.191750+0000","last_fullsized":"2024-04-25T23:02:16.173053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":362,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165545+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:30.165545+0000","last_peered":"2024-04-25T23:02:30.165545+0000","last_clean":"2024-04-25T23:02:30.165545+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:30.165545+0000","last_undegraded":"2024-04-25T23:02:30.165545+0000","last_fullsized":"2024-04-25T23:02:30.165545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165886+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:30.165886+0000","last_peered":"2024-04-25T23:02:30.165886+0000","last_clean":"2024-04-25T23:02:30.165886+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:30.165886+0000","last_undegraded":"2024-04-25T23:02:30.165886+0000","last_fullsized":"2024-04-25T23:02:30.165886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":787,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163679+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:30.163679+0000","last_peered":"2024-04-25T23:02:30.163679+0000","last_clean":"2024-04-25T23:02:30.163679+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:30.163679+0000","last_undegraded":"2024-04-25T23:02:30.163679+0000","last_fullsized":"2024-04-25T23:02:30.163679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":645,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.166605+0000","last_change":"2024-04-25T23:02:16.345583+0000","last_active":"2024-04-25T23:02:30.166605+0000","last_peered":"2024-04-25T23:02:30.166605+0000","last_clean":"2024-04-25T22:59:33.272809+0000","last_became_active":"2024-04-25T23:02:16.342554+0000","last_became_peered":"2024-04-25T23:02:16.342554+0000","last_unstale":"2024-04-25T23:02:30.166605+0000","last_undegraded":"2024-04-25T23:02:16.202781+0000","last_fullsized":"2024-04-25T23:02:16.198394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165291+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:30.165291+0000","last_peered":"2024-04-25T23:02:30.165291+0000","last_clean":"2024-04-25T23:02:30.165291+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:30.165291+0000","last_undegraded":"2024-04-25T23:02:30.165291+0000","last_fullsized":"2024-04-25T23:02:30.165291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":339,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163318+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:30.163318+0000","last_peered":"2024-04-25T23:02:30.163318+0000","last_clean":"2024-04-25T23:02:30.163318+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:30.163318+0000","last_undegraded":"2024-04-25T23:02:30.163318+0000","last_fullsized":"2024-04-25T23:02:30.163318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":982,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:29.561481+0000","last_change":"2024-04-25T23:02:29.562004+0000","last_active":"2024-04-25T23:02:29.561481+0000","last_peered":"2024-04-25T23:02:29.561481+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.318001+0000","last_became_peered":"2024-04-25T23:02:16.318001+0000","last_unstale":"2024-04-25T23:02:29.561481+0000","last_undegraded":"2024-04-25T23:02:29.561481+0000","last_fullsized":"2024-04-25T23:02:16.167634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163664+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:30.163664+0000","last_peered":"2024-04-25T23:02:30.163664+0000","last_clean":"2024-04-25T23:02:30.163664+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:30.163664+0000","last_undegraded":"2024-04-25T23:02:30.163664+0000","last_fullsized":"2024-04-25T23:02:30.163664+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":471,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.082682+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:29.082682+0000","last_peered":"2024-04-25T23:02:29.082682+0000","last_clean":"2024-04-25T23:02:29.082682+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:29.082682+0000","last_undegraded":"2024-04-25T23:02:29.082682+0000","last_fullsized":"2024-04-25T23:02:29.082682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":545,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.165324+0000","last_change":"2024-04-25T23:02:16.336587+0000","last_active":"2024-04-25T23:02:30.165324+0000","last_peered":"2024-04-25T23:02:30.165324+0000","last_clean":"2024-04-25T22:59:32.893156+0000","last_became_active":"2024-04-25T23:02:16.330744+0000","last_became_peered":"2024-04-25T23:02:16.330744+0000","last_unstale":"2024-04-25T23:02:30.165324+0000","last_undegraded":"2024-04-25T23:02:16.203382+0000","last_fullsized":"2024-04-25T23:02:16.192794+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165189+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:30.165189+0000","last_peered":"2024-04-25T23:02:30.165189+0000","last_clean":"2024-04-25T23:02:30.165189+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:30.165189+0000","last_undegraded":"2024-04-25T23:02:30.165189+0000","last_fullsized":"2024-04-25T23:02:30.165189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165103+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:30.165103+0000","last_peered":"2024-04-25T23:02:30.165103+0000","last_clean":"2024-04-25T23:02:30.165103+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:30.165103+0000","last_undegraded":"2024-04-25T23:02:30.165103+0000","last_fullsized":"2024-04-25T23:02:30.165103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":909,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.173119+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:30.173119+0000","last_peered":"2024-04-25T23:02:30.173119+0000","last_clean":"2024-04-25T23:02:30.173119+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:30.173119+0000","last_undegraded":"2024-04-25T23:02:30.173119+0000","last_fullsized":"2024-04-25T23:02:30.173119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":426,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167014+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:30.167014+0000","last_peered":"2024-04-25T23:02:30.167014+0000","last_clean":"2024-04-25T23:02:30.167014+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:30.167014+0000","last_undegraded":"2024-04-25T23:02:30.167014+0000","last_fullsized":"2024-04-25T23:02:30.167014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165139+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:30.165139+0000","last_peered":"2024-04-25T23:02:30.165139+0000","last_clean":"2024-04-25T23:02:30.165139+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:30.165139+0000","last_undegraded":"2024-04-25T23:02:30.165139+0000","last_fullsized":"2024-04-25T23:02:30.165139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.086087+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:29.086087+0000","last_peered":"2024-04-25T23:02:29.086087+0000","last_clean":"2024-04-25T23:02:29.086087+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:29.086087+0000","last_undegraded":"2024-04-25T23:02:29.086087+0000","last_fullsized":"2024-04-25T23:02:29.086087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":203,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164826+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:30.164826+0000","last_peered":"2024-04-25T23:02:30.164826+0000","last_clean":"2024-04-25T23:02:30.164826+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:30.164826+0000","last_undegraded":"2024-04-25T23:02:30.164826+0000","last_fullsized":"2024-04-25T23:02:30.164826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085540+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:29.085540+0000","last_peered":"2024-04-25T23:02:29.085540+0000","last_clean":"2024-04-25T23:02:29.085540+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:29.085540+0000","last_undegraded":"2024-04-25T23:02:29.085540+0000","last_fullsized":"2024-04-25T23:02:29.085540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":582,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083398+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:29.083398+0000","last_peered":"2024-04-25T23:02:29.083398+0000","last_clean":"2024-04-25T23:02:29.083398+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:29.083398+0000","last_undegraded":"2024-04-25T23:02:29.083398+0000","last_fullsized":"2024-04-25T23:02:29.083398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":214,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166182+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:30.166182+0000","last_peered":"2024-04-25T23:02:30.166182+0000","last_clean":"2024-04-25T23:02:30.166182+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:30.166182+0000","last_undegraded":"2024-04-25T23:02:30.166182+0000","last_fullsized":"2024-04-25T23:02:30.166182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167629+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:30.167629+0000","last_peered":"2024-04-25T23:02:30.167629+0000","last_clean":"2024-04-25T23:02:30.167629+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:30.167629+0000","last_undegraded":"2024-04-25T23:02:30.167629+0000","last_fullsized":"2024-04-25T23:02:30.167629+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163666+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:30.163666+0000","last_peered":"2024-04-25T23:02:30.163666+0000","last_clean":"2024-04-25T23:02:30.163666+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:30.163666+0000","last_undegraded":"2024-04-25T23:02:30.163666+0000","last_fullsized":"2024-04-25T23:02:30.163666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167483+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:30.167483+0000","last_peered":"2024-04-25T23:02:30.167483+0000","last_clean":"2024-04-25T23:02:30.167483+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:30.167483+0000","last_undegraded":"2024-04-25T23:02:30.167483+0000","last_fullsized":"2024-04-25T23:02:30.167483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166389+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:30.166389+0000","last_peered":"2024-04-25T23:02:30.166389+0000","last_clean":"2024-04-25T23:02:30.166389+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:30.166389+0000","last_undegraded":"2024-04-25T23:02:30.166389+0000","last_fullsized":"2024-04-25T23:02:30.166389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083681+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:29.083681+0000","last_peered":"2024-04-25T23:02:29.083681+0000","last_clean":"2024-04-25T23:02:29.083681+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:29.083681+0000","last_undegraded":"2024-04-25T23:02:29.083681+0000","last_fullsized":"2024-04-25T23:02:29.083681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164344+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:30.164344+0000","last_peered":"2024-04-25T23:02:30.164344+0000","last_clean":"2024-04-25T23:02:30.164344+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:30.164344+0000","last_undegraded":"2024-04-25T23:02:30.164344+0000","last_fullsized":"2024-04-25T23:02:30.164344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":413,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165791+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:30.165791+0000","last_peered":"2024-04-25T23:02:30.165791+0000","last_clean":"2024-04-25T23:02:30.165791+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:30.165791+0000","last_undegraded":"2024-04-25T23:02:30.165791+0000","last_fullsized":"2024-04-25T23:02:30.165791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":972,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163132+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:30.163132+0000","last_peered":"2024-04-25T23:02:30.163132+0000","last_clean":"2024-04-25T23:02:30.163132+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:30.163132+0000","last_undegraded":"2024-04-25T23:02:30.163132+0000","last_fullsized":"2024-04-25T23:02:30.163132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084819+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:29.084819+0000","last_peered":"2024-04-25T23:02:29.084819+0000","last_clean":"2024-04-25T23:02:29.084819+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:29.084819+0000","last_undegraded":"2024-04-25T23:02:29.084819+0000","last_fullsized":"2024-04-25T23:02:29.084819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165471+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:30.165471+0000","last_peered":"2024-04-25T23:02:30.165471+0000","last_clean":"2024-04-25T23:02:30.165471+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:30.165471+0000","last_undegraded":"2024-04-25T23:02:30.165471+0000","last_fullsized":"2024-04-25T23:02:30.165471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":652,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.162972+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:30.162972+0000","last_peered":"2024-04-25T23:02:30.162972+0000","last_clean":"2024-04-25T23:02:30.162972+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:30.162972+0000","last_undegraded":"2024-04-25T23:02:30.162972+0000","last_fullsized":"2024-04-25T23:02:30.162972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165944+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:30.165944+0000","last_peered":"2024-04-25T23:02:30.165944+0000","last_clean":"2024-04-25T23:02:30.165944+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:30.165944+0000","last_undegraded":"2024-04-25T23:02:30.165944+0000","last_fullsized":"2024-04-25T23:02:30.165944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":616,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.163052+0000","last_change":"2024-04-25T23:02:16.326390+0000","last_active":"2024-04-25T23:02:30.163052+0000","last_peered":"2024-04-25T23:02:30.163052+0000","last_clean":"2024-04-25T22:59:32.891227+0000","last_became_active":"2024-04-25T23:02:16.320796+0000","last_became_peered":"2024-04-25T23:02:16.320796+0000","last_unstale":"2024-04-25T23:02:30.163052+0000","last_undegraded":"2024-04-25T23:02:16.200450+0000","last_fullsized":"2024-04-25T23:02:16.183515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.085396+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:29.085396+0000","last_peered":"2024-04-25T23:02:29.085396+0000","last_clean":"2024-04-25T23:02:29.085396+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:29.085396+0000","last_undegraded":"2024-04-25T23:02:29.085396+0000","last_fullsized":"2024-04-25T23:02:29.085396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":731,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163988+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:30.163988+0000","last_peered":"2024-04-25T23:02:30.163988+0000","last_clean":"2024-04-25T23:02:30.163988+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:30.163988+0000","last_undegraded":"2024-04-25T23:02:30.163988+0000","last_fullsized":"2024-04-25T23:02:30.163988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.166451+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:30.166451+0000","last_peered":"2024-04-25T23:02:30.166451+0000","last_clean":"2024-04-25T23:02:30.166451+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:30.166451+0000","last_undegraded":"2024-04-25T23:02:30.166451+0000","last_fullsized":"2024-04-25T23:02:30.166451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":349,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.163265+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:30.163265+0000","last_peered":"2024-04-25T23:02:30.163265+0000","last_clean":"2024-04-25T23:02:30.163265+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:30.163265+0000","last_undegraded":"2024-04-25T23:02:30.163265+0000","last_fullsized":"2024-04-25T23:02:30.163265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":596,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.164160+0000","last_change":"2024-04-25T23:02:16.342038+0000","last_active":"2024-04-25T23:02:30.164160+0000","last_peered":"2024-04-25T23:02:30.164160+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329576+0000","last_became_peered":"2024-04-25T23:02:16.329576+0000","last_unstale":"2024-04-25T23:02:30.164160+0000","last_undegraded":"2024-04-25T23:02:16.182696+0000","last_fullsized":"2024-04-25T23:02:16.166712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":354,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083505+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:29.083505+0000","last_peered":"2024-04-25T23:02:29.083505+0000","last_clean":"2024-04-25T23:02:29.083505+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:29.083505+0000","last_undegraded":"2024-04-25T23:02:29.083505+0000","last_fullsized":"2024-04-25T23:02:29.083505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":517,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.094226+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:29.094226+0000","last_peered":"2024-04-25T23:02:29.094226+0000","last_clean":"2024-04-25T23:02:29.094226+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:29.094226+0000","last_undegraded":"2024-04-25T23:02:29.094226+0000","last_fullsized":"2024-04-25T23:02:29.094226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083578+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:29.083578+0000","last_peered":"2024-04-25T23:02:29.083578+0000","last_clean":"2024-04-25T23:02:29.083578+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:29.083578+0000","last_undegraded":"2024-04-25T23:02:29.083578+0000","last_fullsized":"2024-04-25T23:02:29.083578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":572,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164042+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:30.164042+0000","last_peered":"2024-04-25T23:02:30.164042+0000","last_clean":"2024-04-25T23:02:30.164042+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:30.164042+0000","last_undegraded":"2024-04-25T23:02:30.164042+0000","last_fullsized":"2024-04-25T23:02:30.164042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":349,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165496+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:30.165496+0000","last_peered":"2024-04-25T23:02:30.165496+0000","last_clean":"2024-04-25T23:02:30.165496+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:30.165496+0000","last_undegraded":"2024-04-25T23:02:30.165496+0000","last_fullsized":"2024-04-25T23:02:30.165496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164648+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:30.164648+0000","last_peered":"2024-04-25T23:02:30.164648+0000","last_clean":"2024-04-25T23:02:30.164648+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:30.164648+0000","last_undegraded":"2024-04-25T23:02:30.164648+0000","last_fullsized":"2024-04-25T23:02:30.164648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":418,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.084297+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:29.084297+0000","last_peered":"2024-04-25T23:02:29.084297+0000","last_clean":"2024-04-25T23:02:29.084297+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:29.084297+0000","last_undegraded":"2024-04-25T23:02:29.084297+0000","last_fullsized":"2024-04-25T23:02:29.084297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":619,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T23:02:29.083341+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:29.083341+0000","last_peered":"2024-04-25T23:02:29.083341+0000","last_clean":"2024-04-25T23:02:29.083341+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:29.083341+0000","last_undegraded":"2024-04-25T23:02:29.083341+0000","last_fullsized":"2024-04-25T23:02:29.083341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":218,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.167213+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:30.167213+0000","last_peered":"2024-04-25T23:02:30.167213+0000","last_clean":"2024-04-25T23:02:30.167213+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:30.167213+0000","last_undegraded":"2024-04-25T23:02:30.167213+0000","last_fullsized":"2024-04-25T23:02:30.167213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":633,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.164037+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:30.164037+0000","last_peered":"2024-04-25T23:02:30.164037+0000","last_clean":"2024-04-25T23:02:30.164037+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:30.164037+0000","last_undegraded":"2024-04-25T23:02:30.164037+0000","last_fullsized":"2024-04-25T23:02:30.164037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T23:02:30.165774+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:30.165774+0000","last_peered":"2024-04-25T23:02:30.165774+0000","last_clean":"2024-04-25T23:02:30.165774+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:30.165774+0000","last_undegraded":"2024-04-25T23:02:30.165774+0000","last_fullsized":"2024-04-25T23:02:30.165774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3033,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4409,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":108,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111468,"kb_used_data":83932,"kb_used_omap":5,"kb_used_meta":27514,"kb_avail":94260372,"statfs":{"total":96636764160,"available":96522620928,"internally_reserved":0,"allocated":85946368,"data_stored":85511015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":28174475},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177744,"kb_used_data":80004,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94194096,"statfs":{"total":96636764160,"available":96454754304,"internally_reserved":0,"allocated":81924096,"data_stored":81508258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178884,"kb_used_data":89464,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192956,"statfs":{"total":96636764160,"available":96453586944,"internally_reserved":0,"allocated":91611136,"data_stored":91171142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:36.261 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:36.591 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:36.593 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:36.611 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-25T23:02:36.164318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1601,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5838,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":199,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":476588,"kb_used_data":253556,"kb_used_omap":8,"kb_used_meta":222967,"kb_avail":282638932,"statfs":{"total":289910292480,"available":289422266368,"internally_reserved":0,"allocated":259641344,"data_stored":258251115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":228318229},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1432,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1406,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001401"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":636,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.170255+0000","last_change":"2024-04-25T23:02:16.336211+0000","last_active":"2024-04-25T23:02:35.170255+0000","last_peered":"2024-04-25T23:02:35.170255+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329824+0000","last_became_peered":"2024-04-25T23:02:16.329824+0000","last_unstale":"2024-04-25T23:02:35.170255+0000","last_undegraded":"2024-04-25T23:02:16.203747+0000","last_fullsized":"2024-04-25T23:02:16.195496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":981,"reported_epoch":90,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:35.231277+0000","last_change":"2024-04-25T23:02:35.231777+0000","last_active":"2024-04-25T23:02:35.231277+0000","last_peered":"2024-04-25T23:02:35.231277+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.323624+0000","last_became_peered":"2024-04-25T23:02:16.323624+0000","last_unstale":"2024-04-25T23:02:35.231277+0000","last_undegraded":"2024-04-25T23:02:35.231277+0000","last_fullsized":"2024-04-25T23:02:16.185275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":897,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.178275+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:35.178275+0000","last_peered":"2024-04-25T23:02:35.178275+0000","last_clean":"2024-04-25T23:02:35.178275+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:35.178275+0000","last_undegraded":"2024-04-25T23:02:35.178275+0000","last_fullsized":"2024-04-25T23:02:35.178275+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171542+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:35.171542+0000","last_peered":"2024-04-25T23:02:35.171542+0000","last_clean":"2024-04-25T23:02:35.171542+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:35.171542+0000","last_undegraded":"2024-04-25T23:02:35.171542+0000","last_fullsized":"2024-04-25T23:02:35.171542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":634,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.082863+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:33.082863+0000","last_peered":"2024-04-25T23:02:33.082863+0000","last_clean":"2024-04-25T23:02:33.082863+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:33.082863+0000","last_undegraded":"2024-04-25T23:02:33.082863+0000","last_fullsized":"2024-04-25T23:02:33.082863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":537,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171057+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:35.171057+0000","last_peered":"2024-04-25T23:02:35.171057+0000","last_clean":"2024-04-25T23:02:35.171057+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:35.171057+0000","last_undegraded":"2024-04-25T23:02:35.171057+0000","last_fullsized":"2024-04-25T23:02:35.171057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":576,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170594+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:35.170594+0000","last_peered":"2024-04-25T23:02:35.170594+0000","last_clean":"2024-04-25T23:02:35.170594+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:35.170594+0000","last_undegraded":"2024-04-25T23:02:35.170594+0000","last_fullsized":"2024-04-25T23:02:35.170594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":570,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170282+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:35.170282+0000","last_peered":"2024-04-25T23:02:35.170282+0000","last_clean":"2024-04-25T23:02:35.170282+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:35.170282+0000","last_undegraded":"2024-04-25T23:02:35.170282+0000","last_fullsized":"2024-04-25T23:02:35.170282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":561,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.168840+0000","last_change":"2024-04-25T23:02:16.335542+0000","last_active":"2024-04-25T23:02:35.168840+0000","last_peered":"2024-04-25T23:02:35.168840+0000","last_clean":"2024-04-25T22:59:32.892759+0000","last_became_active":"2024-04-25T23:02:16.324506+0000","last_became_peered":"2024-04-25T23:02:16.324506+0000","last_unstale":"2024-04-25T23:02:35.168840+0000","last_undegraded":"2024-04-25T23:02:16.192548+0000","last_fullsized":"2024-04-25T23:02:16.163168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":523,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086835+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:33.086835+0000","last_peered":"2024-04-25T23:02:33.086835+0000","last_clean":"2024-04-25T23:02:33.086835+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:33.086835+0000","last_undegraded":"2024-04-25T23:02:33.086835+0000","last_fullsized":"2024-04-25T23:02:33.086835+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":584,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172557+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:35.172557+0000","last_peered":"2024-04-25T23:02:35.172557+0000","last_clean":"2024-04-25T23:02:35.172557+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:35.172557+0000","last_undegraded":"2024-04-25T23:02:35.172557+0000","last_fullsized":"2024-04-25T23:02:35.172557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":506,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085938+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:33.085938+0000","last_peered":"2024-04-25T23:02:33.085938+0000","last_clean":"2024-04-25T23:02:33.085938+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:33.085938+0000","last_undegraded":"2024-04-25T23:02:33.085938+0000","last_fullsized":"2024-04-25T23:02:33.085938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":519,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.166950+0000","last_change":"2024-04-25T23:02:16.889283+0000","last_active":"2024-04-25T23:02:35.166950+0000","last_peered":"2024-04-25T23:02:35.166950+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.264824+0000","last_became_peered":"2024-04-25T23:02:16.264824+0000","last_unstale":"2024-04-25T23:02:35.166950+0000","last_undegraded":"2024-04-25T23:02:16.888989+0000","last_fullsized":"2024-04-25T23:02:16.163698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1016,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171380+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:35.171380+0000","last_peered":"2024-04-25T23:02:35.171380+0000","last_clean":"2024-04-25T23:02:35.171380+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:35.171380+0000","last_undegraded":"2024-04-25T23:02:35.171380+0000","last_fullsized":"2024-04-25T23:02:35.171380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":964,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170671+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:35.170671+0000","last_peered":"2024-04-25T23:02:35.170671+0000","last_clean":"2024-04-25T23:02:35.170671+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:35.170671+0000","last_undegraded":"2024-04-25T23:02:35.170671+0000","last_fullsized":"2024-04-25T23:02:35.170671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":615,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170298+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:35.170298+0000","last_peered":"2024-04-25T23:02:35.170298+0000","last_clean":"2024-04-25T23:02:35.170298+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:35.170298+0000","last_undegraded":"2024-04-25T23:02:35.170298+0000","last_fullsized":"2024-04-25T23:02:35.170298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":675,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.170550+0000","last_change":"2024-04-25T23:02:16.339646+0000","last_active":"2024-04-25T23:02:35.170550+0000","last_peered":"2024-04-25T23:02:35.170550+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:35.170550+0000","last_undegraded":"2024-04-25T23:02:16.208021+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":575,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-25T23:02:32.972690+0000","last_change":"2024-04-25T23:02:33.650876+0000","last_active":"2024-04-25T23:02:33.650876+0000","last_peered":"2024-04-25T23:02:32.972690+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.321704+0000","last_became_peered":"2024-04-25T23:02:16.321704+0000","last_unstale":"2024-04-25T23:02:32.972690+0000","last_undegraded":"2024-04-25T23:02:32.972690+0000","last_fullsized":"2024-04-25T23:02:16.189024+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1093,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168513+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:35.168513+0000","last_peered":"2024-04-25T23:02:35.168513+0000","last_clean":"2024-04-25T23:02:35.168513+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:35.168513+0000","last_undegraded":"2024-04-25T23:02:35.168513+0000","last_fullsized":"2024-04-25T23:02:35.168513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":586,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171833+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:35.171833+0000","last_peered":"2024-04-25T23:02:35.171833+0000","last_clean":"2024-04-25T23:02:35.171833+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:35.171833+0000","last_undegraded":"2024-04-25T23:02:35.171833+0000","last_fullsized":"2024-04-25T23:02:35.171833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":629,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172441+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:35.172441+0000","last_peered":"2024-04-25T23:02:35.172441+0000","last_clean":"2024-04-25T23:02:35.172441+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:35.172441+0000","last_undegraded":"2024-04-25T23:02:35.172441+0000","last_fullsized":"2024-04-25T23:02:35.172441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":650,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085319+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:33.085319+0000","last_peered":"2024-04-25T23:02:33.085319+0000","last_clean":"2024-04-25T23:02:33.085319+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:33.085319+0000","last_undegraded":"2024-04-25T23:02:33.085319+0000","last_fullsized":"2024-04-25T23:02:33.085319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":567,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166345+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:35.166345+0000","last_peered":"2024-04-25T23:02:35.166345+0000","last_clean":"2024-04-25T23:02:35.166345+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:35.166345+0000","last_undegraded":"2024-04-25T23:02:35.166345+0000","last_fullsized":"2024-04-25T23:02:35.166345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":655,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.162911+0000","last_change":"2024-04-25T23:02:16.326683+0000","last_active":"2024-04-25T23:02:30.162911+0000","last_peered":"2024-04-25T23:02:30.162911+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.320738+0000","last_became_peered":"2024-04-25T23:02:16.320738+0000","last_unstale":"2024-04-25T23:02:30.162911+0000","last_undegraded":"2024-04-25T23:02:16.182673+0000","last_fullsized":"2024-04-25T23:02:16.162015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":607,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.098058+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:33.098058+0000","last_peered":"2024-04-25T23:02:33.098058+0000","last_clean":"2024-04-25T23:02:33.098058+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:33.098058+0000","last_undegraded":"2024-04-25T23:02:33.098058+0000","last_fullsized":"2024-04-25T23:02:33.098058+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":648,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169017+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:35.169017+0000","last_peered":"2024-04-25T23:02:35.169017+0000","last_clean":"2024-04-25T23:02:35.169017+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:35.169017+0000","last_undegraded":"2024-04-25T23:02:35.169017+0000","last_fullsized":"2024-04-25T23:02:35.169017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":932,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-25T23:02:34.749779+0000","last_change":"2024-04-25T23:02:35.173425+0000","last_active":"2024-04-25T23:02:35.173425+0000","last_peered":"2024-04-25T23:02:34.749779+0000","last_clean":"2024-04-25T22:59:33.272585+0000","last_became_active":"2024-04-25T23:02:16.337943+0000","last_became_peered":"2024-04-25T23:02:16.337943+0000","last_unstale":"2024-04-25T23:02:34.749779+0000","last_undegraded":"2024-04-25T23:02:34.749779+0000","last_fullsized":"2024-04-25T23:02:16.191698+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":602,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.171176+0000","last_change":"2024-04-25T23:02:16.857958+0000","last_active":"2024-04-25T23:02:35.171176+0000","last_peered":"2024-04-25T23:02:35.171176+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.316513+0000","last_became_peered":"2024-04-25T23:02:16.316513+0000","last_unstale":"2024-04-25T23:02:35.171176+0000","last_undegraded":"2024-04-25T23:02:16.857683+0000","last_fullsized":"2024-04-25T23:02:16.165883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":935,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167442+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:35.167442+0000","last_peered":"2024-04-25T23:02:35.167442+0000","last_clean":"2024-04-25T23:02:35.167442+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:35.167442+0000","last_undegraded":"2024-04-25T23:02:35.167442+0000","last_fullsized":"2024-04-25T23:02:35.167442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":613,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084747+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:33.084747+0000","last_peered":"2024-04-25T23:02:33.084747+0000","last_clean":"2024-04-25T23:02:33.084747+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:33.084747+0000","last_undegraded":"2024-04-25T23:02:33.084747+0000","last_fullsized":"2024-04-25T23:02:33.084747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1026,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166517+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:35.166517+0000","last_peered":"2024-04-25T23:02:35.166517+0000","last_clean":"2024-04-25T23:02:35.166517+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:35.166517+0000","last_undegraded":"2024-04-25T23:02:35.166517+0000","last_fullsized":"2024-04-25T23:02:35.166517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":676,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170521+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:35.170521+0000","last_peered":"2024-04-25T23:02:35.170521+0000","last_clean":"2024-04-25T23:02:35.170521+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:35.170521+0000","last_undegraded":"2024-04-25T23:02:35.170521+0000","last_fullsized":"2024-04-25T23:02:35.170521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":633,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084985+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:33.084985+0000","last_peered":"2024-04-25T23:02:33.084985+0000","last_clean":"2024-04-25T23:02:33.084985+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:33.084985+0000","last_undegraded":"2024-04-25T23:02:33.084985+0000","last_fullsized":"2024-04-25T23:02:33.084985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":704,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172754+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:35.172754+0000","last_peered":"2024-04-25T23:02:35.172754+0000","last_clean":"2024-04-25T23:02:35.172754+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:35.172754+0000","last_undegraded":"2024-04-25T23:02:35.172754+0000","last_fullsized":"2024-04-25T23:02:35.172754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086868+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:33.086868+0000","last_peered":"2024-04-25T23:02:33.086868+0000","last_clean":"2024-04-25T23:02:33.086868+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:33.086868+0000","last_undegraded":"2024-04-25T23:02:33.086868+0000","last_fullsized":"2024-04-25T23:02:33.086868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":204,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167034+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:35.167034+0000","last_peered":"2024-04-25T23:02:35.167034+0000","last_clean":"2024-04-25T23:02:35.167034+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:35.167034+0000","last_undegraded":"2024-04-25T23:02:35.167034+0000","last_fullsized":"2024-04-25T23:02:35.167034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":656,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169386+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:35.169386+0000","last_peered":"2024-04-25T23:02:35.169386+0000","last_clean":"2024-04-25T23:02:35.169386+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:35.169386+0000","last_undegraded":"2024-04-25T23:02:35.169386+0000","last_fullsized":"2024-04-25T23:02:35.169386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083819+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:33.083819+0000","last_peered":"2024-04-25T23:02:33.083819+0000","last_clean":"2024-04-25T23:02:33.083819+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:33.083819+0000","last_undegraded":"2024-04-25T23:02:33.083819+0000","last_fullsized":"2024-04-25T23:02:33.083819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":615,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168892+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:35.168892+0000","last_peered":"2024-04-25T23:02:35.168892+0000","last_clean":"2024-04-25T23:02:35.168892+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:35.168892+0000","last_undegraded":"2024-04-25T23:02:35.168892+0000","last_fullsized":"2024-04-25T23:02:35.168892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170613+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:35.170613+0000","last_peered":"2024-04-25T23:02:35.170613+0000","last_clean":"2024-04-25T23:02:35.170613+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:35.170613+0000","last_undegraded":"2024-04-25T23:02:35.170613+0000","last_fullsized":"2024-04-25T23:02:35.170613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":323,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173249+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:35.173249+0000","last_peered":"2024-04-25T23:02:35.173249+0000","last_clean":"2024-04-25T23:02:35.173249+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:35.173249+0000","last_undegraded":"2024-04-25T23:02:35.173249+0000","last_fullsized":"2024-04-25T23:02:35.173249+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":609,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084102+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:33.084102+0000","last_peered":"2024-04-25T23:02:33.084102+0000","last_clean":"2024-04-25T23:02:33.084102+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:33.084102+0000","last_undegraded":"2024-04-25T23:02:33.084102+0000","last_fullsized":"2024-04-25T23:02:33.084102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":429,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086450+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:33.086450+0000","last_peered":"2024-04-25T23:02:33.086450+0000","last_clean":"2024-04-25T23:02:33.086450+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:33.086450+0000","last_undegraded":"2024-04-25T23:02:33.086450+0000","last_fullsized":"2024-04-25T23:02:33.086450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":641,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083286+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:33.083286+0000","last_peered":"2024-04-25T23:02:33.083286+0000","last_clean":"2024-04-25T23:02:33.083286+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:33.083286+0000","last_undegraded":"2024-04-25T23:02:33.083286+0000","last_fullsized":"2024-04-25T23:02:33.083286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":657,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.174855+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:35.174855+0000","last_peered":"2024-04-25T23:02:35.174855+0000","last_clean":"2024-04-25T23:02:35.174855+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:35.174855+0000","last_undegraded":"2024-04-25T23:02:35.174855+0000","last_fullsized":"2024-04-25T23:02:35.174855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":602,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171436+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:35.171436+0000","last_peered":"2024-04-25T23:02:35.171436+0000","last_clean":"2024-04-25T23:02:35.171436+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:35.171436+0000","last_undegraded":"2024-04-25T23:02:35.171436+0000","last_fullsized":"2024-04-25T23:02:35.171436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":227,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172718+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:35.172718+0000","last_peered":"2024-04-25T23:02:35.172718+0000","last_clean":"2024-04-25T23:02:35.172718+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:35.172718+0000","last_undegraded":"2024-04-25T23:02:35.172718+0000","last_fullsized":"2024-04-25T23:02:35.172718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":668,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167865+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:35.167865+0000","last_peered":"2024-04-25T23:02:35.167865+0000","last_clean":"2024-04-25T23:02:35.167865+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:35.167865+0000","last_undegraded":"2024-04-25T23:02:35.167865+0000","last_fullsized":"2024-04-25T23:02:35.167865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168011+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:35.168011+0000","last_peered":"2024-04-25T23:02:35.168011+0000","last_clean":"2024-04-25T23:02:35.168011+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:35.168011+0000","last_undegraded":"2024-04-25T23:02:35.168011+0000","last_fullsized":"2024-04-25T23:02:35.168011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":624,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172119+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:35.172119+0000","last_peered":"2024-04-25T23:02:35.172119+0000","last_clean":"2024-04-25T23:02:35.172119+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:35.172119+0000","last_undegraded":"2024-04-25T23:02:35.172119+0000","last_fullsized":"2024-04-25T23:02:35.172119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":281,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172225+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:35.172225+0000","last_peered":"2024-04-25T23:02:35.172225+0000","last_clean":"2024-04-25T23:02:35.172225+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:35.172225+0000","last_undegraded":"2024-04-25T23:02:35.172225+0000","last_fullsized":"2024-04-25T23:02:35.172225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":868,"reported_epoch":90,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T23:02:35.641736+0000","last_change":"2024-04-25T23:02:35.235425+0000","last_active":"2024-04-25T23:02:35.641736+0000","last_peered":"2024-04-25T23:02:35.641736+0000","last_clean":"2024-04-25T22:59:33.272608+0000","last_became_active":"2024-04-25T23:02:16.338558+0000","last_became_peered":"2024-04-25T23:02:16.338558+0000","last_unstale":"2024-04-25T23:02:35.641736+0000","last_undegraded":"2024-04-25T23:02:35.641736+0000","last_fullsized":"2024-04-25T23:02:16.197751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083298+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:33.083298+0000","last_peered":"2024-04-25T23:02:33.083298+0000","last_clean":"2024-04-25T23:02:33.083298+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:33.083298+0000","last_undegraded":"2024-04-25T23:02:33.083298+0000","last_fullsized":"2024-04-25T23:02:33.083298+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":893,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172760+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:35.172760+0000","last_peered":"2024-04-25T23:02:35.172760+0000","last_clean":"2024-04-25T23:02:35.172760+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:35.172760+0000","last_undegraded":"2024-04-25T23:02:35.172760+0000","last_fullsized":"2024-04-25T23:02:35.172760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":616,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084063+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:33.084063+0000","last_peered":"2024-04-25T23:02:33.084063+0000","last_clean":"2024-04-25T23:02:33.084063+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:33.084063+0000","last_undegraded":"2024-04-25T23:02:33.084063+0000","last_fullsized":"2024-04-25T23:02:33.084063+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":570,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.169220+0000","last_change":"2024-04-25T23:02:16.335886+0000","last_active":"2024-04-25T23:02:35.169220+0000","last_peered":"2024-04-25T23:02:35.169220+0000","last_clean":"2024-04-25T22:59:32.892903+0000","last_became_active":"2024-04-25T23:02:16.325195+0000","last_became_peered":"2024-04-25T23:02:16.325195+0000","last_unstale":"2024-04-25T23:02:35.169220+0000","last_undegraded":"2024-04-25T23:02:16.191750+0000","last_fullsized":"2024-04-25T23:02:16.173053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":372,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172175+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:35.172175+0000","last_peered":"2024-04-25T23:02:35.172175+0000","last_clean":"2024-04-25T23:02:35.172175+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:35.172175+0000","last_undegraded":"2024-04-25T23:02:35.172175+0000","last_fullsized":"2024-04-25T23:02:35.172175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173477+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:35.173477+0000","last_peered":"2024-04-25T23:02:35.173477+0000","last_clean":"2024-04-25T23:02:35.173477+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:35.173477+0000","last_undegraded":"2024-04-25T23:02:35.173477+0000","last_fullsized":"2024-04-25T23:02:35.173477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":797,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167366+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:35.167366+0000","last_peered":"2024-04-25T23:02:35.167366+0000","last_clean":"2024-04-25T23:02:35.167366+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:35.167366+0000","last_undegraded":"2024-04-25T23:02:35.167366+0000","last_fullsized":"2024-04-25T23:02:35.167366+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":655,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.174315+0000","last_change":"2024-04-25T23:02:16.345583+0000","last_active":"2024-04-25T23:02:35.174315+0000","last_peered":"2024-04-25T23:02:35.174315+0000","last_clean":"2024-04-25T22:59:33.272809+0000","last_became_active":"2024-04-25T23:02:16.342554+0000","last_became_peered":"2024-04-25T23:02:16.342554+0000","last_unstale":"2024-04-25T23:02:35.174315+0000","last_undegraded":"2024-04-25T23:02:16.202781+0000","last_fullsized":"2024-04-25T23:02:16.198394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172514+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:35.172514+0000","last_peered":"2024-04-25T23:02:35.172514+0000","last_clean":"2024-04-25T23:02:35.172514+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:35.172514+0000","last_undegraded":"2024-04-25T23:02:35.172514+0000","last_fullsized":"2024-04-25T23:02:35.172514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167887+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:35.167887+0000","last_peered":"2024-04-25T23:02:35.167887+0000","last_clean":"2024-04-25T23:02:35.167887+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:35.167887+0000","last_undegraded":"2024-04-25T23:02:35.167887+0000","last_fullsized":"2024-04-25T23:02:35.167887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":580,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.087128+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:33.087128+0000","last_peered":"2024-04-25T23:02:33.087128+0000","last_clean":"2024-04-25T23:02:33.087128+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:33.087128+0000","last_undegraded":"2024-04-25T23:02:33.087128+0000","last_fullsized":"2024-04-25T23:02:33.087128+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168075+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:35.168075+0000","last_peered":"2024-04-25T23:02:35.168075+0000","last_clean":"2024-04-25T23:02:35.168075+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:35.168075+0000","last_undegraded":"2024-04-25T23:02:35.168075+0000","last_fullsized":"2024-04-25T23:02:35.168075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":479,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083429+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:33.083429+0000","last_peered":"2024-04-25T23:02:33.083429+0000","last_clean":"2024-04-25T23:02:33.083429+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:33.083429+0000","last_undegraded":"2024-04-25T23:02:33.083429+0000","last_fullsized":"2024-04-25T23:02:33.083429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":555,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.169514+0000","last_change":"2024-04-25T23:02:16.336587+0000","last_active":"2024-04-25T23:02:35.169514+0000","last_peered":"2024-04-25T23:02:35.169514+0000","last_clean":"2024-04-25T22:59:32.893156+0000","last_became_active":"2024-04-25T23:02:16.330744+0000","last_became_peered":"2024-04-25T23:02:16.330744+0000","last_unstale":"2024-04-25T23:02:35.169514+0000","last_undegraded":"2024-04-25T23:02:16.203382+0000","last_fullsized":"2024-04-25T23:02:16.192794+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172514+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:35.172514+0000","last_peered":"2024-04-25T23:02:35.172514+0000","last_clean":"2024-04-25T23:02:35.172514+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:35.172514+0000","last_undegraded":"2024-04-25T23:02:35.172514+0000","last_fullsized":"2024-04-25T23:02:35.172514+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173080+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:35.173080+0000","last_peered":"2024-04-25T23:02:35.173080+0000","last_clean":"2024-04-25T23:02:35.173080+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:35.173080+0000","last_undegraded":"2024-04-25T23:02:35.173080+0000","last_fullsized":"2024-04-25T23:02:35.173080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":919,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167868+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:35.167868+0000","last_peered":"2024-04-25T23:02:35.167868+0000","last_clean":"2024-04-25T23:02:35.167868+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:35.167868+0000","last_undegraded":"2024-04-25T23:02:35.167868+0000","last_fullsized":"2024-04-25T23:02:35.167868+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":436,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.174906+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:35.174906+0000","last_peered":"2024-04-25T23:02:35.174906+0000","last_clean":"2024-04-25T23:02:35.174906+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:35.174906+0000","last_undegraded":"2024-04-25T23:02:35.174906+0000","last_fullsized":"2024-04-25T23:02:35.174906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168432+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:35.168432+0000","last_peered":"2024-04-25T23:02:35.168432+0000","last_clean":"2024-04-25T23:02:35.168432+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:35.168432+0000","last_undegraded":"2024-04-25T23:02:35.168432+0000","last_fullsized":"2024-04-25T23:02:35.168432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":495,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.082828+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:33.082828+0000","last_peered":"2024-04-25T23:02:33.082828+0000","last_clean":"2024-04-25T23:02:33.082828+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:33.082828+0000","last_undegraded":"2024-04-25T23:02:33.082828+0000","last_fullsized":"2024-04-25T23:02:33.082828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":213,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168202+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:35.168202+0000","last_peered":"2024-04-25T23:02:35.168202+0000","last_clean":"2024-04-25T23:02:35.168202+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:35.168202+0000","last_undegraded":"2024-04-25T23:02:35.168202+0000","last_fullsized":"2024-04-25T23:02:35.168202+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.087019+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:33.087019+0000","last_peered":"2024-04-25T23:02:33.087019+0000","last_clean":"2024-04-25T23:02:33.087019+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:33.087019+0000","last_undegraded":"2024-04-25T23:02:33.087019+0000","last_fullsized":"2024-04-25T23:02:33.087019+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":590,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084792+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:33.084792+0000","last_peered":"2024-04-25T23:02:33.084792+0000","last_clean":"2024-04-25T23:02:33.084792+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:33.084792+0000","last_undegraded":"2024-04-25T23:02:33.084792+0000","last_fullsized":"2024-04-25T23:02:33.084792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":224,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170918+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:35.170918+0000","last_peered":"2024-04-25T23:02:35.170918+0000","last_clean":"2024-04-25T23:02:35.170918+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:35.170918+0000","last_undegraded":"2024-04-25T23:02:35.170918+0000","last_fullsized":"2024-04-25T23:02:35.170918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169633+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:35.169633+0000","last_peered":"2024-04-25T23:02:35.169633+0000","last_clean":"2024-04-25T23:02:35.169633+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:35.169633+0000","last_undegraded":"2024-04-25T23:02:35.169633+0000","last_fullsized":"2024-04-25T23:02:35.169633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":559,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167152+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:35.167152+0000","last_peered":"2024-04-25T23:02:35.167152+0000","last_clean":"2024-04-25T23:02:35.167152+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:35.167152+0000","last_undegraded":"2024-04-25T23:02:35.167152+0000","last_fullsized":"2024-04-25T23:02:35.167152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":263,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169538+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:35.169538+0000","last_peered":"2024-04-25T23:02:35.169538+0000","last_clean":"2024-04-25T23:02:35.169538+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:35.169538+0000","last_undegraded":"2024-04-25T23:02:35.169538+0000","last_fullsized":"2024-04-25T23:02:35.169538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173408+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:35.173408+0000","last_peered":"2024-04-25T23:02:35.173408+0000","last_clean":"2024-04-25T23:02:35.173408+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:35.173408+0000","last_undegraded":"2024-04-25T23:02:35.173408+0000","last_fullsized":"2024-04-25T23:02:35.173408+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":628,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083972+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:33.083972+0000","last_peered":"2024-04-25T23:02:33.083972+0000","last_clean":"2024-04-25T23:02:33.083972+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:33.083972+0000","last_undegraded":"2024-04-25T23:02:33.083972+0000","last_fullsized":"2024-04-25T23:02:33.083972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":990,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172137+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:35.172137+0000","last_peered":"2024-04-25T23:02:35.172137+0000","last_clean":"2024-04-25T23:02:35.172137+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:35.172137+0000","last_undegraded":"2024-04-25T23:02:35.172137+0000","last_fullsized":"2024-04-25T23:02:35.172137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":423,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172418+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:35.172418+0000","last_peered":"2024-04-25T23:02:35.172418+0000","last_clean":"2024-04-25T23:02:35.172418+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:35.172418+0000","last_undegraded":"2024-04-25T23:02:35.172418+0000","last_fullsized":"2024-04-25T23:02:35.172418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":982,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166791+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:35.166791+0000","last_peered":"2024-04-25T23:02:35.166791+0000","last_clean":"2024-04-25T23:02:35.166791+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:35.166791+0000","last_undegraded":"2024-04-25T23:02:35.166791+0000","last_fullsized":"2024-04-25T23:02:35.166791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086342+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:33.086342+0000","last_peered":"2024-04-25T23:02:33.086342+0000","last_clean":"2024-04-25T23:02:33.086342+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:33.086342+0000","last_undegraded":"2024-04-25T23:02:33.086342+0000","last_fullsized":"2024-04-25T23:02:33.086342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":366,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173385+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:35.173385+0000","last_peered":"2024-04-25T23:02:35.173385+0000","last_clean":"2024-04-25T23:02:35.173385+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:35.173385+0000","last_undegraded":"2024-04-25T23:02:35.173385+0000","last_fullsized":"2024-04-25T23:02:35.173385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":662,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166647+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:35.166647+0000","last_peered":"2024-04-25T23:02:35.166647+0000","last_clean":"2024-04-25T23:02:35.166647+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:35.166647+0000","last_undegraded":"2024-04-25T23:02:35.166647+0000","last_fullsized":"2024-04-25T23:02:35.166647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":221,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170258+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:35.170258+0000","last_peered":"2024-04-25T23:02:35.170258+0000","last_clean":"2024-04-25T23:02:35.170258+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:35.170258+0000","last_undegraded":"2024-04-25T23:02:35.170258+0000","last_fullsized":"2024-04-25T23:02:35.170258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1027,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166775+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:35.166775+0000","last_peered":"2024-04-25T23:02:35.166775+0000","last_clean":"2024-04-25T23:02:35.166775+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:35.166775+0000","last_undegraded":"2024-04-25T23:02:35.166775+0000","last_fullsized":"2024-04-25T23:02:35.166775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":485,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085955+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:33.085955+0000","last_peered":"2024-04-25T23:02:33.085955+0000","last_clean":"2024-04-25T23:02:33.085955+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:33.085955+0000","last_undegraded":"2024-04-25T23:02:33.085955+0000","last_fullsized":"2024-04-25T23:02:33.085955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":741,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167443+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:35.167443+0000","last_peered":"2024-04-25T23:02:35.167443+0000","last_clean":"2024-04-25T23:02:35.167443+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:35.167443+0000","last_undegraded":"2024-04-25T23:02:35.167443+0000","last_fullsized":"2024-04-25T23:02:35.167443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168874+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:35.168874+0000","last_peered":"2024-04-25T23:02:35.168874+0000","last_clean":"2024-04-25T23:02:35.168874+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:35.168874+0000","last_undegraded":"2024-04-25T23:02:35.168874+0000","last_fullsized":"2024-04-25T23:02:35.168874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167029+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:35.167029+0000","last_peered":"2024-04-25T23:02:35.167029+0000","last_clean":"2024-04-25T23:02:35.167029+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:35.167029+0000","last_undegraded":"2024-04-25T23:02:35.167029+0000","last_fullsized":"2024-04-25T23:02:35.167029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":566,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-25T23:02:32.420413+0000","last_change":"2024-04-25T23:02:33.650795+0000","last_active":"2024-04-25T23:02:33.650795+0000","last_peered":"2024-04-25T23:02:32.420413+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329576+0000","last_became_peered":"2024-04-25T23:02:16.329576+0000","last_unstale":"2024-04-25T23:02:32.420413+0000","last_undegraded":"2024-04-25T23:02:32.420413+0000","last_fullsized":"2024-04-25T23:02:16.166712+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":362,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084999+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:33.084999+0000","last_peered":"2024-04-25T23:02:33.084999+0000","last_clean":"2024-04-25T23:02:33.084999+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:33.084999+0000","last_undegraded":"2024-04-25T23:02:33.084999+0000","last_fullsized":"2024-04-25T23:02:33.084999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":525,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085666+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:33.085666+0000","last_peered":"2024-04-25T23:02:33.085666+0000","last_clean":"2024-04-25T23:02:33.085666+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:33.085666+0000","last_undegraded":"2024-04-25T23:02:33.085666+0000","last_fullsized":"2024-04-25T23:02:33.085666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085062+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:33.085062+0000","last_peered":"2024-04-25T23:02:33.085062+0000","last_clean":"2024-04-25T23:02:33.085062+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:33.085062+0000","last_undegraded":"2024-04-25T23:02:33.085062+0000","last_fullsized":"2024-04-25T23:02:33.085062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":582,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172291+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:35.172291+0000","last_peered":"2024-04-25T23:02:35.172291+0000","last_clean":"2024-04-25T23:02:35.172291+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:35.172291+0000","last_undegraded":"2024-04-25T23:02:35.172291+0000","last_fullsized":"2024-04-25T23:02:35.172291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172234+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:35.172234+0000","last_peered":"2024-04-25T23:02:35.172234+0000","last_clean":"2024-04-25T23:02:35.172234+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:35.172234+0000","last_undegraded":"2024-04-25T23:02:35.172234+0000","last_fullsized":"2024-04-25T23:02:35.172234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":644,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171658+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:35.171658+0000","last_peered":"2024-04-25T23:02:35.171658+0000","last_clean":"2024-04-25T23:02:35.171658+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:35.171658+0000","last_undegraded":"2024-04-25T23:02:35.171658+0000","last_fullsized":"2024-04-25T23:02:35.171658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":426,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085960+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:33.085960+0000","last_peered":"2024-04-25T23:02:33.085960+0000","last_clean":"2024-04-25T23:02:33.085960+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:33.085960+0000","last_undegraded":"2024-04-25T23:02:33.085960+0000","last_fullsized":"2024-04-25T23:02:33.085960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":627,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083665+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:33.083665+0000","last_peered":"2024-04-25T23:02:33.083665+0000","last_clean":"2024-04-25T23:02:33.083665+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:33.083665+0000","last_undegraded":"2024-04-25T23:02:33.083665+0000","last_fullsized":"2024-04-25T23:02:33.083665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169352+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:35.169352+0000","last_peered":"2024-04-25T23:02:35.169352+0000","last_clean":"2024-04-25T23:02:35.169352+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:35.169352+0000","last_undegraded":"2024-04-25T23:02:35.169352+0000","last_fullsized":"2024-04-25T23:02:35.169352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":643,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171369+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:35.171369+0000","last_peered":"2024-04-25T23:02:35.171369+0000","last_clean":"2024-04-25T23:02:35.171369+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:35.171369+0000","last_undegraded":"2024-04-25T23:02:35.171369+0000","last_fullsized":"2024-04-25T23:02:35.171369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169831+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:35.169831+0000","last_peered":"2024-04-25T23:02:35.169831+0000","last_clean":"2024-04-25T23:02:35.169831+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:35.169831+0000","last_undegraded":"2024-04-25T23:02:35.169831+0000","last_fullsized":"2024-04-25T23:02:35.169831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1601,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5815,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":117,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119824,"kb_used_data":83968,"kb_used_omap":5,"kb_used_meta":35834,"kb_avail":94252016,"statfs":{"total":96636764160,"available":96514064384,"internally_reserved":0,"allocated":85983232,"data_stored":85525131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":36694155},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177812,"kb_used_data":80064,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94194028,"statfs":{"total":96636764160,"available":96454684672,"internally_reserved":0,"allocated":81985536,"data_stored":81531550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178952,"kb_used_data":89524,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192888,"statfs":{"total":96636764160,"available":96453517312,"internally_reserved":0,"allocated":91672576,"data_stored":91194434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:36.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T23:02:37.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:37.020 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2497/110 objects degraded (2270.000%), 14 pgs degraded","count":14},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":231,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":91,"num_osds":3,"num_up_osds":3,"osd_up_since":1714086134,"num_in_osds":3,"osd_in_since":1714085926,"num_remapped_pgs":8},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":89},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":14},{"state_name":"peering","count":2}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":128569219,"bytes_used":487886848,"bytes_avail":289422405632,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":2497,"degraded_total":110,"degraded_ratio":22.699999999999999,"recovering_objects_per_sec":193,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":773,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4239}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-25T23:00:12.528425+0000","services":{}},"progress_events":{}} 2024-04-25T23:02:37.039 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T23:02:37.039 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:37.362 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:37.364 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:37.380 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-04-25T23:02:37.167799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1601,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5838,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":199,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":476588,"kb_used_data":253556,"kb_used_omap":8,"kb_used_meta":222967,"kb_avail":282638932,"statfs":{"total":289910292480,"available":289422266368,"internally_reserved":0,"allocated":259641344,"data_stored":258251115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":228318229},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1432,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1406,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002610"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":636,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.170255+0000","last_change":"2024-04-25T23:02:16.336211+0000","last_active":"2024-04-25T23:02:35.170255+0000","last_peered":"2024-04-25T23:02:35.170255+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329824+0000","last_became_peered":"2024-04-25T23:02:16.329824+0000","last_unstale":"2024-04-25T23:02:35.170255+0000","last_undegraded":"2024-04-25T23:02:16.203747+0000","last_fullsized":"2024-04-25T23:02:16.195496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":981,"reported_epoch":90,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:35.231277+0000","last_change":"2024-04-25T23:02:35.231777+0000","last_active":"2024-04-25T23:02:35.231277+0000","last_peered":"2024-04-25T23:02:35.231277+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.323624+0000","last_became_peered":"2024-04-25T23:02:16.323624+0000","last_unstale":"2024-04-25T23:02:35.231277+0000","last_undegraded":"2024-04-25T23:02:35.231277+0000","last_fullsized":"2024-04-25T23:02:16.185275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":897,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.178275+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:35.178275+0000","last_peered":"2024-04-25T23:02:35.178275+0000","last_clean":"2024-04-25T23:02:35.178275+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:35.178275+0000","last_undegraded":"2024-04-25T23:02:35.178275+0000","last_fullsized":"2024-04-25T23:02:35.178275+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171542+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:35.171542+0000","last_peered":"2024-04-25T23:02:35.171542+0000","last_clean":"2024-04-25T23:02:35.171542+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:35.171542+0000","last_undegraded":"2024-04-25T23:02:35.171542+0000","last_fullsized":"2024-04-25T23:02:35.171542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":634,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.082863+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:33.082863+0000","last_peered":"2024-04-25T23:02:33.082863+0000","last_clean":"2024-04-25T23:02:33.082863+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:33.082863+0000","last_undegraded":"2024-04-25T23:02:33.082863+0000","last_fullsized":"2024-04-25T23:02:33.082863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":537,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171057+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:35.171057+0000","last_peered":"2024-04-25T23:02:35.171057+0000","last_clean":"2024-04-25T23:02:35.171057+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:35.171057+0000","last_undegraded":"2024-04-25T23:02:35.171057+0000","last_fullsized":"2024-04-25T23:02:35.171057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":576,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170594+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:35.170594+0000","last_peered":"2024-04-25T23:02:35.170594+0000","last_clean":"2024-04-25T23:02:35.170594+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:35.170594+0000","last_undegraded":"2024-04-25T23:02:35.170594+0000","last_fullsized":"2024-04-25T23:02:35.170594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":570,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170282+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:35.170282+0000","last_peered":"2024-04-25T23:02:35.170282+0000","last_clean":"2024-04-25T23:02:35.170282+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:35.170282+0000","last_undegraded":"2024-04-25T23:02:35.170282+0000","last_fullsized":"2024-04-25T23:02:35.170282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":561,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.168840+0000","last_change":"2024-04-25T23:02:16.335542+0000","last_active":"2024-04-25T23:02:35.168840+0000","last_peered":"2024-04-25T23:02:35.168840+0000","last_clean":"2024-04-25T22:59:32.892759+0000","last_became_active":"2024-04-25T23:02:16.324506+0000","last_became_peered":"2024-04-25T23:02:16.324506+0000","last_unstale":"2024-04-25T23:02:35.168840+0000","last_undegraded":"2024-04-25T23:02:16.192548+0000","last_fullsized":"2024-04-25T23:02:16.163168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":523,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086835+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:33.086835+0000","last_peered":"2024-04-25T23:02:33.086835+0000","last_clean":"2024-04-25T23:02:33.086835+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:33.086835+0000","last_undegraded":"2024-04-25T23:02:33.086835+0000","last_fullsized":"2024-04-25T23:02:33.086835+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":584,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172557+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:35.172557+0000","last_peered":"2024-04-25T23:02:35.172557+0000","last_clean":"2024-04-25T23:02:35.172557+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:35.172557+0000","last_undegraded":"2024-04-25T23:02:35.172557+0000","last_fullsized":"2024-04-25T23:02:35.172557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":506,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085938+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:33.085938+0000","last_peered":"2024-04-25T23:02:33.085938+0000","last_clean":"2024-04-25T23:02:33.085938+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:33.085938+0000","last_undegraded":"2024-04-25T23:02:33.085938+0000","last_fullsized":"2024-04-25T23:02:33.085938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":519,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.166950+0000","last_change":"2024-04-25T23:02:16.889283+0000","last_active":"2024-04-25T23:02:35.166950+0000","last_peered":"2024-04-25T23:02:35.166950+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.264824+0000","last_became_peered":"2024-04-25T23:02:16.264824+0000","last_unstale":"2024-04-25T23:02:35.166950+0000","last_undegraded":"2024-04-25T23:02:16.888989+0000","last_fullsized":"2024-04-25T23:02:16.163698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1016,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171380+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:35.171380+0000","last_peered":"2024-04-25T23:02:35.171380+0000","last_clean":"2024-04-25T23:02:35.171380+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:35.171380+0000","last_undegraded":"2024-04-25T23:02:35.171380+0000","last_fullsized":"2024-04-25T23:02:35.171380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":964,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170671+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:35.170671+0000","last_peered":"2024-04-25T23:02:35.170671+0000","last_clean":"2024-04-25T23:02:35.170671+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:35.170671+0000","last_undegraded":"2024-04-25T23:02:35.170671+0000","last_fullsized":"2024-04-25T23:02:35.170671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":615,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170298+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:35.170298+0000","last_peered":"2024-04-25T23:02:35.170298+0000","last_clean":"2024-04-25T23:02:35.170298+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:35.170298+0000","last_undegraded":"2024-04-25T23:02:35.170298+0000","last_fullsized":"2024-04-25T23:02:35.170298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":675,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.170550+0000","last_change":"2024-04-25T23:02:16.339646+0000","last_active":"2024-04-25T23:02:35.170550+0000","last_peered":"2024-04-25T23:02:35.170550+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:35.170550+0000","last_undegraded":"2024-04-25T23:02:16.208021+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":575,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-25T23:02:32.972690+0000","last_change":"2024-04-25T23:02:33.650876+0000","last_active":"2024-04-25T23:02:33.650876+0000","last_peered":"2024-04-25T23:02:32.972690+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.321704+0000","last_became_peered":"2024-04-25T23:02:16.321704+0000","last_unstale":"2024-04-25T23:02:32.972690+0000","last_undegraded":"2024-04-25T23:02:32.972690+0000","last_fullsized":"2024-04-25T23:02:16.189024+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1093,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168513+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:35.168513+0000","last_peered":"2024-04-25T23:02:35.168513+0000","last_clean":"2024-04-25T23:02:35.168513+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:35.168513+0000","last_undegraded":"2024-04-25T23:02:35.168513+0000","last_fullsized":"2024-04-25T23:02:35.168513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":586,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171833+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:35.171833+0000","last_peered":"2024-04-25T23:02:35.171833+0000","last_clean":"2024-04-25T23:02:35.171833+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:35.171833+0000","last_undegraded":"2024-04-25T23:02:35.171833+0000","last_fullsized":"2024-04-25T23:02:35.171833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":629,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172441+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:35.172441+0000","last_peered":"2024-04-25T23:02:35.172441+0000","last_clean":"2024-04-25T23:02:35.172441+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:35.172441+0000","last_undegraded":"2024-04-25T23:02:35.172441+0000","last_fullsized":"2024-04-25T23:02:35.172441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":650,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085319+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:33.085319+0000","last_peered":"2024-04-25T23:02:33.085319+0000","last_clean":"2024-04-25T23:02:33.085319+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:33.085319+0000","last_undegraded":"2024-04-25T23:02:33.085319+0000","last_fullsized":"2024-04-25T23:02:33.085319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":567,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166345+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:35.166345+0000","last_peered":"2024-04-25T23:02:35.166345+0000","last_clean":"2024-04-25T23:02:35.166345+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:35.166345+0000","last_undegraded":"2024-04-25T23:02:35.166345+0000","last_fullsized":"2024-04-25T23:02:35.166345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":655,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:30.162911+0000","last_change":"2024-04-25T23:02:16.326683+0000","last_active":"2024-04-25T23:02:30.162911+0000","last_peered":"2024-04-25T23:02:30.162911+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.320738+0000","last_became_peered":"2024-04-25T23:02:16.320738+0000","last_unstale":"2024-04-25T23:02:30.162911+0000","last_undegraded":"2024-04-25T23:02:16.182673+0000","last_fullsized":"2024-04-25T23:02:16.162015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":607,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.098058+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:33.098058+0000","last_peered":"2024-04-25T23:02:33.098058+0000","last_clean":"2024-04-25T23:02:33.098058+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:33.098058+0000","last_undegraded":"2024-04-25T23:02:33.098058+0000","last_fullsized":"2024-04-25T23:02:33.098058+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":648,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169017+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:35.169017+0000","last_peered":"2024-04-25T23:02:35.169017+0000","last_clean":"2024-04-25T23:02:35.169017+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:35.169017+0000","last_undegraded":"2024-04-25T23:02:35.169017+0000","last_fullsized":"2024-04-25T23:02:35.169017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":932,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-25T23:02:34.749779+0000","last_change":"2024-04-25T23:02:35.173425+0000","last_active":"2024-04-25T23:02:35.173425+0000","last_peered":"2024-04-25T23:02:34.749779+0000","last_clean":"2024-04-25T22:59:33.272585+0000","last_became_active":"2024-04-25T23:02:16.337943+0000","last_became_peered":"2024-04-25T23:02:16.337943+0000","last_unstale":"2024-04-25T23:02:34.749779+0000","last_undegraded":"2024-04-25T23:02:34.749779+0000","last_fullsized":"2024-04-25T23:02:16.191698+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":602,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.171176+0000","last_change":"2024-04-25T23:02:16.857958+0000","last_active":"2024-04-25T23:02:35.171176+0000","last_peered":"2024-04-25T23:02:35.171176+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.316513+0000","last_became_peered":"2024-04-25T23:02:16.316513+0000","last_unstale":"2024-04-25T23:02:35.171176+0000","last_undegraded":"2024-04-25T23:02:16.857683+0000","last_fullsized":"2024-04-25T23:02:16.165883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":935,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167442+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:35.167442+0000","last_peered":"2024-04-25T23:02:35.167442+0000","last_clean":"2024-04-25T23:02:35.167442+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:35.167442+0000","last_undegraded":"2024-04-25T23:02:35.167442+0000","last_fullsized":"2024-04-25T23:02:35.167442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":613,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084747+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:33.084747+0000","last_peered":"2024-04-25T23:02:33.084747+0000","last_clean":"2024-04-25T23:02:33.084747+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:33.084747+0000","last_undegraded":"2024-04-25T23:02:33.084747+0000","last_fullsized":"2024-04-25T23:02:33.084747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1026,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166517+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:35.166517+0000","last_peered":"2024-04-25T23:02:35.166517+0000","last_clean":"2024-04-25T23:02:35.166517+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:35.166517+0000","last_undegraded":"2024-04-25T23:02:35.166517+0000","last_fullsized":"2024-04-25T23:02:35.166517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":676,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170521+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:35.170521+0000","last_peered":"2024-04-25T23:02:35.170521+0000","last_clean":"2024-04-25T23:02:35.170521+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:35.170521+0000","last_undegraded":"2024-04-25T23:02:35.170521+0000","last_fullsized":"2024-04-25T23:02:35.170521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":633,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084985+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:33.084985+0000","last_peered":"2024-04-25T23:02:33.084985+0000","last_clean":"2024-04-25T23:02:33.084985+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:33.084985+0000","last_undegraded":"2024-04-25T23:02:33.084985+0000","last_fullsized":"2024-04-25T23:02:33.084985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":704,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172754+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:35.172754+0000","last_peered":"2024-04-25T23:02:35.172754+0000","last_clean":"2024-04-25T23:02:35.172754+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:35.172754+0000","last_undegraded":"2024-04-25T23:02:35.172754+0000","last_fullsized":"2024-04-25T23:02:35.172754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086868+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:33.086868+0000","last_peered":"2024-04-25T23:02:33.086868+0000","last_clean":"2024-04-25T23:02:33.086868+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:33.086868+0000","last_undegraded":"2024-04-25T23:02:33.086868+0000","last_fullsized":"2024-04-25T23:02:33.086868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":204,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167034+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:35.167034+0000","last_peered":"2024-04-25T23:02:35.167034+0000","last_clean":"2024-04-25T23:02:35.167034+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:35.167034+0000","last_undegraded":"2024-04-25T23:02:35.167034+0000","last_fullsized":"2024-04-25T23:02:35.167034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":656,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169386+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:35.169386+0000","last_peered":"2024-04-25T23:02:35.169386+0000","last_clean":"2024-04-25T23:02:35.169386+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:35.169386+0000","last_undegraded":"2024-04-25T23:02:35.169386+0000","last_fullsized":"2024-04-25T23:02:35.169386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083819+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:33.083819+0000","last_peered":"2024-04-25T23:02:33.083819+0000","last_clean":"2024-04-25T23:02:33.083819+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:33.083819+0000","last_undegraded":"2024-04-25T23:02:33.083819+0000","last_fullsized":"2024-04-25T23:02:33.083819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":615,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168892+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:35.168892+0000","last_peered":"2024-04-25T23:02:35.168892+0000","last_clean":"2024-04-25T23:02:35.168892+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:35.168892+0000","last_undegraded":"2024-04-25T23:02:35.168892+0000","last_fullsized":"2024-04-25T23:02:35.168892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170613+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:35.170613+0000","last_peered":"2024-04-25T23:02:35.170613+0000","last_clean":"2024-04-25T23:02:35.170613+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:35.170613+0000","last_undegraded":"2024-04-25T23:02:35.170613+0000","last_fullsized":"2024-04-25T23:02:35.170613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":323,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173249+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:35.173249+0000","last_peered":"2024-04-25T23:02:35.173249+0000","last_clean":"2024-04-25T23:02:35.173249+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:35.173249+0000","last_undegraded":"2024-04-25T23:02:35.173249+0000","last_fullsized":"2024-04-25T23:02:35.173249+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":609,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084102+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:33.084102+0000","last_peered":"2024-04-25T23:02:33.084102+0000","last_clean":"2024-04-25T23:02:33.084102+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:33.084102+0000","last_undegraded":"2024-04-25T23:02:33.084102+0000","last_fullsized":"2024-04-25T23:02:33.084102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":429,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086450+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:33.086450+0000","last_peered":"2024-04-25T23:02:33.086450+0000","last_clean":"2024-04-25T23:02:33.086450+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:33.086450+0000","last_undegraded":"2024-04-25T23:02:33.086450+0000","last_fullsized":"2024-04-25T23:02:33.086450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":641,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083286+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:33.083286+0000","last_peered":"2024-04-25T23:02:33.083286+0000","last_clean":"2024-04-25T23:02:33.083286+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:33.083286+0000","last_undegraded":"2024-04-25T23:02:33.083286+0000","last_fullsized":"2024-04-25T23:02:33.083286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":657,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.174855+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:35.174855+0000","last_peered":"2024-04-25T23:02:35.174855+0000","last_clean":"2024-04-25T23:02:35.174855+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:35.174855+0000","last_undegraded":"2024-04-25T23:02:35.174855+0000","last_fullsized":"2024-04-25T23:02:35.174855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":602,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171436+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:35.171436+0000","last_peered":"2024-04-25T23:02:35.171436+0000","last_clean":"2024-04-25T23:02:35.171436+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:35.171436+0000","last_undegraded":"2024-04-25T23:02:35.171436+0000","last_fullsized":"2024-04-25T23:02:35.171436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":227,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172718+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:35.172718+0000","last_peered":"2024-04-25T23:02:35.172718+0000","last_clean":"2024-04-25T23:02:35.172718+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:35.172718+0000","last_undegraded":"2024-04-25T23:02:35.172718+0000","last_fullsized":"2024-04-25T23:02:35.172718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":668,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167865+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:35.167865+0000","last_peered":"2024-04-25T23:02:35.167865+0000","last_clean":"2024-04-25T23:02:35.167865+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:35.167865+0000","last_undegraded":"2024-04-25T23:02:35.167865+0000","last_fullsized":"2024-04-25T23:02:35.167865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168011+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:35.168011+0000","last_peered":"2024-04-25T23:02:35.168011+0000","last_clean":"2024-04-25T23:02:35.168011+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:35.168011+0000","last_undegraded":"2024-04-25T23:02:35.168011+0000","last_fullsized":"2024-04-25T23:02:35.168011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":624,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172119+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:35.172119+0000","last_peered":"2024-04-25T23:02:35.172119+0000","last_clean":"2024-04-25T23:02:35.172119+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:35.172119+0000","last_undegraded":"2024-04-25T23:02:35.172119+0000","last_fullsized":"2024-04-25T23:02:35.172119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":281,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172225+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:35.172225+0000","last_peered":"2024-04-25T23:02:35.172225+0000","last_clean":"2024-04-25T23:02:35.172225+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:35.172225+0000","last_undegraded":"2024-04-25T23:02:35.172225+0000","last_fullsized":"2024-04-25T23:02:35.172225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":868,"reported_epoch":90,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T23:02:35.641736+0000","last_change":"2024-04-25T23:02:35.235425+0000","last_active":"2024-04-25T23:02:35.641736+0000","last_peered":"2024-04-25T23:02:35.641736+0000","last_clean":"2024-04-25T22:59:33.272608+0000","last_became_active":"2024-04-25T23:02:16.338558+0000","last_became_peered":"2024-04-25T23:02:16.338558+0000","last_unstale":"2024-04-25T23:02:35.641736+0000","last_undegraded":"2024-04-25T23:02:35.641736+0000","last_fullsized":"2024-04-25T23:02:16.197751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083298+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:33.083298+0000","last_peered":"2024-04-25T23:02:33.083298+0000","last_clean":"2024-04-25T23:02:33.083298+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:33.083298+0000","last_undegraded":"2024-04-25T23:02:33.083298+0000","last_fullsized":"2024-04-25T23:02:33.083298+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":893,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172760+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:35.172760+0000","last_peered":"2024-04-25T23:02:35.172760+0000","last_clean":"2024-04-25T23:02:35.172760+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:35.172760+0000","last_undegraded":"2024-04-25T23:02:35.172760+0000","last_fullsized":"2024-04-25T23:02:35.172760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":616,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084063+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:33.084063+0000","last_peered":"2024-04-25T23:02:33.084063+0000","last_clean":"2024-04-25T23:02:33.084063+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:33.084063+0000","last_undegraded":"2024-04-25T23:02:33.084063+0000","last_fullsized":"2024-04-25T23:02:33.084063+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":570,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.169220+0000","last_change":"2024-04-25T23:02:16.335886+0000","last_active":"2024-04-25T23:02:35.169220+0000","last_peered":"2024-04-25T23:02:35.169220+0000","last_clean":"2024-04-25T22:59:32.892903+0000","last_became_active":"2024-04-25T23:02:16.325195+0000","last_became_peered":"2024-04-25T23:02:16.325195+0000","last_unstale":"2024-04-25T23:02:35.169220+0000","last_undegraded":"2024-04-25T23:02:16.191750+0000","last_fullsized":"2024-04-25T23:02:16.173053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":372,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172175+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:35.172175+0000","last_peered":"2024-04-25T23:02:35.172175+0000","last_clean":"2024-04-25T23:02:35.172175+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:35.172175+0000","last_undegraded":"2024-04-25T23:02:35.172175+0000","last_fullsized":"2024-04-25T23:02:35.172175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173477+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:35.173477+0000","last_peered":"2024-04-25T23:02:35.173477+0000","last_clean":"2024-04-25T23:02:35.173477+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:35.173477+0000","last_undegraded":"2024-04-25T23:02:35.173477+0000","last_fullsized":"2024-04-25T23:02:35.173477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":797,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167366+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:35.167366+0000","last_peered":"2024-04-25T23:02:35.167366+0000","last_clean":"2024-04-25T23:02:35.167366+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:35.167366+0000","last_undegraded":"2024-04-25T23:02:35.167366+0000","last_fullsized":"2024-04-25T23:02:35.167366+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":655,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.174315+0000","last_change":"2024-04-25T23:02:16.345583+0000","last_active":"2024-04-25T23:02:35.174315+0000","last_peered":"2024-04-25T23:02:35.174315+0000","last_clean":"2024-04-25T22:59:33.272809+0000","last_became_active":"2024-04-25T23:02:16.342554+0000","last_became_peered":"2024-04-25T23:02:16.342554+0000","last_unstale":"2024-04-25T23:02:35.174315+0000","last_undegraded":"2024-04-25T23:02:16.202781+0000","last_fullsized":"2024-04-25T23:02:16.198394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172514+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:35.172514+0000","last_peered":"2024-04-25T23:02:35.172514+0000","last_clean":"2024-04-25T23:02:35.172514+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:35.172514+0000","last_undegraded":"2024-04-25T23:02:35.172514+0000","last_fullsized":"2024-04-25T23:02:35.172514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167887+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:35.167887+0000","last_peered":"2024-04-25T23:02:35.167887+0000","last_clean":"2024-04-25T23:02:35.167887+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:35.167887+0000","last_undegraded":"2024-04-25T23:02:35.167887+0000","last_fullsized":"2024-04-25T23:02:35.167887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":580,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.087128+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:33.087128+0000","last_peered":"2024-04-25T23:02:33.087128+0000","last_clean":"2024-04-25T23:02:33.087128+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:33.087128+0000","last_undegraded":"2024-04-25T23:02:33.087128+0000","last_fullsized":"2024-04-25T23:02:33.087128+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168075+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:35.168075+0000","last_peered":"2024-04-25T23:02:35.168075+0000","last_clean":"2024-04-25T23:02:35.168075+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:35.168075+0000","last_undegraded":"2024-04-25T23:02:35.168075+0000","last_fullsized":"2024-04-25T23:02:35.168075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":479,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083429+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:33.083429+0000","last_peered":"2024-04-25T23:02:33.083429+0000","last_clean":"2024-04-25T23:02:33.083429+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:33.083429+0000","last_undegraded":"2024-04-25T23:02:33.083429+0000","last_fullsized":"2024-04-25T23:02:33.083429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":555,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.169514+0000","last_change":"2024-04-25T23:02:16.336587+0000","last_active":"2024-04-25T23:02:35.169514+0000","last_peered":"2024-04-25T23:02:35.169514+0000","last_clean":"2024-04-25T22:59:32.893156+0000","last_became_active":"2024-04-25T23:02:16.330744+0000","last_became_peered":"2024-04-25T23:02:16.330744+0000","last_unstale":"2024-04-25T23:02:35.169514+0000","last_undegraded":"2024-04-25T23:02:16.203382+0000","last_fullsized":"2024-04-25T23:02:16.192794+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172514+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:35.172514+0000","last_peered":"2024-04-25T23:02:35.172514+0000","last_clean":"2024-04-25T23:02:35.172514+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:35.172514+0000","last_undegraded":"2024-04-25T23:02:35.172514+0000","last_fullsized":"2024-04-25T23:02:35.172514+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173080+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:35.173080+0000","last_peered":"2024-04-25T23:02:35.173080+0000","last_clean":"2024-04-25T23:02:35.173080+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:35.173080+0000","last_undegraded":"2024-04-25T23:02:35.173080+0000","last_fullsized":"2024-04-25T23:02:35.173080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":919,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167868+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:35.167868+0000","last_peered":"2024-04-25T23:02:35.167868+0000","last_clean":"2024-04-25T23:02:35.167868+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:35.167868+0000","last_undegraded":"2024-04-25T23:02:35.167868+0000","last_fullsized":"2024-04-25T23:02:35.167868+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":436,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.174906+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:35.174906+0000","last_peered":"2024-04-25T23:02:35.174906+0000","last_clean":"2024-04-25T23:02:35.174906+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:35.174906+0000","last_undegraded":"2024-04-25T23:02:35.174906+0000","last_fullsized":"2024-04-25T23:02:35.174906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168432+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:35.168432+0000","last_peered":"2024-04-25T23:02:35.168432+0000","last_clean":"2024-04-25T23:02:35.168432+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:35.168432+0000","last_undegraded":"2024-04-25T23:02:35.168432+0000","last_fullsized":"2024-04-25T23:02:35.168432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":495,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.082828+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:33.082828+0000","last_peered":"2024-04-25T23:02:33.082828+0000","last_clean":"2024-04-25T23:02:33.082828+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:33.082828+0000","last_undegraded":"2024-04-25T23:02:33.082828+0000","last_fullsized":"2024-04-25T23:02:33.082828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":213,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168202+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:35.168202+0000","last_peered":"2024-04-25T23:02:35.168202+0000","last_clean":"2024-04-25T23:02:35.168202+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:35.168202+0000","last_undegraded":"2024-04-25T23:02:35.168202+0000","last_fullsized":"2024-04-25T23:02:35.168202+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.087019+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:33.087019+0000","last_peered":"2024-04-25T23:02:33.087019+0000","last_clean":"2024-04-25T23:02:33.087019+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:33.087019+0000","last_undegraded":"2024-04-25T23:02:33.087019+0000","last_fullsized":"2024-04-25T23:02:33.087019+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":590,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084792+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:33.084792+0000","last_peered":"2024-04-25T23:02:33.084792+0000","last_clean":"2024-04-25T23:02:33.084792+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:33.084792+0000","last_undegraded":"2024-04-25T23:02:33.084792+0000","last_fullsized":"2024-04-25T23:02:33.084792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":224,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170918+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:35.170918+0000","last_peered":"2024-04-25T23:02:35.170918+0000","last_clean":"2024-04-25T23:02:35.170918+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:35.170918+0000","last_undegraded":"2024-04-25T23:02:35.170918+0000","last_fullsized":"2024-04-25T23:02:35.170918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169633+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:35.169633+0000","last_peered":"2024-04-25T23:02:35.169633+0000","last_clean":"2024-04-25T23:02:35.169633+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:35.169633+0000","last_undegraded":"2024-04-25T23:02:35.169633+0000","last_fullsized":"2024-04-25T23:02:35.169633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":559,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167152+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:35.167152+0000","last_peered":"2024-04-25T23:02:35.167152+0000","last_clean":"2024-04-25T23:02:35.167152+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:35.167152+0000","last_undegraded":"2024-04-25T23:02:35.167152+0000","last_fullsized":"2024-04-25T23:02:35.167152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":263,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169538+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:35.169538+0000","last_peered":"2024-04-25T23:02:35.169538+0000","last_clean":"2024-04-25T23:02:35.169538+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:35.169538+0000","last_undegraded":"2024-04-25T23:02:35.169538+0000","last_fullsized":"2024-04-25T23:02:35.169538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173408+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:35.173408+0000","last_peered":"2024-04-25T23:02:35.173408+0000","last_clean":"2024-04-25T23:02:35.173408+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:35.173408+0000","last_undegraded":"2024-04-25T23:02:35.173408+0000","last_fullsized":"2024-04-25T23:02:35.173408+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":628,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083972+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:33.083972+0000","last_peered":"2024-04-25T23:02:33.083972+0000","last_clean":"2024-04-25T23:02:33.083972+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:33.083972+0000","last_undegraded":"2024-04-25T23:02:33.083972+0000","last_fullsized":"2024-04-25T23:02:33.083972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":990,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172137+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:35.172137+0000","last_peered":"2024-04-25T23:02:35.172137+0000","last_clean":"2024-04-25T23:02:35.172137+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:35.172137+0000","last_undegraded":"2024-04-25T23:02:35.172137+0000","last_fullsized":"2024-04-25T23:02:35.172137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":423,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172418+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:35.172418+0000","last_peered":"2024-04-25T23:02:35.172418+0000","last_clean":"2024-04-25T23:02:35.172418+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:35.172418+0000","last_undegraded":"2024-04-25T23:02:35.172418+0000","last_fullsized":"2024-04-25T23:02:35.172418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":982,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166791+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:35.166791+0000","last_peered":"2024-04-25T23:02:35.166791+0000","last_clean":"2024-04-25T23:02:35.166791+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:35.166791+0000","last_undegraded":"2024-04-25T23:02:35.166791+0000","last_fullsized":"2024-04-25T23:02:35.166791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.086342+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:33.086342+0000","last_peered":"2024-04-25T23:02:33.086342+0000","last_clean":"2024-04-25T23:02:33.086342+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:33.086342+0000","last_undegraded":"2024-04-25T23:02:33.086342+0000","last_fullsized":"2024-04-25T23:02:33.086342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":366,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173385+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:35.173385+0000","last_peered":"2024-04-25T23:02:35.173385+0000","last_clean":"2024-04-25T23:02:35.173385+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:35.173385+0000","last_undegraded":"2024-04-25T23:02:35.173385+0000","last_fullsized":"2024-04-25T23:02:35.173385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":662,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166647+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:35.166647+0000","last_peered":"2024-04-25T23:02:35.166647+0000","last_clean":"2024-04-25T23:02:35.166647+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:35.166647+0000","last_undegraded":"2024-04-25T23:02:35.166647+0000","last_fullsized":"2024-04-25T23:02:35.166647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":221,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170258+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:35.170258+0000","last_peered":"2024-04-25T23:02:35.170258+0000","last_clean":"2024-04-25T23:02:35.170258+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:35.170258+0000","last_undegraded":"2024-04-25T23:02:35.170258+0000","last_fullsized":"2024-04-25T23:02:35.170258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1027,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166775+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:35.166775+0000","last_peered":"2024-04-25T23:02:35.166775+0000","last_clean":"2024-04-25T23:02:35.166775+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:35.166775+0000","last_undegraded":"2024-04-25T23:02:35.166775+0000","last_fullsized":"2024-04-25T23:02:35.166775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":485,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085955+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:33.085955+0000","last_peered":"2024-04-25T23:02:33.085955+0000","last_clean":"2024-04-25T23:02:33.085955+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:33.085955+0000","last_undegraded":"2024-04-25T23:02:33.085955+0000","last_fullsized":"2024-04-25T23:02:33.085955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":741,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167443+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:35.167443+0000","last_peered":"2024-04-25T23:02:35.167443+0000","last_clean":"2024-04-25T23:02:35.167443+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:35.167443+0000","last_undegraded":"2024-04-25T23:02:35.167443+0000","last_fullsized":"2024-04-25T23:02:35.167443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168874+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:35.168874+0000","last_peered":"2024-04-25T23:02:35.168874+0000","last_clean":"2024-04-25T23:02:35.168874+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:35.168874+0000","last_undegraded":"2024-04-25T23:02:35.168874+0000","last_fullsized":"2024-04-25T23:02:35.168874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167029+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:35.167029+0000","last_peered":"2024-04-25T23:02:35.167029+0000","last_clean":"2024-04-25T23:02:35.167029+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:35.167029+0000","last_undegraded":"2024-04-25T23:02:35.167029+0000","last_fullsized":"2024-04-25T23:02:35.167029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":566,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-25T23:02:32.420413+0000","last_change":"2024-04-25T23:02:33.650795+0000","last_active":"2024-04-25T23:02:33.650795+0000","last_peered":"2024-04-25T23:02:32.420413+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329576+0000","last_became_peered":"2024-04-25T23:02:16.329576+0000","last_unstale":"2024-04-25T23:02:32.420413+0000","last_undegraded":"2024-04-25T23:02:32.420413+0000","last_fullsized":"2024-04-25T23:02:16.166712+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":362,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.084999+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:33.084999+0000","last_peered":"2024-04-25T23:02:33.084999+0000","last_clean":"2024-04-25T23:02:33.084999+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:33.084999+0000","last_undegraded":"2024-04-25T23:02:33.084999+0000","last_fullsized":"2024-04-25T23:02:33.084999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":525,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085666+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:33.085666+0000","last_peered":"2024-04-25T23:02:33.085666+0000","last_clean":"2024-04-25T23:02:33.085666+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:33.085666+0000","last_undegraded":"2024-04-25T23:02:33.085666+0000","last_fullsized":"2024-04-25T23:02:33.085666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085062+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:33.085062+0000","last_peered":"2024-04-25T23:02:33.085062+0000","last_clean":"2024-04-25T23:02:33.085062+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:33.085062+0000","last_undegraded":"2024-04-25T23:02:33.085062+0000","last_fullsized":"2024-04-25T23:02:33.085062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":582,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172291+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:35.172291+0000","last_peered":"2024-04-25T23:02:35.172291+0000","last_clean":"2024-04-25T23:02:35.172291+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:35.172291+0000","last_undegraded":"2024-04-25T23:02:35.172291+0000","last_fullsized":"2024-04-25T23:02:35.172291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172234+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:35.172234+0000","last_peered":"2024-04-25T23:02:35.172234+0000","last_clean":"2024-04-25T23:02:35.172234+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:35.172234+0000","last_undegraded":"2024-04-25T23:02:35.172234+0000","last_fullsized":"2024-04-25T23:02:35.172234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":644,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171658+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:35.171658+0000","last_peered":"2024-04-25T23:02:35.171658+0000","last_clean":"2024-04-25T23:02:35.171658+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:35.171658+0000","last_undegraded":"2024-04-25T23:02:35.171658+0000","last_fullsized":"2024-04-25T23:02:35.171658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":426,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.085960+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:33.085960+0000","last_peered":"2024-04-25T23:02:33.085960+0000","last_clean":"2024-04-25T23:02:33.085960+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:33.085960+0000","last_undegraded":"2024-04-25T23:02:33.085960+0000","last_fullsized":"2024-04-25T23:02:33.085960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":627,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T23:02:33.083665+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:33.083665+0000","last_peered":"2024-04-25T23:02:33.083665+0000","last_clean":"2024-04-25T23:02:33.083665+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:33.083665+0000","last_undegraded":"2024-04-25T23:02:33.083665+0000","last_fullsized":"2024-04-25T23:02:33.083665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169352+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:35.169352+0000","last_peered":"2024-04-25T23:02:35.169352+0000","last_clean":"2024-04-25T23:02:35.169352+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:35.169352+0000","last_undegraded":"2024-04-25T23:02:35.169352+0000","last_fullsized":"2024-04-25T23:02:35.169352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":643,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171369+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:35.171369+0000","last_peered":"2024-04-25T23:02:35.171369+0000","last_clean":"2024-04-25T23:02:35.171369+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:35.171369+0000","last_undegraded":"2024-04-25T23:02:35.171369+0000","last_fullsized":"2024-04-25T23:02:35.171369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169831+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:35.169831+0000","last_peered":"2024-04-25T23:02:35.169831+0000","last_clean":"2024-04-25T23:02:35.169831+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:35.169831+0000","last_undegraded":"2024-04-25T23:02:35.169831+0000","last_fullsized":"2024-04-25T23:02:35.169831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1601,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5815,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":117,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119824,"kb_used_data":83968,"kb_used_omap":5,"kb_used_meta":35834,"kb_avail":94252016,"statfs":{"total":96636764160,"available":96514064384,"internally_reserved":0,"allocated":85983232,"data_stored":85525131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":36694155},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177812,"kb_used_data":80064,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94194028,"statfs":{"total":96636764160,"available":96454684672,"internally_reserved":0,"allocated":81985536,"data_stored":81531550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178952,"kb_used_data":89524,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192888,"statfs":{"total":96636764160,"available":96453517312,"internally_reserved":0,"allocated":91672576,"data_stored":91194434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:40.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:40.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:40.701 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:40.717 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-25T23:02:40.595721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6212,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":472484,"kb_used_data":253616,"kb_used_omap":8,"kb_used_meta":218807,"kb_avail":282643036,"statfs":{"total":289910292480,"available":289426468864,"internally_reserved":0,"allocated":259702784,"data_stored":258273753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":224058389},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-374,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001294"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":636,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.170255+0000","last_change":"2024-04-25T23:02:16.336211+0000","last_active":"2024-04-25T23:02:35.170255+0000","last_peered":"2024-04-25T23:02:35.170255+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329824+0000","last_became_peered":"2024-04-25T23:02:16.329824+0000","last_unstale":"2024-04-25T23:02:35.170255+0000","last_undegraded":"2024-04-25T23:02:16.203747+0000","last_fullsized":"2024-04-25T23:02:16.195496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":593,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091930+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:38.091930+0000","last_peered":"2024-04-25T23:02:38.091930+0000","last_clean":"2024-04-25T23:02:38.091930+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:38.091930+0000","last_undegraded":"2024-04-25T23:02:38.091930+0000","last_fullsized":"2024-04-25T23:02:38.091930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":897,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.178275+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:35.178275+0000","last_peered":"2024-04-25T23:02:35.178275+0000","last_clean":"2024-04-25T23:02:35.178275+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:35.178275+0000","last_undegraded":"2024-04-25T23:02:35.178275+0000","last_fullsized":"2024-04-25T23:02:35.178275+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171542+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:35.171542+0000","last_peered":"2024-04-25T23:02:35.171542+0000","last_clean":"2024-04-25T23:02:35.171542+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:35.171542+0000","last_undegraded":"2024-04-25T23:02:35.171542+0000","last_fullsized":"2024-04-25T23:02:35.171542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":644,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090210+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:38.090210+0000","last_peered":"2024-04-25T23:02:38.090210+0000","last_clean":"2024-04-25T23:02:38.090210+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:38.090210+0000","last_undegraded":"2024-04-25T23:02:38.090210+0000","last_fullsized":"2024-04-25T23:02:38.090210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":537,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171057+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:35.171057+0000","last_peered":"2024-04-25T23:02:35.171057+0000","last_clean":"2024-04-25T23:02:35.171057+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:35.171057+0000","last_undegraded":"2024-04-25T23:02:35.171057+0000","last_fullsized":"2024-04-25T23:02:35.171057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":576,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170594+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:35.170594+0000","last_peered":"2024-04-25T23:02:35.170594+0000","last_clean":"2024-04-25T23:02:35.170594+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:35.170594+0000","last_undegraded":"2024-04-25T23:02:35.170594+0000","last_fullsized":"2024-04-25T23:02:35.170594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":570,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170282+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:35.170282+0000","last_peered":"2024-04-25T23:02:35.170282+0000","last_clean":"2024-04-25T23:02:35.170282+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:35.170282+0000","last_undegraded":"2024-04-25T23:02:35.170282+0000","last_fullsized":"2024-04-25T23:02:35.170282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":561,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.168840+0000","last_change":"2024-04-25T23:02:16.335542+0000","last_active":"2024-04-25T23:02:35.168840+0000","last_peered":"2024-04-25T23:02:35.168840+0000","last_clean":"2024-04-25T22:59:32.892759+0000","last_became_active":"2024-04-25T23:02:16.324506+0000","last_became_peered":"2024-04-25T23:02:16.324506+0000","last_unstale":"2024-04-25T23:02:35.168840+0000","last_undegraded":"2024-04-25T23:02:16.192548+0000","last_fullsized":"2024-04-25T23:02:16.163168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":533,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090984+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:38.090984+0000","last_peered":"2024-04-25T23:02:38.090984+0000","last_clean":"2024-04-25T23:02:38.090984+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:38.090984+0000","last_undegraded":"2024-04-25T23:02:38.090984+0000","last_fullsized":"2024-04-25T23:02:38.090984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":584,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172557+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:35.172557+0000","last_peered":"2024-04-25T23:02:35.172557+0000","last_clean":"2024-04-25T23:02:35.172557+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:35.172557+0000","last_undegraded":"2024-04-25T23:02:35.172557+0000","last_fullsized":"2024-04-25T23:02:35.172557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":516,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091659+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:38.091659+0000","last_peered":"2024-04-25T23:02:38.091659+0000","last_clean":"2024-04-25T23:02:38.091659+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:38.091659+0000","last_undegraded":"2024-04-25T23:02:38.091659+0000","last_fullsized":"2024-04-25T23:02:38.091659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":519,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.166950+0000","last_change":"2024-04-25T23:02:16.889283+0000","last_active":"2024-04-25T23:02:35.166950+0000","last_peered":"2024-04-25T23:02:35.166950+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.264824+0000","last_became_peered":"2024-04-25T23:02:16.264824+0000","last_unstale":"2024-04-25T23:02:35.166950+0000","last_undegraded":"2024-04-25T23:02:16.888989+0000","last_fullsized":"2024-04-25T23:02:16.163698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1016,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171380+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:35.171380+0000","last_peered":"2024-04-25T23:02:35.171380+0000","last_clean":"2024-04-25T23:02:35.171380+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:35.171380+0000","last_undegraded":"2024-04-25T23:02:35.171380+0000","last_fullsized":"2024-04-25T23:02:35.171380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":964,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170671+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:35.170671+0000","last_peered":"2024-04-25T23:02:35.170671+0000","last_clean":"2024-04-25T23:02:35.170671+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:35.170671+0000","last_undegraded":"2024-04-25T23:02:35.170671+0000","last_fullsized":"2024-04-25T23:02:35.170671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":615,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170298+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:35.170298+0000","last_peered":"2024-04-25T23:02:35.170298+0000","last_clean":"2024-04-25T23:02:35.170298+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:35.170298+0000","last_undegraded":"2024-04-25T23:02:35.170298+0000","last_fullsized":"2024-04-25T23:02:35.170298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":675,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.170550+0000","last_change":"2024-04-25T23:02:16.339646+0000","last_active":"2024-04-25T23:02:35.170550+0000","last_peered":"2024-04-25T23:02:35.170550+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:35.170550+0000","last_undegraded":"2024-04-25T23:02:16.208021+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091547+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:38.091547+0000","last_peered":"2024-04-25T23:02:38.091547+0000","last_clean":"2024-04-25T23:02:38.091547+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:38.091547+0000","last_undegraded":"2024-04-25T23:02:38.091547+0000","last_fullsized":"2024-04-25T23:02:38.091547+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1093,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168513+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:35.168513+0000","last_peered":"2024-04-25T23:02:35.168513+0000","last_clean":"2024-04-25T23:02:35.168513+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:35.168513+0000","last_undegraded":"2024-04-25T23:02:35.168513+0000","last_fullsized":"2024-04-25T23:02:35.168513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":586,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171833+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:35.171833+0000","last_peered":"2024-04-25T23:02:35.171833+0000","last_clean":"2024-04-25T23:02:35.171833+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:35.171833+0000","last_undegraded":"2024-04-25T23:02:35.171833+0000","last_fullsized":"2024-04-25T23:02:35.171833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":629,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172441+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:35.172441+0000","last_peered":"2024-04-25T23:02:35.172441+0000","last_clean":"2024-04-25T23:02:35.172441+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:35.172441+0000","last_undegraded":"2024-04-25T23:02:35.172441+0000","last_fullsized":"2024-04-25T23:02:35.172441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":660,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090334+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:38.090334+0000","last_peered":"2024-04-25T23:02:38.090334+0000","last_clean":"2024-04-25T23:02:38.090334+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:38.090334+0000","last_undegraded":"2024-04-25T23:02:38.090334+0000","last_fullsized":"2024-04-25T23:02:38.090334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":567,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166345+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:35.166345+0000","last_peered":"2024-04-25T23:02:35.166345+0000","last_clean":"2024-04-25T23:02:35.166345+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:35.166345+0000","last_undegraded":"2024-04-25T23:02:35.166345+0000","last_fullsized":"2024-04-25T23:02:35.166345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":637,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089240+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:38.089240+0000","last_peered":"2024-04-25T23:02:38.089240+0000","last_clean":"2024-04-25T23:02:38.089240+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:38.089240+0000","last_undegraded":"2024-04-25T23:02:38.089240+0000","last_fullsized":"2024-04-25T23:02:38.089240+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":617,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090964+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:38.090964+0000","last_peered":"2024-04-25T23:02:38.090964+0000","last_clean":"2024-04-25T23:02:38.090964+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:38.090964+0000","last_undegraded":"2024-04-25T23:02:38.090964+0000","last_fullsized":"2024-04-25T23:02:38.090964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":648,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169017+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:35.169017+0000","last_peered":"2024-04-25T23:02:35.169017+0000","last_clean":"2024-04-25T23:02:35.169017+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:35.169017+0000","last_undegraded":"2024-04-25T23:02:35.169017+0000","last_fullsized":"2024-04-25T23:02:35.169017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":932,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-25T23:02:34.749779+0000","last_change":"2024-04-25T23:02:35.173425+0000","last_active":"2024-04-25T23:02:35.173425+0000","last_peered":"2024-04-25T23:02:34.749779+0000","last_clean":"2024-04-25T22:59:33.272585+0000","last_became_active":"2024-04-25T23:02:16.337943+0000","last_became_peered":"2024-04-25T23:02:16.337943+0000","last_unstale":"2024-04-25T23:02:34.749779+0000","last_undegraded":"2024-04-25T23:02:34.749779+0000","last_fullsized":"2024-04-25T23:02:16.191698+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":557,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-25T23:02:38.056934+0000","last_change":"2024-04-25T23:02:38.651838+0000","last_active":"2024-04-25T23:02:38.651838+0000","last_peered":"2024-04-25T23:02:38.056934+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.316513+0000","last_became_peered":"2024-04-25T23:02:16.316513+0000","last_unstale":"2024-04-25T23:02:38.056934+0000","last_undegraded":"2024-04-25T23:02:38.056934+0000","last_fullsized":"2024-04-25T23:02:16.165883+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":935,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167442+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:35.167442+0000","last_peered":"2024-04-25T23:02:35.167442+0000","last_clean":"2024-04-25T23:02:35.167442+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:35.167442+0000","last_undegraded":"2024-04-25T23:02:35.167442+0000","last_fullsized":"2024-04-25T23:02:35.167442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":623,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089872+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:38.089872+0000","last_peered":"2024-04-25T23:02:38.089872+0000","last_clean":"2024-04-25T23:02:38.089872+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:38.089872+0000","last_undegraded":"2024-04-25T23:02:38.089872+0000","last_fullsized":"2024-04-25T23:02:38.089872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1026,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166517+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:35.166517+0000","last_peered":"2024-04-25T23:02:35.166517+0000","last_clean":"2024-04-25T23:02:35.166517+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:35.166517+0000","last_undegraded":"2024-04-25T23:02:35.166517+0000","last_fullsized":"2024-04-25T23:02:35.166517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":676,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170521+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:35.170521+0000","last_peered":"2024-04-25T23:02:35.170521+0000","last_clean":"2024-04-25T23:02:35.170521+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:35.170521+0000","last_undegraded":"2024-04-25T23:02:35.170521+0000","last_fullsized":"2024-04-25T23:02:35.170521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":643,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091359+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:38.091359+0000","last_peered":"2024-04-25T23:02:38.091359+0000","last_clean":"2024-04-25T23:02:38.091359+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:38.091359+0000","last_undegraded":"2024-04-25T23:02:38.091359+0000","last_fullsized":"2024-04-25T23:02:38.091359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":704,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172754+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:35.172754+0000","last_peered":"2024-04-25T23:02:35.172754+0000","last_clean":"2024-04-25T23:02:35.172754+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:35.172754+0000","last_undegraded":"2024-04-25T23:02:35.172754+0000","last_fullsized":"2024-04-25T23:02:35.172754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":570,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090904+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:38.090904+0000","last_peered":"2024-04-25T23:02:38.090904+0000","last_clean":"2024-04-25T23:02:38.090904+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:38.090904+0000","last_undegraded":"2024-04-25T23:02:38.090904+0000","last_fullsized":"2024-04-25T23:02:38.090904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":204,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167034+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:35.167034+0000","last_peered":"2024-04-25T23:02:35.167034+0000","last_clean":"2024-04-25T23:02:35.167034+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:35.167034+0000","last_undegraded":"2024-04-25T23:02:35.167034+0000","last_fullsized":"2024-04-25T23:02:35.167034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":656,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169386+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:35.169386+0000","last_peered":"2024-04-25T23:02:35.169386+0000","last_clean":"2024-04-25T23:02:35.169386+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:35.169386+0000","last_undegraded":"2024-04-25T23:02:35.169386+0000","last_fullsized":"2024-04-25T23:02:35.169386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":67,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090205+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:38.090205+0000","last_peered":"2024-04-25T23:02:38.090205+0000","last_clean":"2024-04-25T23:02:38.090205+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:38.090205+0000","last_undegraded":"2024-04-25T23:02:38.090205+0000","last_fullsized":"2024-04-25T23:02:38.090205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":615,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168892+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:35.168892+0000","last_peered":"2024-04-25T23:02:35.168892+0000","last_clean":"2024-04-25T23:02:35.168892+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:35.168892+0000","last_undegraded":"2024-04-25T23:02:35.168892+0000","last_fullsized":"2024-04-25T23:02:35.168892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170613+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:35.170613+0000","last_peered":"2024-04-25T23:02:35.170613+0000","last_clean":"2024-04-25T23:02:35.170613+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:35.170613+0000","last_undegraded":"2024-04-25T23:02:35.170613+0000","last_fullsized":"2024-04-25T23:02:35.170613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":323,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173249+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:35.173249+0000","last_peered":"2024-04-25T23:02:35.173249+0000","last_clean":"2024-04-25T23:02:35.173249+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:35.173249+0000","last_undegraded":"2024-04-25T23:02:35.173249+0000","last_fullsized":"2024-04-25T23:02:35.173249+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":619,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089595+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:38.089595+0000","last_peered":"2024-04-25T23:02:38.089595+0000","last_clean":"2024-04-25T23:02:38.089595+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:38.089595+0000","last_undegraded":"2024-04-25T23:02:38.089595+0000","last_fullsized":"2024-04-25T23:02:38.089595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":439,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090646+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:38.090646+0000","last_peered":"2024-04-25T23:02:38.090646+0000","last_clean":"2024-04-25T23:02:38.090646+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:38.090646+0000","last_undegraded":"2024-04-25T23:02:38.090646+0000","last_fullsized":"2024-04-25T23:02:38.090646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":651,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.087890+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:38.087890+0000","last_peered":"2024-04-25T23:02:38.087890+0000","last_clean":"2024-04-25T23:02:38.087890+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:38.087890+0000","last_undegraded":"2024-04-25T23:02:38.087890+0000","last_fullsized":"2024-04-25T23:02:38.087890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":657,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.174855+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:35.174855+0000","last_peered":"2024-04-25T23:02:35.174855+0000","last_clean":"2024-04-25T23:02:35.174855+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:35.174855+0000","last_undegraded":"2024-04-25T23:02:35.174855+0000","last_fullsized":"2024-04-25T23:02:35.174855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":602,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171436+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:35.171436+0000","last_peered":"2024-04-25T23:02:35.171436+0000","last_clean":"2024-04-25T23:02:35.171436+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:35.171436+0000","last_undegraded":"2024-04-25T23:02:35.171436+0000","last_fullsized":"2024-04-25T23:02:35.171436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":227,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172718+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:35.172718+0000","last_peered":"2024-04-25T23:02:35.172718+0000","last_clean":"2024-04-25T23:02:35.172718+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:35.172718+0000","last_undegraded":"2024-04-25T23:02:35.172718+0000","last_fullsized":"2024-04-25T23:02:35.172718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":668,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167865+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:35.167865+0000","last_peered":"2024-04-25T23:02:35.167865+0000","last_clean":"2024-04-25T23:02:35.167865+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:35.167865+0000","last_undegraded":"2024-04-25T23:02:35.167865+0000","last_fullsized":"2024-04-25T23:02:35.167865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":294,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168011+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:35.168011+0000","last_peered":"2024-04-25T23:02:35.168011+0000","last_clean":"2024-04-25T23:02:35.168011+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:35.168011+0000","last_undegraded":"2024-04-25T23:02:35.168011+0000","last_fullsized":"2024-04-25T23:02:35.168011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":624,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172119+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:35.172119+0000","last_peered":"2024-04-25T23:02:35.172119+0000","last_clean":"2024-04-25T23:02:35.172119+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:35.172119+0000","last_undegraded":"2024-04-25T23:02:35.172119+0000","last_fullsized":"2024-04-25T23:02:35.172119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":281,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172225+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:35.172225+0000","last_peered":"2024-04-25T23:02:35.172225+0000","last_clean":"2024-04-25T23:02:35.172225+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:35.172225+0000","last_undegraded":"2024-04-25T23:02:35.172225+0000","last_fullsized":"2024-04-25T23:02:35.172225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":868,"reported_epoch":90,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T23:02:35.641736+0000","last_change":"2024-04-25T23:02:35.235425+0000","last_active":"2024-04-25T23:02:35.641736+0000","last_peered":"2024-04-25T23:02:35.641736+0000","last_clean":"2024-04-25T22:59:33.272608+0000","last_became_active":"2024-04-25T23:02:16.338558+0000","last_became_peered":"2024-04-25T23:02:16.338558+0000","last_unstale":"2024-04-25T23:02:35.641736+0000","last_undegraded":"2024-04-25T23:02:35.641736+0000","last_fullsized":"2024-04-25T23:02:16.197751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":67,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089482+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:38.089482+0000","last_peered":"2024-04-25T23:02:38.089482+0000","last_clean":"2024-04-25T23:02:38.089482+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:38.089482+0000","last_undegraded":"2024-04-25T23:02:38.089482+0000","last_fullsized":"2024-04-25T23:02:38.089482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":893,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172760+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:35.172760+0000","last_peered":"2024-04-25T23:02:35.172760+0000","last_clean":"2024-04-25T23:02:35.172760+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:35.172760+0000","last_undegraded":"2024-04-25T23:02:35.172760+0000","last_fullsized":"2024-04-25T23:02:35.172760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":626,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089126+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:38.089126+0000","last_peered":"2024-04-25T23:02:38.089126+0000","last_clean":"2024-04-25T23:02:38.089126+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:38.089126+0000","last_undegraded":"2024-04-25T23:02:38.089126+0000","last_fullsized":"2024-04-25T23:02:38.089126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":570,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.169220+0000","last_change":"2024-04-25T23:02:16.335886+0000","last_active":"2024-04-25T23:02:35.169220+0000","last_peered":"2024-04-25T23:02:35.169220+0000","last_clean":"2024-04-25T22:59:32.892903+0000","last_became_active":"2024-04-25T23:02:16.325195+0000","last_became_peered":"2024-04-25T23:02:16.325195+0000","last_unstale":"2024-04-25T23:02:35.169220+0000","last_undegraded":"2024-04-25T23:02:16.191750+0000","last_fullsized":"2024-04-25T23:02:16.173053+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":177,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":372,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172175+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:35.172175+0000","last_peered":"2024-04-25T23:02:35.172175+0000","last_clean":"2024-04-25T23:02:35.172175+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:35.172175+0000","last_undegraded":"2024-04-25T23:02:35.172175+0000","last_fullsized":"2024-04-25T23:02:35.172175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173477+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:35.173477+0000","last_peered":"2024-04-25T23:02:35.173477+0000","last_clean":"2024-04-25T23:02:35.173477+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:35.173477+0000","last_undegraded":"2024-04-25T23:02:35.173477+0000","last_fullsized":"2024-04-25T23:02:35.173477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":797,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167366+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:35.167366+0000","last_peered":"2024-04-25T23:02:35.167366+0000","last_clean":"2024-04-25T23:02:35.167366+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:35.167366+0000","last_undegraded":"2024-04-25T23:02:35.167366+0000","last_fullsized":"2024-04-25T23:02:35.167366+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":655,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.174315+0000","last_change":"2024-04-25T23:02:16.345583+0000","last_active":"2024-04-25T23:02:35.174315+0000","last_peered":"2024-04-25T23:02:35.174315+0000","last_clean":"2024-04-25T22:59:33.272809+0000","last_became_active":"2024-04-25T23:02:16.342554+0000","last_became_peered":"2024-04-25T23:02:16.342554+0000","last_unstale":"2024-04-25T23:02:35.174315+0000","last_undegraded":"2024-04-25T23:02:16.202781+0000","last_fullsized":"2024-04-25T23:02:16.198394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172514+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:35.172514+0000","last_peered":"2024-04-25T23:02:35.172514+0000","last_clean":"2024-04-25T23:02:35.172514+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:35.172514+0000","last_undegraded":"2024-04-25T23:02:35.172514+0000","last_fullsized":"2024-04-25T23:02:35.172514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167887+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:35.167887+0000","last_peered":"2024-04-25T23:02:35.167887+0000","last_clean":"2024-04-25T23:02:35.167887+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:35.167887+0000","last_undegraded":"2024-04-25T23:02:35.167887+0000","last_fullsized":"2024-04-25T23:02:35.167887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":590,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.092243+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:38.092243+0000","last_peered":"2024-04-25T23:02:38.092243+0000","last_clean":"2024-04-25T23:02:38.092243+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:38.092243+0000","last_undegraded":"2024-04-25T23:02:38.092243+0000","last_fullsized":"2024-04-25T23:02:38.092243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168075+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:35.168075+0000","last_peered":"2024-04-25T23:02:35.168075+0000","last_clean":"2024-04-25T23:02:35.168075+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:35.168075+0000","last_undegraded":"2024-04-25T23:02:35.168075+0000","last_fullsized":"2024-04-25T23:02:35.168075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":489,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.088549+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:38.088549+0000","last_peered":"2024-04-25T23:02:38.088549+0000","last_clean":"2024-04-25T23:02:38.088549+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:38.088549+0000","last_undegraded":"2024-04-25T23:02:38.088549+0000","last_fullsized":"2024-04-25T23:02:38.088549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":555,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.169514+0000","last_change":"2024-04-25T23:02:16.336587+0000","last_active":"2024-04-25T23:02:35.169514+0000","last_peered":"2024-04-25T23:02:35.169514+0000","last_clean":"2024-04-25T22:59:32.893156+0000","last_became_active":"2024-04-25T23:02:16.330744+0000","last_became_peered":"2024-04-25T23:02:16.330744+0000","last_unstale":"2024-04-25T23:02:35.169514+0000","last_undegraded":"2024-04-25T23:02:16.203382+0000","last_fullsized":"2024-04-25T23:02:16.192794+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172514+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:35.172514+0000","last_peered":"2024-04-25T23:02:35.172514+0000","last_clean":"2024-04-25T23:02:35.172514+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:35.172514+0000","last_undegraded":"2024-04-25T23:02:35.172514+0000","last_fullsized":"2024-04-25T23:02:35.172514+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173080+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:35.173080+0000","last_peered":"2024-04-25T23:02:35.173080+0000","last_clean":"2024-04-25T23:02:35.173080+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:35.173080+0000","last_undegraded":"2024-04-25T23:02:35.173080+0000","last_fullsized":"2024-04-25T23:02:35.173080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":919,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167868+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:35.167868+0000","last_peered":"2024-04-25T23:02:35.167868+0000","last_clean":"2024-04-25T23:02:35.167868+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:35.167868+0000","last_undegraded":"2024-04-25T23:02:35.167868+0000","last_fullsized":"2024-04-25T23:02:35.167868+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":436,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.174906+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:35.174906+0000","last_peered":"2024-04-25T23:02:35.174906+0000","last_clean":"2024-04-25T23:02:35.174906+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:35.174906+0000","last_undegraded":"2024-04-25T23:02:35.174906+0000","last_fullsized":"2024-04-25T23:02:35.174906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168432+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:35.168432+0000","last_peered":"2024-04-25T23:02:35.168432+0000","last_clean":"2024-04-25T23:02:35.168432+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:35.168432+0000","last_undegraded":"2024-04-25T23:02:35.168432+0000","last_fullsized":"2024-04-25T23:02:35.168432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":505,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090014+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:38.090014+0000","last_peered":"2024-04-25T23:02:38.090014+0000","last_clean":"2024-04-25T23:02:38.090014+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:38.090014+0000","last_undegraded":"2024-04-25T23:02:38.090014+0000","last_fullsized":"2024-04-25T23:02:38.090014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":213,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168202+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:35.168202+0000","last_peered":"2024-04-25T23:02:35.168202+0000","last_clean":"2024-04-25T23:02:35.168202+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:35.168202+0000","last_undegraded":"2024-04-25T23:02:35.168202+0000","last_fullsized":"2024-04-25T23:02:35.168202+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091797+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:38.091797+0000","last_peered":"2024-04-25T23:02:38.091797+0000","last_clean":"2024-04-25T23:02:38.091797+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:38.091797+0000","last_undegraded":"2024-04-25T23:02:38.091797+0000","last_fullsized":"2024-04-25T23:02:38.091797+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":600,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089869+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:38.089869+0000","last_peered":"2024-04-25T23:02:38.089869+0000","last_clean":"2024-04-25T23:02:38.089869+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:38.089869+0000","last_undegraded":"2024-04-25T23:02:38.089869+0000","last_fullsized":"2024-04-25T23:02:38.089869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":224,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170918+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:35.170918+0000","last_peered":"2024-04-25T23:02:35.170918+0000","last_clean":"2024-04-25T23:02:35.170918+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:35.170918+0000","last_undegraded":"2024-04-25T23:02:35.170918+0000","last_fullsized":"2024-04-25T23:02:35.170918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169633+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:35.169633+0000","last_peered":"2024-04-25T23:02:35.169633+0000","last_clean":"2024-04-25T23:02:35.169633+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:35.169633+0000","last_undegraded":"2024-04-25T23:02:35.169633+0000","last_fullsized":"2024-04-25T23:02:35.169633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":559,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167152+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:35.167152+0000","last_peered":"2024-04-25T23:02:35.167152+0000","last_clean":"2024-04-25T23:02:35.167152+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:35.167152+0000","last_undegraded":"2024-04-25T23:02:35.167152+0000","last_fullsized":"2024-04-25T23:02:35.167152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":263,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169538+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:35.169538+0000","last_peered":"2024-04-25T23:02:35.169538+0000","last_clean":"2024-04-25T23:02:35.169538+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:35.169538+0000","last_undegraded":"2024-04-25T23:02:35.169538+0000","last_fullsized":"2024-04-25T23:02:35.169538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173408+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:35.173408+0000","last_peered":"2024-04-25T23:02:35.173408+0000","last_clean":"2024-04-25T23:02:35.173408+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:35.173408+0000","last_undegraded":"2024-04-25T23:02:35.173408+0000","last_fullsized":"2024-04-25T23:02:35.173408+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":638,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090514+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:38.090514+0000","last_peered":"2024-04-25T23:02:38.090514+0000","last_clean":"2024-04-25T23:02:38.090514+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:38.090514+0000","last_undegraded":"2024-04-25T23:02:38.090514+0000","last_fullsized":"2024-04-25T23:02:38.090514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":990,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172137+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:35.172137+0000","last_peered":"2024-04-25T23:02:35.172137+0000","last_clean":"2024-04-25T23:02:35.172137+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:35.172137+0000","last_undegraded":"2024-04-25T23:02:35.172137+0000","last_fullsized":"2024-04-25T23:02:35.172137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":423,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172418+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:35.172418+0000","last_peered":"2024-04-25T23:02:35.172418+0000","last_clean":"2024-04-25T23:02:35.172418+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:35.172418+0000","last_undegraded":"2024-04-25T23:02:35.172418+0000","last_fullsized":"2024-04-25T23:02:35.172418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":982,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166791+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:35.166791+0000","last_peered":"2024-04-25T23:02:35.166791+0000","last_clean":"2024-04-25T23:02:35.166791+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:35.166791+0000","last_undegraded":"2024-04-25T23:02:35.166791+0000","last_fullsized":"2024-04-25T23:02:35.166791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091293+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:38.091293+0000","last_peered":"2024-04-25T23:02:38.091293+0000","last_clean":"2024-04-25T23:02:38.091293+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:38.091293+0000","last_undegraded":"2024-04-25T23:02:38.091293+0000","last_fullsized":"2024-04-25T23:02:38.091293+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":366,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.173385+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:35.173385+0000","last_peered":"2024-04-25T23:02:35.173385+0000","last_clean":"2024-04-25T23:02:35.173385+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:35.173385+0000","last_undegraded":"2024-04-25T23:02:35.173385+0000","last_fullsized":"2024-04-25T23:02:35.173385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":662,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166647+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:35.166647+0000","last_peered":"2024-04-25T23:02:35.166647+0000","last_clean":"2024-04-25T23:02:35.166647+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:35.166647+0000","last_undegraded":"2024-04-25T23:02:35.166647+0000","last_fullsized":"2024-04-25T23:02:35.166647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":221,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.170258+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:35.170258+0000","last_peered":"2024-04-25T23:02:35.170258+0000","last_clean":"2024-04-25T23:02:35.170258+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:35.170258+0000","last_undegraded":"2024-04-25T23:02:35.170258+0000","last_fullsized":"2024-04-25T23:02:35.170258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1027,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.166775+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:35.166775+0000","last_peered":"2024-04-25T23:02:35.166775+0000","last_clean":"2024-04-25T23:02:35.166775+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:35.166775+0000","last_undegraded":"2024-04-25T23:02:35.166775+0000","last_fullsized":"2024-04-25T23:02:35.166775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":495,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.088837+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:38.088837+0000","last_peered":"2024-04-25T23:02:38.088837+0000","last_clean":"2024-04-25T23:02:38.088837+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:38.088837+0000","last_undegraded":"2024-04-25T23:02:38.088837+0000","last_fullsized":"2024-04-25T23:02:38.088837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":741,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167443+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:35.167443+0000","last_peered":"2024-04-25T23:02:35.167443+0000","last_clean":"2024-04-25T23:02:35.167443+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:35.167443+0000","last_undegraded":"2024-04-25T23:02:35.167443+0000","last_fullsized":"2024-04-25T23:02:35.167443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.168874+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:35.168874+0000","last_peered":"2024-04-25T23:02:35.168874+0000","last_clean":"2024-04-25T23:02:35.168874+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:35.168874+0000","last_undegraded":"2024-04-25T23:02:35.168874+0000","last_fullsized":"2024-04-25T23:02:35.168874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.167029+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:35.167029+0000","last_peered":"2024-04-25T23:02:35.167029+0000","last_clean":"2024-04-25T23:02:35.167029+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:35.167029+0000","last_undegraded":"2024-04-25T23:02:35.167029+0000","last_fullsized":"2024-04-25T23:02:35.167029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":582,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091042+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:38.091042+0000","last_peered":"2024-04-25T23:02:38.091042+0000","last_clean":"2024-04-25T23:02:38.091042+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:38.091042+0000","last_undegraded":"2024-04-25T23:02:38.091042+0000","last_fullsized":"2024-04-25T23:02:38.091042+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":372,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089707+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:38.089707+0000","last_peered":"2024-04-25T23:02:38.089707+0000","last_clean":"2024-04-25T23:02:38.089707+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:38.089707+0000","last_undegraded":"2024-04-25T23:02:38.089707+0000","last_fullsized":"2024-04-25T23:02:38.089707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":535,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091019+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:38.091019+0000","last_peered":"2024-04-25T23:02:38.091019+0000","last_clean":"2024-04-25T23:02:38.091019+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:38.091019+0000","last_undegraded":"2024-04-25T23:02:38.091019+0000","last_fullsized":"2024-04-25T23:02:38.091019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090007+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:38.090007+0000","last_peered":"2024-04-25T23:02:38.090007+0000","last_clean":"2024-04-25T23:02:38.090007+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:38.090007+0000","last_undegraded":"2024-04-25T23:02:38.090007+0000","last_fullsized":"2024-04-25T23:02:38.090007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":582,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172291+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:35.172291+0000","last_peered":"2024-04-25T23:02:35.172291+0000","last_clean":"2024-04-25T23:02:35.172291+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:35.172291+0000","last_undegraded":"2024-04-25T23:02:35.172291+0000","last_fullsized":"2024-04-25T23:02:35.172291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.172234+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:35.172234+0000","last_peered":"2024-04-25T23:02:35.172234+0000","last_clean":"2024-04-25T23:02:35.172234+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:35.172234+0000","last_undegraded":"2024-04-25T23:02:35.172234+0000","last_fullsized":"2024-04-25T23:02:35.172234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":644,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171658+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:35.171658+0000","last_peered":"2024-04-25T23:02:35.171658+0000","last_clean":"2024-04-25T23:02:35.171658+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:35.171658+0000","last_undegraded":"2024-04-25T23:02:35.171658+0000","last_fullsized":"2024-04-25T23:02:35.171658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":436,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090543+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:38.090543+0000","last_peered":"2024-04-25T23:02:38.090543+0000","last_clean":"2024-04-25T23:02:38.090543+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:38.090543+0000","last_undegraded":"2024-04-25T23:02:38.090543+0000","last_fullsized":"2024-04-25T23:02:38.090543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":637,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089922+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:38.089922+0000","last_peered":"2024-04-25T23:02:38.089922+0000","last_clean":"2024-04-25T23:02:38.089922+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:38.089922+0000","last_undegraded":"2024-04-25T23:02:38.089922+0000","last_fullsized":"2024-04-25T23:02:38.089922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169352+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:35.169352+0000","last_peered":"2024-04-25T23:02:35.169352+0000","last_clean":"2024-04-25T23:02:35.169352+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:35.169352+0000","last_undegraded":"2024-04-25T23:02:35.169352+0000","last_fullsized":"2024-04-25T23:02:35.169352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":643,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.171369+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:35.171369+0000","last_peered":"2024-04-25T23:02:35.171369+0000","last_clean":"2024-04-25T23:02:35.171369+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:35.171369+0000","last_undegraded":"2024-04-25T23:02:35.171369+0000","last_fullsized":"2024-04-25T23:02:35.171369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T23:02:35.169831+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:35.169831+0000","last_peered":"2024-04-25T23:02:35.169831+0000","last_clean":"2024-04-25T23:02:35.169831+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:35.169831+0000","last_undegraded":"2024-04-25T23:02:35.169831+0000","last_fullsized":"2024-04-25T23:02:35.169831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115720,"kb_used_data":84028,"kb_used_omap":5,"kb_used_meta":31674,"kb_avail":94256120,"statfs":{"total":96636764160,"available":96518266880,"internally_reserved":0,"allocated":86044672,"data_stored":85547769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":32434315},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177812,"kb_used_data":80064,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94194028,"statfs":{"total":96636764160,"available":96454684672,"internally_reserved":0,"allocated":81985536,"data_stored":81531550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178952,"kb_used_data":89524,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192888,"statfs":{"total":96636764160,"available":96453517312,"internally_reserved":0,"allocated":91672576,"data_stored":91194434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:40.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T23:02:41.112 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:41.112 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1601/110 objects degraded (1455.455%), 9 pgs degraded","count":9},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":235,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":3,"num_up_osds":3,"osd_up_since":1714086134,"num_in_osds":3,"osd_in_since":1714085926,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":9},{"state_name":"peering","count":3},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":128569219,"bytes_used":488026112,"bytes_avail":289422266368,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":1601,"degraded_total":110,"degraded_ratio":14.554545454545455,"recovering_objects_per_sec":211,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":847,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4239}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-25T23:00:12.528425+0000","services":{}},"progress_events":{}} 2024-04-25T23:02:41.130 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T23:02:41.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:41.467 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-04-25T23:02:41.165157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":472592,"kb_used_data":253728,"kb_used_omap":8,"kb_used_meta":218807,"kb_avail":282642928,"statfs":{"total":289910292480,"available":289426358272,"internally_reserved":0,"allocated":259817472,"data_stored":258322391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":224058389},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1423,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1472,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.997358"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":636,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T23:02:35.170255+0000","last_change":"2024-04-25T23:02:16.336211+0000","last_active":"2024-04-25T23:02:35.170255+0000","last_peered":"2024-04-25T23:02:35.170255+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.329824+0000","last_became_peered":"2024-04-25T23:02:16.329824+0000","last_unstale":"2024-04-25T23:02:35.170255+0000","last_undegraded":"2024-04-25T23:02:16.203747+0000","last_fullsized":"2024-04-25T23:02:16.195496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":593,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091930+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:38.091930+0000","last_peered":"2024-04-25T23:02:38.091930+0000","last_clean":"2024-04-25T23:02:38.091930+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:38.091930+0000","last_undegraded":"2024-04-25T23:02:38.091930+0000","last_fullsized":"2024-04-25T23:02:38.091930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":907,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184801+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:40.184801+0000","last_peered":"2024-04-25T23:02:40.184801+0000","last_clean":"2024-04-25T23:02:40.184801+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:40.184801+0000","last_undegraded":"2024-04-25T23:02:40.184801+0000","last_fullsized":"2024-04-25T23:02:40.184801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184338+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:40.184338+0000","last_peered":"2024-04-25T23:02:40.184338+0000","last_clean":"2024-04-25T23:02:40.184338+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:40.184338+0000","last_undegraded":"2024-04-25T23:02:40.184338+0000","last_fullsized":"2024-04-25T23:02:40.184338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":644,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090210+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:38.090210+0000","last_peered":"2024-04-25T23:02:38.090210+0000","last_clean":"2024-04-25T23:02:38.090210+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:38.090210+0000","last_undegraded":"2024-04-25T23:02:38.090210+0000","last_fullsized":"2024-04-25T23:02:38.090210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":547,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183819+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:40.183819+0000","last_peered":"2024-04-25T23:02:40.183819+0000","last_clean":"2024-04-25T23:02:40.183819+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:40.183819+0000","last_undegraded":"2024-04-25T23:02:40.183819+0000","last_fullsized":"2024-04-25T23:02:40.183819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183182+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:40.183182+0000","last_peered":"2024-04-25T23:02:40.183182+0000","last_clean":"2024-04-25T23:02:40.183182+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:40.183182+0000","last_undegraded":"2024-04-25T23:02:40.183182+0000","last_fullsized":"2024-04-25T23:02:40.183182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.182906+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:40.182906+0000","last_peered":"2024-04-25T23:02:40.182906+0000","last_clean":"2024-04-25T23:02:40.182906+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:40.182906+0000","last_undegraded":"2024-04-25T23:02:40.182906+0000","last_fullsized":"2024-04-25T23:02:40.182906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":932,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169501+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:40.169501+0000","last_peered":"2024-04-25T23:02:40.169501+0000","last_clean":"2024-04-25T23:02:40.169501+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:40.169501+0000","last_undegraded":"2024-04-25T23:02:40.169501+0000","last_fullsized":"2024-04-25T23:02:40.169501+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":533,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090984+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:38.090984+0000","last_peered":"2024-04-25T23:02:38.090984+0000","last_clean":"2024-04-25T23:02:38.090984+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:38.090984+0000","last_undegraded":"2024-04-25T23:02:38.090984+0000","last_fullsized":"2024-04-25T23:02:38.090984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":594,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185003+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:40.185003+0000","last_peered":"2024-04-25T23:02:40.185003+0000","last_clean":"2024-04-25T23:02:40.185003+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:40.185003+0000","last_undegraded":"2024-04-25T23:02:40.185003+0000","last_fullsized":"2024-04-25T23:02:40.185003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":516,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091659+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:38.091659+0000","last_peered":"2024-04-25T23:02:38.091659+0000","last_clean":"2024-04-25T23:02:38.091659+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:38.091659+0000","last_undegraded":"2024-04-25T23:02:38.091659+0000","last_fullsized":"2024-04-25T23:02:38.091659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":861,"reported_epoch":95,"state":"active+undersized+remapped","last_fresh":"2024-04-25T23:02:40.168601+0000","last_change":"2024-04-25T23:02:40.160668+0000","last_active":"2024-04-25T23:02:40.168601+0000","last_peered":"2024-04-25T23:02:40.168601+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.264824+0000","last_became_peered":"2024-04-25T23:02:16.264824+0000","last_unstale":"2024-04-25T23:02:40.168601+0000","last_undegraded":"2024-04-25T23:02:40.168601+0000","last_fullsized":"2024-04-25T23:02:16.163698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1026,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183906+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:40.183906+0000","last_peered":"2024-04-25T23:02:40.183906+0000","last_clean":"2024-04-25T23:02:40.183906+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:40.183906+0000","last_undegraded":"2024-04-25T23:02:40.183906+0000","last_fullsized":"2024-04-25T23:02:40.183906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":974,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183319+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:40.183319+0000","last_peered":"2024-04-25T23:02:40.183319+0000","last_clean":"2024-04-25T23:02:40.183319+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:40.183319+0000","last_undegraded":"2024-04-25T23:02:40.183319+0000","last_fullsized":"2024-04-25T23:02:40.183319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.182977+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:40.182977+0000","last_peered":"2024-04-25T23:02:40.182977+0000","last_clean":"2024-04-25T23:02:40.182977+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:40.182977+0000","last_undegraded":"2024-04-25T23:02:40.182977+0000","last_fullsized":"2024-04-25T23:02:40.182977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1054,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-25T23:02:39.666517+0000","last_change":"2024-04-25T23:02:40.171937+0000","last_active":"2024-04-25T23:02:40.171937+0000","last_peered":"2024-04-25T23:02:39.666517+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:39.666517+0000","last_undegraded":"2024-04-25T23:02:39.666517+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091547+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:38.091547+0000","last_peered":"2024-04-25T23:02:38.091547+0000","last_clean":"2024-04-25T23:02:38.091547+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:38.091547+0000","last_undegraded":"2024-04-25T23:02:38.091547+0000","last_fullsized":"2024-04-25T23:02:38.091547+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1103,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169468+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:40.169468+0000","last_peered":"2024-04-25T23:02:40.169468+0000","last_clean":"2024-04-25T23:02:40.169468+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:40.169468+0000","last_undegraded":"2024-04-25T23:02:40.169468+0000","last_fullsized":"2024-04-25T23:02:40.169468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184392+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:40.184392+0000","last_peered":"2024-04-25T23:02:40.184392+0000","last_clean":"2024-04-25T23:02:40.184392+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:40.184392+0000","last_undegraded":"2024-04-25T23:02:40.184392+0000","last_fullsized":"2024-04-25T23:02:40.184392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":639,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184583+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:40.184583+0000","last_peered":"2024-04-25T23:02:40.184583+0000","last_clean":"2024-04-25T23:02:40.184583+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:40.184583+0000","last_undegraded":"2024-04-25T23:02:40.184583+0000","last_fullsized":"2024-04-25T23:02:40.184583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":660,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090334+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:38.090334+0000","last_peered":"2024-04-25T23:02:38.090334+0000","last_clean":"2024-04-25T23:02:38.090334+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:38.090334+0000","last_undegraded":"2024-04-25T23:02:38.090334+0000","last_fullsized":"2024-04-25T23:02:38.090334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.167888+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:40.167888+0000","last_peered":"2024-04-25T23:02:40.167888+0000","last_clean":"2024-04-25T23:02:40.167888+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:40.167888+0000","last_undegraded":"2024-04-25T23:02:40.167888+0000","last_fullsized":"2024-04-25T23:02:40.167888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":637,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089240+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:38.089240+0000","last_peered":"2024-04-25T23:02:38.089240+0000","last_clean":"2024-04-25T23:02:38.089240+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:38.089240+0000","last_undegraded":"2024-04-25T23:02:38.089240+0000","last_fullsized":"2024-04-25T23:02:38.089240+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":617,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090964+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:38.090964+0000","last_peered":"2024-04-25T23:02:38.090964+0000","last_clean":"2024-04-25T23:02:38.090964+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:38.090964+0000","last_undegraded":"2024-04-25T23:02:38.090964+0000","last_fullsized":"2024-04-25T23:02:38.090964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":658,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169921+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:40.169921+0000","last_peered":"2024-04-25T23:02:40.169921+0000","last_clean":"2024-04-25T23:02:40.169921+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:40.169921+0000","last_undegraded":"2024-04-25T23:02:40.169921+0000","last_fullsized":"2024-04-25T23:02:40.169921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":948,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185289+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:40.185289+0000","last_peered":"2024-04-25T23:02:40.185289+0000","last_clean":"2024-04-25T23:02:40.185289+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:40.185289+0000","last_undegraded":"2024-04-25T23:02:40.185289+0000","last_fullsized":"2024-04-25T23:02:40.185289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":557,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-25T23:02:38.056934+0000","last_change":"2024-04-25T23:02:38.651838+0000","last_active":"2024-04-25T23:02:38.651838+0000","last_peered":"2024-04-25T23:02:38.056934+0000","last_clean":"2024-04-25T22:59:05.744631+0000","last_became_active":"2024-04-25T23:02:16.316513+0000","last_became_peered":"2024-04-25T23:02:16.316513+0000","last_unstale":"2024-04-25T23:02:38.056934+0000","last_undegraded":"2024-04-25T23:02:38.056934+0000","last_fullsized":"2024-04-25T23:02:16.165883+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169444+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:40.169444+0000","last_peered":"2024-04-25T23:02:40.169444+0000","last_clean":"2024-04-25T23:02:40.169444+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:40.169444+0000","last_undegraded":"2024-04-25T23:02:40.169444+0000","last_fullsized":"2024-04-25T23:02:40.169444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":623,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089872+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:38.089872+0000","last_peered":"2024-04-25T23:02:38.089872+0000","last_clean":"2024-04-25T23:02:38.089872+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:38.089872+0000","last_undegraded":"2024-04-25T23:02:38.089872+0000","last_fullsized":"2024-04-25T23:02:38.089872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1036,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168047+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:40.168047+0000","last_peered":"2024-04-25T23:02:40.168047+0000","last_clean":"2024-04-25T23:02:40.168047+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:40.168047+0000","last_undegraded":"2024-04-25T23:02:40.168047+0000","last_fullsized":"2024-04-25T23:02:40.168047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":686,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183192+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:40.183192+0000","last_peered":"2024-04-25T23:02:40.183192+0000","last_clean":"2024-04-25T23:02:40.183192+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:40.183192+0000","last_undegraded":"2024-04-25T23:02:40.183192+0000","last_fullsized":"2024-04-25T23:02:40.183192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":643,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091359+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:38.091359+0000","last_peered":"2024-04-25T23:02:38.091359+0000","last_clean":"2024-04-25T23:02:38.091359+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:38.091359+0000","last_undegraded":"2024-04-25T23:02:38.091359+0000","last_fullsized":"2024-04-25T23:02:38.091359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":714,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185092+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:40.185092+0000","last_peered":"2024-04-25T23:02:40.185092+0000","last_clean":"2024-04-25T23:02:40.185092+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:40.185092+0000","last_undegraded":"2024-04-25T23:02:40.185092+0000","last_fullsized":"2024-04-25T23:02:40.185092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":570,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090904+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:38.090904+0000","last_peered":"2024-04-25T23:02:38.090904+0000","last_clean":"2024-04-25T23:02:38.090904+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:38.090904+0000","last_undegraded":"2024-04-25T23:02:38.090904+0000","last_fullsized":"2024-04-25T23:02:38.090904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168758+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:40.168758+0000","last_peered":"2024-04-25T23:02:40.168758+0000","last_clean":"2024-04-25T23:02:40.168758+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:40.168758+0000","last_undegraded":"2024-04-25T23:02:40.168758+0000","last_fullsized":"2024-04-25T23:02:40.168758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":666,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170227+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:40.170227+0000","last_peered":"2024-04-25T23:02:40.170227+0000","last_clean":"2024-04-25T23:02:40.170227+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:40.170227+0000","last_undegraded":"2024-04-25T23:02:40.170227+0000","last_fullsized":"2024-04-25T23:02:40.170227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":67,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090205+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:38.090205+0000","last_peered":"2024-04-25T23:02:38.090205+0000","last_clean":"2024-04-25T23:02:38.090205+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:38.090205+0000","last_undegraded":"2024-04-25T23:02:38.090205+0000","last_fullsized":"2024-04-25T23:02:38.090205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169648+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:40.169648+0000","last_peered":"2024-04-25T23:02:40.169648+0000","last_clean":"2024-04-25T23:02:40.169648+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:40.169648+0000","last_undegraded":"2024-04-25T23:02:40.169648+0000","last_fullsized":"2024-04-25T23:02:40.169648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":239,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183202+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:40.183202+0000","last_peered":"2024-04-25T23:02:40.183202+0000","last_clean":"2024-04-25T23:02:40.183202+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:40.183202+0000","last_undegraded":"2024-04-25T23:02:40.183202+0000","last_fullsized":"2024-04-25T23:02:40.183202+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":333,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185652+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:40.185652+0000","last_peered":"2024-04-25T23:02:40.185652+0000","last_clean":"2024-04-25T23:02:40.185652+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:40.185652+0000","last_undegraded":"2024-04-25T23:02:40.185652+0000","last_fullsized":"2024-04-25T23:02:40.185652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":619,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089595+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:38.089595+0000","last_peered":"2024-04-25T23:02:38.089595+0000","last_clean":"2024-04-25T23:02:38.089595+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:38.089595+0000","last_undegraded":"2024-04-25T23:02:38.089595+0000","last_fullsized":"2024-04-25T23:02:38.089595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":439,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090646+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:38.090646+0000","last_peered":"2024-04-25T23:02:38.090646+0000","last_clean":"2024-04-25T23:02:38.090646+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:38.090646+0000","last_undegraded":"2024-04-25T23:02:38.090646+0000","last_fullsized":"2024-04-25T23:02:38.090646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":651,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.087890+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:38.087890+0000","last_peered":"2024-04-25T23:02:38.087890+0000","last_clean":"2024-04-25T23:02:38.087890+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:38.087890+0000","last_undegraded":"2024-04-25T23:02:38.087890+0000","last_fullsized":"2024-04-25T23:02:38.087890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":667,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185961+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:40.185961+0000","last_peered":"2024-04-25T23:02:40.185961+0000","last_clean":"2024-04-25T23:02:40.185961+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:40.185961+0000","last_undegraded":"2024-04-25T23:02:40.185961+0000","last_fullsized":"2024-04-25T23:02:40.185961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184067+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:40.184067+0000","last_peered":"2024-04-25T23:02:40.184067+0000","last_clean":"2024-04-25T23:02:40.184067+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:40.184067+0000","last_undegraded":"2024-04-25T23:02:40.184067+0000","last_fullsized":"2024-04-25T23:02:40.184067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185364+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:40.185364+0000","last_peered":"2024-04-25T23:02:40.185364+0000","last_clean":"2024-04-25T23:02:40.185364+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:40.185364+0000","last_undegraded":"2024-04-25T23:02:40.185364+0000","last_fullsized":"2024-04-25T23:02:40.185364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":678,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170594+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:40.170594+0000","last_peered":"2024-04-25T23:02:40.170594+0000","last_clean":"2024-04-25T23:02:40.170594+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:40.170594+0000","last_undegraded":"2024-04-25T23:02:40.170594+0000","last_fullsized":"2024-04-25T23:02:40.170594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":304,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170886+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:40.170886+0000","last_peered":"2024-04-25T23:02:40.170886+0000","last_clean":"2024-04-25T23:02:40.170886+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:40.170886+0000","last_undegraded":"2024-04-25T23:02:40.170886+0000","last_fullsized":"2024-04-25T23:02:40.170886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":634,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184703+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:40.184703+0000","last_peered":"2024-04-25T23:02:40.184703+0000","last_clean":"2024-04-25T23:02:40.184703+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:40.184703+0000","last_undegraded":"2024-04-25T23:02:40.184703+0000","last_fullsized":"2024-04-25T23:02:40.184703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":291,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184602+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:40.184602+0000","last_peered":"2024-04-25T23:02:40.184602+0000","last_clean":"2024-04-25T23:02:40.184602+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:40.184602+0000","last_undegraded":"2024-04-25T23:02:40.184602+0000","last_fullsized":"2024-04-25T23:02:40.184602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":982,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185716+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:40.185716+0000","last_peered":"2024-04-25T23:02:40.185716+0000","last_clean":"2024-04-25T23:02:40.185716+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:40.185716+0000","last_undegraded":"2024-04-25T23:02:40.185716+0000","last_fullsized":"2024-04-25T23:02:40.185716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":67,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089482+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:38.089482+0000","last_peered":"2024-04-25T23:02:38.089482+0000","last_clean":"2024-04-25T23:02:38.089482+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:38.089482+0000","last_undegraded":"2024-04-25T23:02:38.089482+0000","last_fullsized":"2024-04-25T23:02:38.089482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":903,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184881+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:40.184881+0000","last_peered":"2024-04-25T23:02:40.184881+0000","last_clean":"2024-04-25T23:02:40.184881+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:40.184881+0000","last_undegraded":"2024-04-25T23:02:40.184881+0000","last_fullsized":"2024-04-25T23:02:40.184881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":626,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089126+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:38.089126+0000","last_peered":"2024-04-25T23:02:38.089126+0000","last_clean":"2024-04-25T23:02:38.089126+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:38.089126+0000","last_undegraded":"2024-04-25T23:02:38.089126+0000","last_fullsized":"2024-04-25T23:02:38.089126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":941,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169770+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:40.169770+0000","last_peered":"2024-04-25T23:02:40.169770+0000","last_clean":"2024-04-25T23:02:40.169770+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:40.169770+0000","last_undegraded":"2024-04-25T23:02:40.169770+0000","last_fullsized":"2024-04-25T23:02:40.169770+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":382,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183576+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:40.183576+0000","last_peered":"2024-04-25T23:02:40.183576+0000","last_clean":"2024-04-25T23:02:40.183576+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:40.183576+0000","last_undegraded":"2024-04-25T23:02:40.183576+0000","last_fullsized":"2024-04-25T23:02:40.183576+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185668+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:40.185668+0000","last_peered":"2024-04-25T23:02:40.185668+0000","last_clean":"2024-04-25T23:02:40.185668+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:40.185668+0000","last_undegraded":"2024-04-25T23:02:40.185668+0000","last_fullsized":"2024-04-25T23:02:40.185668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":807,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169120+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:40.169120+0000","last_peered":"2024-04-25T23:02:40.169120+0000","last_clean":"2024-04-25T23:02:40.169120+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:40.169120+0000","last_undegraded":"2024-04-25T23:02:40.169120+0000","last_fullsized":"2024-04-25T23:02:40.169120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1052,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185919+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:40.185919+0000","last_peered":"2024-04-25T23:02:40.185919+0000","last_clean":"2024-04-25T23:02:40.185919+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:40.185919+0000","last_undegraded":"2024-04-25T23:02:40.185919+0000","last_fullsized":"2024-04-25T23:02:40.185919+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183428+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:40.183428+0000","last_peered":"2024-04-25T23:02:40.183428+0000","last_clean":"2024-04-25T23:02:40.183428+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:40.183428+0000","last_undegraded":"2024-04-25T23:02:40.183428+0000","last_fullsized":"2024-04-25T23:02:40.183428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":359,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168632+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:40.168632+0000","last_peered":"2024-04-25T23:02:40.168632+0000","last_clean":"2024-04-25T23:02:40.168632+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:40.168632+0000","last_undegraded":"2024-04-25T23:02:40.168632+0000","last_fullsized":"2024-04-25T23:02:40.168632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":590,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.092243+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:38.092243+0000","last_peered":"2024-04-25T23:02:38.092243+0000","last_clean":"2024-04-25T23:02:38.092243+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:38.092243+0000","last_undegraded":"2024-04-25T23:02:38.092243+0000","last_fullsized":"2024-04-25T23:02:38.092243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168963+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:40.168963+0000","last_peered":"2024-04-25T23:02:40.168963+0000","last_clean":"2024-04-25T23:02:40.168963+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:40.168963+0000","last_undegraded":"2024-04-25T23:02:40.168963+0000","last_fullsized":"2024-04-25T23:02:40.168963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":489,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.088549+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:38.088549+0000","last_peered":"2024-04-25T23:02:38.088549+0000","last_clean":"2024-04-25T23:02:38.088549+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:38.088549+0000","last_undegraded":"2024-04-25T23:02:38.088549+0000","last_fullsized":"2024-04-25T23:02:38.088549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":884,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.176356+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:40.176356+0000","last_peered":"2024-04-25T23:02:40.176356+0000","last_clean":"2024-04-25T23:02:40.176356+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:40.176356+0000","last_undegraded":"2024-04-25T23:02:40.176356+0000","last_fullsized":"2024-04-25T23:02:40.176356+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184583+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:40.184583+0000","last_peered":"2024-04-25T23:02:40.184583+0000","last_clean":"2024-04-25T23:02:40.184583+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:40.184583+0000","last_undegraded":"2024-04-25T23:02:40.184583+0000","last_fullsized":"2024-04-25T23:02:40.184583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":239,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185396+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:40.185396+0000","last_peered":"2024-04-25T23:02:40.185396+0000","last_clean":"2024-04-25T23:02:40.185396+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:40.185396+0000","last_undegraded":"2024-04-25T23:02:40.185396+0000","last_fullsized":"2024-04-25T23:02:40.185396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":929,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169989+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:40.169989+0000","last_peered":"2024-04-25T23:02:40.169989+0000","last_clean":"2024-04-25T23:02:40.169989+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:40.169989+0000","last_undegraded":"2024-04-25T23:02:40.169989+0000","last_fullsized":"2024-04-25T23:02:40.169989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":446,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.186064+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:40.186064+0000","last_peered":"2024-04-25T23:02:40.186064+0000","last_clean":"2024-04-25T23:02:40.186064+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:40.186064+0000","last_undegraded":"2024-04-25T23:02:40.186064+0000","last_fullsized":"2024-04-25T23:02:40.186064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170294+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:40.170294+0000","last_peered":"2024-04-25T23:02:40.170294+0000","last_clean":"2024-04-25T23:02:40.170294+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:40.170294+0000","last_undegraded":"2024-04-25T23:02:40.170294+0000","last_fullsized":"2024-04-25T23:02:40.170294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":505,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090014+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:38.090014+0000","last_peered":"2024-04-25T23:02:38.090014+0000","last_clean":"2024-04-25T23:02:38.090014+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:38.090014+0000","last_undegraded":"2024-04-25T23:02:38.090014+0000","last_fullsized":"2024-04-25T23:02:38.090014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170146+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:40.170146+0000","last_peered":"2024-04-25T23:02:40.170146+0000","last_clean":"2024-04-25T23:02:40.170146+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:40.170146+0000","last_undegraded":"2024-04-25T23:02:40.170146+0000","last_fullsized":"2024-04-25T23:02:40.170146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091797+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:38.091797+0000","last_peered":"2024-04-25T23:02:38.091797+0000","last_clean":"2024-04-25T23:02:38.091797+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:38.091797+0000","last_undegraded":"2024-04-25T23:02:38.091797+0000","last_fullsized":"2024-04-25T23:02:38.091797+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":600,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089869+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:38.089869+0000","last_peered":"2024-04-25T23:02:38.089869+0000","last_clean":"2024-04-25T23:02:38.089869+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:38.089869+0000","last_undegraded":"2024-04-25T23:02:38.089869+0000","last_fullsized":"2024-04-25T23:02:38.089869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170943+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:40.170943+0000","last_peered":"2024-04-25T23:02:40.170943+0000","last_clean":"2024-04-25T23:02:40.170943+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:40.170943+0000","last_undegraded":"2024-04-25T23:02:40.170943+0000","last_fullsized":"2024-04-25T23:02:40.170943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170523+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:40.170523+0000","last_peered":"2024-04-25T23:02:40.170523+0000","last_clean":"2024-04-25T23:02:40.170523+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:40.170523+0000","last_undegraded":"2024-04-25T23:02:40.170523+0000","last_fullsized":"2024-04-25T23:02:40.170523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168426+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:40.168426+0000","last_peered":"2024-04-25T23:02:40.168426+0000","last_clean":"2024-04-25T23:02:40.168426+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:40.168426+0000","last_undegraded":"2024-04-25T23:02:40.168426+0000","last_fullsized":"2024-04-25T23:02:40.168426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170404+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:40.170404+0000","last_peered":"2024-04-25T23:02:40.170404+0000","last_clean":"2024-04-25T23:02:40.170404+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:40.170404+0000","last_undegraded":"2024-04-25T23:02:40.170404+0000","last_fullsized":"2024-04-25T23:02:40.170404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185799+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:40.185799+0000","last_peered":"2024-04-25T23:02:40.185799+0000","last_clean":"2024-04-25T23:02:40.185799+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:40.185799+0000","last_undegraded":"2024-04-25T23:02:40.185799+0000","last_fullsized":"2024-04-25T23:02:40.185799+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":638,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090514+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:38.090514+0000","last_peered":"2024-04-25T23:02:38.090514+0000","last_clean":"2024-04-25T23:02:38.090514+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:38.090514+0000","last_undegraded":"2024-04-25T23:02:38.090514+0000","last_fullsized":"2024-04-25T23:02:38.090514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1000,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184286+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:40.184286+0000","last_peered":"2024-04-25T23:02:40.184286+0000","last_clean":"2024-04-25T23:02:40.184286+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:40.184286+0000","last_undegraded":"2024-04-25T23:02:40.184286+0000","last_fullsized":"2024-04-25T23:02:40.184286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":433,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185237+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:40.185237+0000","last_peered":"2024-04-25T23:02:40.185237+0000","last_clean":"2024-04-25T23:02:40.185237+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:40.185237+0000","last_undegraded":"2024-04-25T23:02:40.185237+0000","last_fullsized":"2024-04-25T23:02:40.185237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":992,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168568+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:40.168568+0000","last_peered":"2024-04-25T23:02:40.168568+0000","last_clean":"2024-04-25T23:02:40.168568+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:40.168568+0000","last_undegraded":"2024-04-25T23:02:40.168568+0000","last_fullsized":"2024-04-25T23:02:40.168568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091293+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:38.091293+0000","last_peered":"2024-04-25T23:02:38.091293+0000","last_clean":"2024-04-25T23:02:38.091293+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:38.091293+0000","last_undegraded":"2024-04-25T23:02:38.091293+0000","last_fullsized":"2024-04-25T23:02:38.091293+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":376,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185445+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:40.185445+0000","last_peered":"2024-04-25T23:02:40.185445+0000","last_clean":"2024-04-25T23:02:40.185445+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:40.185445+0000","last_undegraded":"2024-04-25T23:02:40.185445+0000","last_fullsized":"2024-04-25T23:02:40.185445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":672,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168289+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:40.168289+0000","last_peered":"2024-04-25T23:02:40.168289+0000","last_clean":"2024-04-25T23:02:40.168289+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:40.168289+0000","last_undegraded":"2024-04-25T23:02:40.168289+0000","last_fullsized":"2024-04-25T23:02:40.168289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170701+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:40.170701+0000","last_peered":"2024-04-25T23:02:40.170701+0000","last_clean":"2024-04-25T23:02:40.170701+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:40.170701+0000","last_undegraded":"2024-04-25T23:02:40.170701+0000","last_fullsized":"2024-04-25T23:02:40.170701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1037,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168366+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:40.168366+0000","last_peered":"2024-04-25T23:02:40.168366+0000","last_clean":"2024-04-25T23:02:40.168366+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:40.168366+0000","last_undegraded":"2024-04-25T23:02:40.168366+0000","last_fullsized":"2024-04-25T23:02:40.168366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":495,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.088837+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:38.088837+0000","last_peered":"2024-04-25T23:02:38.088837+0000","last_clean":"2024-04-25T23:02:38.088837+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:38.088837+0000","last_undegraded":"2024-04-25T23:02:38.088837+0000","last_fullsized":"2024-04-25T23:02:38.088837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":751,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168669+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:40.168669+0000","last_peered":"2024-04-25T23:02:40.168669+0000","last_clean":"2024-04-25T23:02:40.168669+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:40.168669+0000","last_undegraded":"2024-04-25T23:02:40.168669+0000","last_fullsized":"2024-04-25T23:02:40.168669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169843+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:40.169843+0000","last_peered":"2024-04-25T23:02:40.169843+0000","last_clean":"2024-04-25T23:02:40.169843+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:40.169843+0000","last_undegraded":"2024-04-25T23:02:40.169843+0000","last_fullsized":"2024-04-25T23:02:40.169843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168619+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:40.168619+0000","last_peered":"2024-04-25T23:02:40.168619+0000","last_clean":"2024-04-25T23:02:40.168619+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:40.168619+0000","last_undegraded":"2024-04-25T23:02:40.168619+0000","last_fullsized":"2024-04-25T23:02:40.168619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":582,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091042+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:38.091042+0000","last_peered":"2024-04-25T23:02:38.091042+0000","last_clean":"2024-04-25T23:02:38.091042+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:38.091042+0000","last_undegraded":"2024-04-25T23:02:38.091042+0000","last_fullsized":"2024-04-25T23:02:38.091042+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":372,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089707+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:38.089707+0000","last_peered":"2024-04-25T23:02:38.089707+0000","last_clean":"2024-04-25T23:02:38.089707+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:38.089707+0000","last_undegraded":"2024-04-25T23:02:38.089707+0000","last_fullsized":"2024-04-25T23:02:38.089707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":535,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.091019+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:38.091019+0000","last_peered":"2024-04-25T23:02:38.091019+0000","last_clean":"2024-04-25T23:02:38.091019+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:38.091019+0000","last_undegraded":"2024-04-25T23:02:38.091019+0000","last_fullsized":"2024-04-25T23:02:38.091019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090007+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:38.090007+0000","last_peered":"2024-04-25T23:02:38.090007+0000","last_clean":"2024-04-25T23:02:38.090007+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:38.090007+0000","last_undegraded":"2024-04-25T23:02:38.090007+0000","last_fullsized":"2024-04-25T23:02:38.090007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":592,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184286+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:40.184286+0000","last_peered":"2024-04-25T23:02:40.184286+0000","last_clean":"2024-04-25T23:02:40.184286+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:40.184286+0000","last_undegraded":"2024-04-25T23:02:40.184286+0000","last_fullsized":"2024-04-25T23:02:40.184286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185064+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:40.185064+0000","last_peered":"2024-04-25T23:02:40.185064+0000","last_clean":"2024-04-25T23:02:40.185064+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:40.185064+0000","last_undegraded":"2024-04-25T23:02:40.185064+0000","last_fullsized":"2024-04-25T23:02:40.185064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":654,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184214+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:40.184214+0000","last_peered":"2024-04-25T23:02:40.184214+0000","last_clean":"2024-04-25T23:02:40.184214+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:40.184214+0000","last_undegraded":"2024-04-25T23:02:40.184214+0000","last_fullsized":"2024-04-25T23:02:40.184214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":436,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.090543+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:38.090543+0000","last_peered":"2024-04-25T23:02:38.090543+0000","last_clean":"2024-04-25T23:02:38.090543+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:38.090543+0000","last_undegraded":"2024-04-25T23:02:38.090543+0000","last_fullsized":"2024-04-25T23:02:38.090543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":637,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T23:02:38.089922+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:38.089922+0000","last_peered":"2024-04-25T23:02:38.089922+0000","last_clean":"2024-04-25T23:02:38.089922+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:38.089922+0000","last_undegraded":"2024-04-25T23:02:38.089922+0000","last_fullsized":"2024-04-25T23:02:38.089922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170234+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:40.170234+0000","last_peered":"2024-04-25T23:02:40.170234+0000","last_clean":"2024-04-25T23:02:40.170234+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:40.170234+0000","last_undegraded":"2024-04-25T23:02:40.170234+0000","last_fullsized":"2024-04-25T23:02:40.170234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":653,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183421+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:40.183421+0000","last_peered":"2024-04-25T23:02:40.183421+0000","last_clean":"2024-04-25T23:02:40.183421+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:40.183421+0000","last_undegraded":"2024-04-25T23:02:40.183421+0000","last_fullsized":"2024-04-25T23:02:40.183421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170026+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:40.170026+0000","last_peered":"2024-04-25T23:02:40.170026+0000","last_clean":"2024-04-25T23:02:40.170026+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:40.170026+0000","last_undegraded":"2024-04-25T23:02:40.170026+0000","last_fullsized":"2024-04-25T23:02:40.170026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7287,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115720,"kb_used_data":84028,"kb_used_omap":5,"kb_used_meta":31674,"kb_avail":94256120,"statfs":{"total":96636764160,"available":96518266880,"internally_reserved":0,"allocated":86044672,"data_stored":85547769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":32434315},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177872,"kb_used_data":80124,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193968,"statfs":{"total":96636764160,"available":96454623232,"internally_reserved":0,"allocated":82046976,"data_stored":81558012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179000,"kb_used_data":89576,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192840,"statfs":{"total":96636764160,"available":96453468160,"internally_reserved":0,"allocated":91725824,"data_stored":91216610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:44.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:44.791 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:44.793 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:44.809 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-04-25T23:02:44.596940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":499008,"kb_used_data":253768,"kb_used_omap":8,"kb_used_meta":245175,"kb_avail":282616512,"statfs":{"total":289910292480,"available":289399308288,"internally_reserved":0,"allocated":259858432,"data_stored":258343876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":251059221},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.426486"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096437+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:42.096437+0000","last_peered":"2024-04-25T23:02:42.096437+0000","last_clean":"2024-04-25T23:02:42.096437+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:42.096437+0000","last_undegraded":"2024-04-25T23:02:42.096437+0000","last_fullsized":"2024-04-25T23:02:42.096437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.770809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":601,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095514+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095514+0000","last_peered":"2024-04-25T23:02:42.095514+0000","last_clean":"2024-04-25T23:02:42.095514+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095514+0000","last_undegraded":"2024-04-25T23:02:42.095514+0000","last_fullsized":"2024-04-25T23:02:42.095514+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":907,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184801+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:40.184801+0000","last_peered":"2024-04-25T23:02:40.184801+0000","last_clean":"2024-04-25T23:02:40.184801+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:40.184801+0000","last_undegraded":"2024-04-25T23:02:40.184801+0000","last_fullsized":"2024-04-25T23:02:40.184801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184338+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:40.184338+0000","last_peered":"2024-04-25T23:02:40.184338+0000","last_clean":"2024-04-25T23:02:40.184338+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:40.184338+0000","last_undegraded":"2024-04-25T23:02:40.184338+0000","last_fullsized":"2024-04-25T23:02:40.184338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094052+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:42.094052+0000","last_peered":"2024-04-25T23:02:42.094052+0000","last_clean":"2024-04-25T23:02:42.094052+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:42.094052+0000","last_undegraded":"2024-04-25T23:02:42.094052+0000","last_fullsized":"2024-04-25T23:02:42.094052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":547,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183819+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:40.183819+0000","last_peered":"2024-04-25T23:02:40.183819+0000","last_clean":"2024-04-25T23:02:40.183819+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:40.183819+0000","last_undegraded":"2024-04-25T23:02:40.183819+0000","last_fullsized":"2024-04-25T23:02:40.183819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183182+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:40.183182+0000","last_peered":"2024-04-25T23:02:40.183182+0000","last_clean":"2024-04-25T23:02:40.183182+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:40.183182+0000","last_undegraded":"2024-04-25T23:02:40.183182+0000","last_fullsized":"2024-04-25T23:02:40.183182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.182906+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:40.182906+0000","last_peered":"2024-04-25T23:02:40.182906+0000","last_clean":"2024-04-25T23:02:40.182906+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:40.182906+0000","last_undegraded":"2024-04-25T23:02:40.182906+0000","last_fullsized":"2024-04-25T23:02:40.182906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":932,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169501+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:40.169501+0000","last_peered":"2024-04-25T23:02:40.169501+0000","last_clean":"2024-04-25T23:02:40.169501+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:40.169501+0000","last_undegraded":"2024-04-25T23:02:40.169501+0000","last_fullsized":"2024-04-25T23:02:40.169501+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095256+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095256+0000","last_peered":"2024-04-25T23:02:42.095256+0000","last_clean":"2024-04-25T23:02:42.095256+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095256+0000","last_undegraded":"2024-04-25T23:02:42.095256+0000","last_fullsized":"2024-04-25T23:02:42.095256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":594,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185003+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:40.185003+0000","last_peered":"2024-04-25T23:02:40.185003+0000","last_clean":"2024-04-25T23:02:40.185003+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:40.185003+0000","last_undegraded":"2024-04-25T23:02:40.185003+0000","last_fullsized":"2024-04-25T23:02:40.185003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":524,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095344+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:42.095344+0000","last_peered":"2024-04-25T23:02:42.095344+0000","last_clean":"2024-04-25T23:02:42.095344+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:42.095344+0000","last_undegraded":"2024-04-25T23:02:42.095344+0000","last_fullsized":"2024-04-25T23:02:42.095344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":484,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.101687+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:42.101687+0000","last_peered":"2024-04-25T23:02:42.101687+0000","last_clean":"2024-04-25T23:02:42.101687+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:42.101687+0000","last_undegraded":"2024-04-25T23:02:42.101687+0000","last_fullsized":"2024-04-25T23:02:42.101687+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:29.984646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1026,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183906+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:40.183906+0000","last_peered":"2024-04-25T23:02:40.183906+0000","last_clean":"2024-04-25T23:02:40.183906+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:40.183906+0000","last_undegraded":"2024-04-25T23:02:40.183906+0000","last_fullsized":"2024-04-25T23:02:40.183906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":974,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183319+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:40.183319+0000","last_peered":"2024-04-25T23:02:40.183319+0000","last_clean":"2024-04-25T23:02:40.183319+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:40.183319+0000","last_undegraded":"2024-04-25T23:02:40.183319+0000","last_fullsized":"2024-04-25T23:02:40.183319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.182977+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:40.182977+0000","last_peered":"2024-04-25T23:02:40.182977+0000","last_clean":"2024-04-25T23:02:40.182977+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:40.182977+0000","last_undegraded":"2024-04-25T23:02:40.182977+0000","last_fullsized":"2024-04-25T23:02:40.182977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1054,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-25T23:02:39.666517+0000","last_change":"2024-04-25T23:02:40.171937+0000","last_active":"2024-04-25T23:02:40.171937+0000","last_peered":"2024-04-25T23:02:39.666517+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:39.666517+0000","last_undegraded":"2024-04-25T23:02:39.666517+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092854+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.092854+0000","last_peered":"2024-04-25T23:02:42.092854+0000","last_clean":"2024-04-25T23:02:42.092854+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.092854+0000","last_undegraded":"2024-04-25T23:02:42.092854+0000","last_fullsized":"2024-04-25T23:02:42.092854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1103,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169468+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:40.169468+0000","last_peered":"2024-04-25T23:02:40.169468+0000","last_clean":"2024-04-25T23:02:40.169468+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:40.169468+0000","last_undegraded":"2024-04-25T23:02:40.169468+0000","last_fullsized":"2024-04-25T23:02:40.169468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184392+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:40.184392+0000","last_peered":"2024-04-25T23:02:40.184392+0000","last_clean":"2024-04-25T23:02:40.184392+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:40.184392+0000","last_undegraded":"2024-04-25T23:02:40.184392+0000","last_fullsized":"2024-04-25T23:02:40.184392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":639,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184583+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:40.184583+0000","last_peered":"2024-04-25T23:02:40.184583+0000","last_clean":"2024-04-25T23:02:40.184583+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:40.184583+0000","last_undegraded":"2024-04-25T23:02:40.184583+0000","last_fullsized":"2024-04-25T23:02:40.184583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094227+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:42.094227+0000","last_peered":"2024-04-25T23:02:42.094227+0000","last_clean":"2024-04-25T23:02:42.094227+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:42.094227+0000","last_undegraded":"2024-04-25T23:02:42.094227+0000","last_fullsized":"2024-04-25T23:02:42.094227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.167888+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:40.167888+0000","last_peered":"2024-04-25T23:02:40.167888+0000","last_clean":"2024-04-25T23:02:40.167888+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:40.167888+0000","last_undegraded":"2024-04-25T23:02:40.167888+0000","last_fullsized":"2024-04-25T23:02:40.167888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093292+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093292+0000","last_peered":"2024-04-25T23:02:42.093292+0000","last_clean":"2024-04-25T23:02:42.093292+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093292+0000","last_undegraded":"2024-04-25T23:02:42.093292+0000","last_fullsized":"2024-04-25T23:02:42.093292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095361+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:42.095361+0000","last_peered":"2024-04-25T23:02:42.095361+0000","last_clean":"2024-04-25T23:02:42.095361+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:42.095361+0000","last_undegraded":"2024-04-25T23:02:42.095361+0000","last_fullsized":"2024-04-25T23:02:42.095361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":658,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169921+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:40.169921+0000","last_peered":"2024-04-25T23:02:40.169921+0000","last_clean":"2024-04-25T23:02:40.169921+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:40.169921+0000","last_undegraded":"2024-04-25T23:02:40.169921+0000","last_fullsized":"2024-04-25T23:02:40.169921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":948,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185289+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:40.185289+0000","last_peered":"2024-04-25T23:02:40.185289+0000","last_clean":"2024-04-25T23:02:40.185289+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:40.185289+0000","last_undegraded":"2024-04-25T23:02:40.185289+0000","last_fullsized":"2024-04-25T23:02:40.185289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":571,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095167+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095167+0000","last_peered":"2024-04-25T23:02:42.095167+0000","last_clean":"2024-04-25T23:02:42.095167+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095167+0000","last_undegraded":"2024-04-25T23:02:42.095167+0000","last_fullsized":"2024-04-25T23:02:42.095167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:37.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169444+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:40.169444+0000","last_peered":"2024-04-25T23:02:40.169444+0000","last_clean":"2024-04-25T23:02:40.169444+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:40.169444+0000","last_undegraded":"2024-04-25T23:02:40.169444+0000","last_fullsized":"2024-04-25T23:02:40.169444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":631,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093898+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:42.093898+0000","last_peered":"2024-04-25T23:02:42.093898+0000","last_clean":"2024-04-25T23:02:42.093898+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:42.093898+0000","last_undegraded":"2024-04-25T23:02:42.093898+0000","last_fullsized":"2024-04-25T23:02:42.093898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1036,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168047+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:40.168047+0000","last_peered":"2024-04-25T23:02:40.168047+0000","last_clean":"2024-04-25T23:02:40.168047+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:40.168047+0000","last_undegraded":"2024-04-25T23:02:40.168047+0000","last_fullsized":"2024-04-25T23:02:40.168047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":686,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183192+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:40.183192+0000","last_peered":"2024-04-25T23:02:40.183192+0000","last_clean":"2024-04-25T23:02:40.183192+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:40.183192+0000","last_undegraded":"2024-04-25T23:02:40.183192+0000","last_fullsized":"2024-04-25T23:02:40.183192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":651,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094571+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:42.094571+0000","last_peered":"2024-04-25T23:02:42.094571+0000","last_clean":"2024-04-25T23:02:42.094571+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:42.094571+0000","last_undegraded":"2024-04-25T23:02:42.094571+0000","last_fullsized":"2024-04-25T23:02:42.094571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":714,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185092+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:40.185092+0000","last_peered":"2024-04-25T23:02:40.185092+0000","last_clean":"2024-04-25T23:02:40.185092+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:40.185092+0000","last_undegraded":"2024-04-25T23:02:40.185092+0000","last_fullsized":"2024-04-25T23:02:40.185092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":578,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094656+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:42.094656+0000","last_peered":"2024-04-25T23:02:42.094656+0000","last_clean":"2024-04-25T23:02:42.094656+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:42.094656+0000","last_undegraded":"2024-04-25T23:02:42.094656+0000","last_fullsized":"2024-04-25T23:02:42.094656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168758+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:40.168758+0000","last_peered":"2024-04-25T23:02:40.168758+0000","last_clean":"2024-04-25T23:02:40.168758+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:40.168758+0000","last_undegraded":"2024-04-25T23:02:40.168758+0000","last_fullsized":"2024-04-25T23:02:40.168758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":666,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170227+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:40.170227+0000","last_peered":"2024-04-25T23:02:40.170227+0000","last_clean":"2024-04-25T23:02:40.170227+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:40.170227+0000","last_undegraded":"2024-04-25T23:02:40.170227+0000","last_fullsized":"2024-04-25T23:02:40.170227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093598+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093598+0000","last_peered":"2024-04-25T23:02:42.093598+0000","last_clean":"2024-04-25T23:02:42.093598+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093598+0000","last_undegraded":"2024-04-25T23:02:42.093598+0000","last_fullsized":"2024-04-25T23:02:42.093598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169648+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:40.169648+0000","last_peered":"2024-04-25T23:02:40.169648+0000","last_clean":"2024-04-25T23:02:40.169648+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:40.169648+0000","last_undegraded":"2024-04-25T23:02:40.169648+0000","last_fullsized":"2024-04-25T23:02:40.169648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":239,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183202+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:40.183202+0000","last_peered":"2024-04-25T23:02:40.183202+0000","last_clean":"2024-04-25T23:02:40.183202+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:40.183202+0000","last_undegraded":"2024-04-25T23:02:40.183202+0000","last_fullsized":"2024-04-25T23:02:40.183202+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":333,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185652+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:40.185652+0000","last_peered":"2024-04-25T23:02:40.185652+0000","last_clean":"2024-04-25T23:02:40.185652+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:40.185652+0000","last_undegraded":"2024-04-25T23:02:40.185652+0000","last_fullsized":"2024-04-25T23:02:40.185652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":627,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093710+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:42.093710+0000","last_peered":"2024-04-25T23:02:42.093710+0000","last_clean":"2024-04-25T23:02:42.093710+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:42.093710+0000","last_undegraded":"2024-04-25T23:02:42.093710+0000","last_fullsized":"2024-04-25T23:02:42.093710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":447,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094936+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.094936+0000","last_peered":"2024-04-25T23:02:42.094936+0000","last_clean":"2024-04-25T23:02:42.094936+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.094936+0000","last_undegraded":"2024-04-25T23:02:42.094936+0000","last_fullsized":"2024-04-25T23:02:42.094936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093125+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:42.093125+0000","last_peered":"2024-04-25T23:02:42.093125+0000","last_clean":"2024-04-25T23:02:42.093125+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:42.093125+0000","last_undegraded":"2024-04-25T23:02:42.093125+0000","last_fullsized":"2024-04-25T23:02:42.093125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":667,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185961+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:40.185961+0000","last_peered":"2024-04-25T23:02:40.185961+0000","last_clean":"2024-04-25T23:02:40.185961+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:40.185961+0000","last_undegraded":"2024-04-25T23:02:40.185961+0000","last_fullsized":"2024-04-25T23:02:40.185961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184067+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:40.184067+0000","last_peered":"2024-04-25T23:02:40.184067+0000","last_clean":"2024-04-25T23:02:40.184067+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:40.184067+0000","last_undegraded":"2024-04-25T23:02:40.184067+0000","last_fullsized":"2024-04-25T23:02:40.184067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185364+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:40.185364+0000","last_peered":"2024-04-25T23:02:40.185364+0000","last_clean":"2024-04-25T23:02:40.185364+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:40.185364+0000","last_undegraded":"2024-04-25T23:02:40.185364+0000","last_fullsized":"2024-04-25T23:02:40.185364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":678,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170594+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:40.170594+0000","last_peered":"2024-04-25T23:02:40.170594+0000","last_clean":"2024-04-25T23:02:40.170594+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:40.170594+0000","last_undegraded":"2024-04-25T23:02:40.170594+0000","last_fullsized":"2024-04-25T23:02:40.170594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":304,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170886+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:40.170886+0000","last_peered":"2024-04-25T23:02:40.170886+0000","last_clean":"2024-04-25T23:02:40.170886+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:40.170886+0000","last_undegraded":"2024-04-25T23:02:40.170886+0000","last_fullsized":"2024-04-25T23:02:40.170886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":634,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184703+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:40.184703+0000","last_peered":"2024-04-25T23:02:40.184703+0000","last_clean":"2024-04-25T23:02:40.184703+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:40.184703+0000","last_undegraded":"2024-04-25T23:02:40.184703+0000","last_fullsized":"2024-04-25T23:02:40.184703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":291,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184602+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:40.184602+0000","last_peered":"2024-04-25T23:02:40.184602+0000","last_clean":"2024-04-25T23:02:40.184602+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:40.184602+0000","last_undegraded":"2024-04-25T23:02:40.184602+0000","last_fullsized":"2024-04-25T23:02:40.184602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":982,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185716+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:40.185716+0000","last_peered":"2024-04-25T23:02:40.185716+0000","last_clean":"2024-04-25T23:02:40.185716+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:40.185716+0000","last_undegraded":"2024-04-25T23:02:40.185716+0000","last_fullsized":"2024-04-25T23:02:40.185716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093232+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093232+0000","last_peered":"2024-04-25T23:02:42.093232+0000","last_clean":"2024-04-25T23:02:42.093232+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093232+0000","last_undegraded":"2024-04-25T23:02:42.093232+0000","last_fullsized":"2024-04-25T23:02:42.093232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":903,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184881+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:40.184881+0000","last_peered":"2024-04-25T23:02:40.184881+0000","last_clean":"2024-04-25T23:02:40.184881+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:40.184881+0000","last_undegraded":"2024-04-25T23:02:40.184881+0000","last_fullsized":"2024-04-25T23:02:40.184881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093409+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093409+0000","last_peered":"2024-04-25T23:02:42.093409+0000","last_clean":"2024-04-25T23:02:42.093409+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093409+0000","last_undegraded":"2024-04-25T23:02:42.093409+0000","last_fullsized":"2024-04-25T23:02:42.093409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":941,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169770+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:40.169770+0000","last_peered":"2024-04-25T23:02:40.169770+0000","last_clean":"2024-04-25T23:02:40.169770+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:40.169770+0000","last_undegraded":"2024-04-25T23:02:40.169770+0000","last_fullsized":"2024-04-25T23:02:40.169770+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":382,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183576+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:40.183576+0000","last_peered":"2024-04-25T23:02:40.183576+0000","last_clean":"2024-04-25T23:02:40.183576+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:40.183576+0000","last_undegraded":"2024-04-25T23:02:40.183576+0000","last_fullsized":"2024-04-25T23:02:40.183576+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185668+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:40.185668+0000","last_peered":"2024-04-25T23:02:40.185668+0000","last_clean":"2024-04-25T23:02:40.185668+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:40.185668+0000","last_undegraded":"2024-04-25T23:02:40.185668+0000","last_fullsized":"2024-04-25T23:02:40.185668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":807,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169120+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:40.169120+0000","last_peered":"2024-04-25T23:02:40.169120+0000","last_clean":"2024-04-25T23:02:40.169120+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:40.169120+0000","last_undegraded":"2024-04-25T23:02:40.169120+0000","last_fullsized":"2024-04-25T23:02:40.169120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1052,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185919+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:40.185919+0000","last_peered":"2024-04-25T23:02:40.185919+0000","last_clean":"2024-04-25T23:02:40.185919+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:40.185919+0000","last_undegraded":"2024-04-25T23:02:40.185919+0000","last_fullsized":"2024-04-25T23:02:40.185919+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183428+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:40.183428+0000","last_peered":"2024-04-25T23:02:40.183428+0000","last_clean":"2024-04-25T23:02:40.183428+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:40.183428+0000","last_undegraded":"2024-04-25T23:02:40.183428+0000","last_fullsized":"2024-04-25T23:02:40.183428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":359,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168632+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:40.168632+0000","last_peered":"2024-04-25T23:02:40.168632+0000","last_clean":"2024-04-25T23:02:40.168632+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:40.168632+0000","last_undegraded":"2024-04-25T23:02:40.168632+0000","last_fullsized":"2024-04-25T23:02:40.168632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095534+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095534+0000","last_peered":"2024-04-25T23:02:42.095534+0000","last_clean":"2024-04-25T23:02:42.095534+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095534+0000","last_undegraded":"2024-04-25T23:02:42.095534+0000","last_fullsized":"2024-04-25T23:02:42.095534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168963+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:40.168963+0000","last_peered":"2024-04-25T23:02:40.168963+0000","last_clean":"2024-04-25T23:02:40.168963+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:40.168963+0000","last_undegraded":"2024-04-25T23:02:40.168963+0000","last_fullsized":"2024-04-25T23:02:40.168963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":497,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092926+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.092926+0000","last_peered":"2024-04-25T23:02:42.092926+0000","last_clean":"2024-04-25T23:02:42.092926+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.092926+0000","last_undegraded":"2024-04-25T23:02:42.092926+0000","last_fullsized":"2024-04-25T23:02:42.092926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":884,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.176356+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:40.176356+0000","last_peered":"2024-04-25T23:02:40.176356+0000","last_clean":"2024-04-25T23:02:40.176356+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:40.176356+0000","last_undegraded":"2024-04-25T23:02:40.176356+0000","last_fullsized":"2024-04-25T23:02:40.176356+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184583+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:40.184583+0000","last_peered":"2024-04-25T23:02:40.184583+0000","last_clean":"2024-04-25T23:02:40.184583+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:40.184583+0000","last_undegraded":"2024-04-25T23:02:40.184583+0000","last_fullsized":"2024-04-25T23:02:40.184583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":239,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185396+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:40.185396+0000","last_peered":"2024-04-25T23:02:40.185396+0000","last_clean":"2024-04-25T23:02:40.185396+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:40.185396+0000","last_undegraded":"2024-04-25T23:02:40.185396+0000","last_fullsized":"2024-04-25T23:02:40.185396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":929,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169989+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:40.169989+0000","last_peered":"2024-04-25T23:02:40.169989+0000","last_clean":"2024-04-25T23:02:40.169989+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:40.169989+0000","last_undegraded":"2024-04-25T23:02:40.169989+0000","last_fullsized":"2024-04-25T23:02:40.169989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":446,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.186064+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:40.186064+0000","last_peered":"2024-04-25T23:02:40.186064+0000","last_clean":"2024-04-25T23:02:40.186064+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:40.186064+0000","last_undegraded":"2024-04-25T23:02:40.186064+0000","last_fullsized":"2024-04-25T23:02:40.186064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170294+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:40.170294+0000","last_peered":"2024-04-25T23:02:40.170294+0000","last_clean":"2024-04-25T23:02:40.170294+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:40.170294+0000","last_undegraded":"2024-04-25T23:02:40.170294+0000","last_fullsized":"2024-04-25T23:02:40.170294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":513,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094054+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:42.094054+0000","last_peered":"2024-04-25T23:02:42.094054+0000","last_clean":"2024-04-25T23:02:42.094054+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:42.094054+0000","last_undegraded":"2024-04-25T23:02:42.094054+0000","last_fullsized":"2024-04-25T23:02:42.094054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170146+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:40.170146+0000","last_peered":"2024-04-25T23:02:40.170146+0000","last_clean":"2024-04-25T23:02:40.170146+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:40.170146+0000","last_undegraded":"2024-04-25T23:02:40.170146+0000","last_fullsized":"2024-04-25T23:02:40.170146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095610+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095610+0000","last_peered":"2024-04-25T23:02:42.095610+0000","last_clean":"2024-04-25T23:02:42.095610+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095610+0000","last_undegraded":"2024-04-25T23:02:42.095610+0000","last_fullsized":"2024-04-25T23:02:42.095610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093609+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:42.093609+0000","last_peered":"2024-04-25T23:02:42.093609+0000","last_clean":"2024-04-25T23:02:42.093609+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:42.093609+0000","last_undegraded":"2024-04-25T23:02:42.093609+0000","last_fullsized":"2024-04-25T23:02:42.093609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170943+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:40.170943+0000","last_peered":"2024-04-25T23:02:40.170943+0000","last_clean":"2024-04-25T23:02:40.170943+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:40.170943+0000","last_undegraded":"2024-04-25T23:02:40.170943+0000","last_fullsized":"2024-04-25T23:02:40.170943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170523+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:40.170523+0000","last_peered":"2024-04-25T23:02:40.170523+0000","last_clean":"2024-04-25T23:02:40.170523+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:40.170523+0000","last_undegraded":"2024-04-25T23:02:40.170523+0000","last_fullsized":"2024-04-25T23:02:40.170523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168426+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:40.168426+0000","last_peered":"2024-04-25T23:02:40.168426+0000","last_clean":"2024-04-25T23:02:40.168426+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:40.168426+0000","last_undegraded":"2024-04-25T23:02:40.168426+0000","last_fullsized":"2024-04-25T23:02:40.168426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170404+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:40.170404+0000","last_peered":"2024-04-25T23:02:40.170404+0000","last_clean":"2024-04-25T23:02:40.170404+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:40.170404+0000","last_undegraded":"2024-04-25T23:02:40.170404+0000","last_fullsized":"2024-04-25T23:02:40.170404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185799+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:40.185799+0000","last_peered":"2024-04-25T23:02:40.185799+0000","last_clean":"2024-04-25T23:02:40.185799+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:40.185799+0000","last_undegraded":"2024-04-25T23:02:40.185799+0000","last_fullsized":"2024-04-25T23:02:40.185799+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093896+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:42.093896+0000","last_peered":"2024-04-25T23:02:42.093896+0000","last_clean":"2024-04-25T23:02:42.093896+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:42.093896+0000","last_undegraded":"2024-04-25T23:02:42.093896+0000","last_fullsized":"2024-04-25T23:02:42.093896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1000,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184286+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:40.184286+0000","last_peered":"2024-04-25T23:02:40.184286+0000","last_clean":"2024-04-25T23:02:40.184286+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:40.184286+0000","last_undegraded":"2024-04-25T23:02:40.184286+0000","last_fullsized":"2024-04-25T23:02:40.184286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":433,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185237+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:40.185237+0000","last_peered":"2024-04-25T23:02:40.185237+0000","last_clean":"2024-04-25T23:02:40.185237+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:40.185237+0000","last_undegraded":"2024-04-25T23:02:40.185237+0000","last_fullsized":"2024-04-25T23:02:40.185237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":992,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168568+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:40.168568+0000","last_peered":"2024-04-25T23:02:40.168568+0000","last_clean":"2024-04-25T23:02:40.168568+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:40.168568+0000","last_undegraded":"2024-04-25T23:02:40.168568+0000","last_fullsized":"2024-04-25T23:02:40.168568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094958+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.094958+0000","last_peered":"2024-04-25T23:02:42.094958+0000","last_clean":"2024-04-25T23:02:42.094958+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.094958+0000","last_undegraded":"2024-04-25T23:02:42.094958+0000","last_fullsized":"2024-04-25T23:02:42.094958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":376,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185445+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:40.185445+0000","last_peered":"2024-04-25T23:02:40.185445+0000","last_clean":"2024-04-25T23:02:40.185445+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:40.185445+0000","last_undegraded":"2024-04-25T23:02:40.185445+0000","last_fullsized":"2024-04-25T23:02:40.185445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":672,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168289+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:40.168289+0000","last_peered":"2024-04-25T23:02:40.168289+0000","last_clean":"2024-04-25T23:02:40.168289+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:40.168289+0000","last_undegraded":"2024-04-25T23:02:40.168289+0000","last_fullsized":"2024-04-25T23:02:40.168289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170701+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:40.170701+0000","last_peered":"2024-04-25T23:02:40.170701+0000","last_clean":"2024-04-25T23:02:40.170701+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:40.170701+0000","last_undegraded":"2024-04-25T23:02:40.170701+0000","last_fullsized":"2024-04-25T23:02:40.170701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1037,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168366+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:40.168366+0000","last_peered":"2024-04-25T23:02:40.168366+0000","last_clean":"2024-04-25T23:02:40.168366+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:40.168366+0000","last_undegraded":"2024-04-25T23:02:40.168366+0000","last_fullsized":"2024-04-25T23:02:40.168366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":503,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096211+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:42.096211+0000","last_peered":"2024-04-25T23:02:42.096211+0000","last_clean":"2024-04-25T23:02:42.096211+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:42.096211+0000","last_undegraded":"2024-04-25T23:02:42.096211+0000","last_fullsized":"2024-04-25T23:02:42.096211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":751,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168669+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:40.168669+0000","last_peered":"2024-04-25T23:02:40.168669+0000","last_clean":"2024-04-25T23:02:40.168669+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:40.168669+0000","last_undegraded":"2024-04-25T23:02:40.168669+0000","last_fullsized":"2024-04-25T23:02:40.168669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169843+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:40.169843+0000","last_peered":"2024-04-25T23:02:40.169843+0000","last_clean":"2024-04-25T23:02:40.169843+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:40.169843+0000","last_undegraded":"2024-04-25T23:02:40.169843+0000","last_fullsized":"2024-04-25T23:02:40.169843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168619+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:40.168619+0000","last_peered":"2024-04-25T23:02:40.168619+0000","last_clean":"2024-04-25T23:02:40.168619+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:40.168619+0000","last_undegraded":"2024-04-25T23:02:40.168619+0000","last_fullsized":"2024-04-25T23:02:40.168619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094896+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.094896+0000","last_peered":"2024-04-25T23:02:42.094896+0000","last_clean":"2024-04-25T23:02:42.094896+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.094896+0000","last_undegraded":"2024-04-25T23:02:42.094896+0000","last_fullsized":"2024-04-25T23:02:42.094896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093622+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093622+0000","last_peered":"2024-04-25T23:02:42.093622+0000","last_clean":"2024-04-25T23:02:42.093622+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093622+0000","last_undegraded":"2024-04-25T23:02:42.093622+0000","last_fullsized":"2024-04-25T23:02:42.093622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094850+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:42.094850+0000","last_peered":"2024-04-25T23:02:42.094850+0000","last_clean":"2024-04-25T23:02:42.094850+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:42.094850+0000","last_undegraded":"2024-04-25T23:02:42.094850+0000","last_fullsized":"2024-04-25T23:02:42.094850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093911+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.093911+0000","last_peered":"2024-04-25T23:02:42.093911+0000","last_clean":"2024-04-25T23:02:42.093911+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.093911+0000","last_undegraded":"2024-04-25T23:02:42.093911+0000","last_fullsized":"2024-04-25T23:02:42.093911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":592,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184286+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:40.184286+0000","last_peered":"2024-04-25T23:02:40.184286+0000","last_clean":"2024-04-25T23:02:40.184286+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:40.184286+0000","last_undegraded":"2024-04-25T23:02:40.184286+0000","last_fullsized":"2024-04-25T23:02:40.184286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185064+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:40.185064+0000","last_peered":"2024-04-25T23:02:40.185064+0000","last_clean":"2024-04-25T23:02:40.185064+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:40.185064+0000","last_undegraded":"2024-04-25T23:02:40.185064+0000","last_fullsized":"2024-04-25T23:02:40.185064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":654,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184214+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:40.184214+0000","last_peered":"2024-04-25T23:02:40.184214+0000","last_clean":"2024-04-25T23:02:40.184214+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:40.184214+0000","last_undegraded":"2024-04-25T23:02:40.184214+0000","last_fullsized":"2024-04-25T23:02:40.184214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":444,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094599+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094599+0000","last_peered":"2024-04-25T23:02:42.094599+0000","last_clean":"2024-04-25T23:02:42.094599+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094599+0000","last_undegraded":"2024-04-25T23:02:42.094599+0000","last_fullsized":"2024-04-25T23:02:42.094599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093692+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:42.093692+0000","last_peered":"2024-04-25T23:02:42.093692+0000","last_clean":"2024-04-25T23:02:42.093692+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:42.093692+0000","last_undegraded":"2024-04-25T23:02:42.093692+0000","last_fullsized":"2024-04-25T23:02:42.093692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170234+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:40.170234+0000","last_peered":"2024-04-25T23:02:40.170234+0000","last_clean":"2024-04-25T23:02:40.170234+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:40.170234+0000","last_undegraded":"2024-04-25T23:02:40.170234+0000","last_fullsized":"2024-04-25T23:02:40.170234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":653,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183421+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:40.183421+0000","last_peered":"2024-04-25T23:02:40.183421+0000","last_clean":"2024-04-25T23:02:40.183421+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:40.183421+0000","last_undegraded":"2024-04-25T23:02:40.183421+0000","last_fullsized":"2024-04-25T23:02:40.183421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170026+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:40.170026+0000","last_peered":"2024-04-25T23:02:40.170026+0000","last_clean":"2024-04-25T23:02:40.170026+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:40.170026+0000","last_undegraded":"2024-04-25T23:02:40.170026+0000","last_fullsized":"2024-04-25T23:02:40.170026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142136,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229704,"statfs":{"total":96636764160,"available":96491216896,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177872,"kb_used_data":80124,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193968,"statfs":{"total":96636764160,"available":96454623232,"internally_reserved":0,"allocated":82046976,"data_stored":81558012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179000,"kb_used_data":89576,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192840,"statfs":{"total":96636764160,"available":96453468160,"internally_reserved":0,"allocated":91725824,"data_stored":91216610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:44.814 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T23:02:45.206 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:45.206 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":239,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":97,"num_osds":3,"num_up_osds":3,"osd_up_since":1714086134,"num_in_osds":3,"osd_in_since":1714085926,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":104},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":128569219,"bytes_used":510984192,"bytes_avail":289399308288,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"recovering_objects_per_sec":235,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1276,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4239}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-25T23:00:12.528425+0000","services":{}},"progress_events":{}} 2024-04-25T23:02:45.225 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T23:02:45.225 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:45.517 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:45.519 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:45.534 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-04-25T23:02:44.596940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":499008,"kb_used_data":253768,"kb_used_omap":8,"kb_used_meta":245175,"kb_avail":282616512,"statfs":{"total":289910292480,"available":289399308288,"internally_reserved":0,"allocated":259858432,"data_stored":258343876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":251059221},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.426486"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096437+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:42.096437+0000","last_peered":"2024-04-25T23:02:42.096437+0000","last_clean":"2024-04-25T23:02:42.096437+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:42.096437+0000","last_undegraded":"2024-04-25T23:02:42.096437+0000","last_fullsized":"2024-04-25T23:02:42.096437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.770809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":601,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095514+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095514+0000","last_peered":"2024-04-25T23:02:42.095514+0000","last_clean":"2024-04-25T23:02:42.095514+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095514+0000","last_undegraded":"2024-04-25T23:02:42.095514+0000","last_fullsized":"2024-04-25T23:02:42.095514+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":907,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184801+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:40.184801+0000","last_peered":"2024-04-25T23:02:40.184801+0000","last_clean":"2024-04-25T23:02:40.184801+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:40.184801+0000","last_undegraded":"2024-04-25T23:02:40.184801+0000","last_fullsized":"2024-04-25T23:02:40.184801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184338+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:40.184338+0000","last_peered":"2024-04-25T23:02:40.184338+0000","last_clean":"2024-04-25T23:02:40.184338+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:40.184338+0000","last_undegraded":"2024-04-25T23:02:40.184338+0000","last_fullsized":"2024-04-25T23:02:40.184338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094052+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:42.094052+0000","last_peered":"2024-04-25T23:02:42.094052+0000","last_clean":"2024-04-25T23:02:42.094052+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:42.094052+0000","last_undegraded":"2024-04-25T23:02:42.094052+0000","last_fullsized":"2024-04-25T23:02:42.094052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":547,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183819+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:40.183819+0000","last_peered":"2024-04-25T23:02:40.183819+0000","last_clean":"2024-04-25T23:02:40.183819+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:40.183819+0000","last_undegraded":"2024-04-25T23:02:40.183819+0000","last_fullsized":"2024-04-25T23:02:40.183819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183182+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:40.183182+0000","last_peered":"2024-04-25T23:02:40.183182+0000","last_clean":"2024-04-25T23:02:40.183182+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:40.183182+0000","last_undegraded":"2024-04-25T23:02:40.183182+0000","last_fullsized":"2024-04-25T23:02:40.183182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.182906+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:40.182906+0000","last_peered":"2024-04-25T23:02:40.182906+0000","last_clean":"2024-04-25T23:02:40.182906+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:40.182906+0000","last_undegraded":"2024-04-25T23:02:40.182906+0000","last_fullsized":"2024-04-25T23:02:40.182906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":932,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169501+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:40.169501+0000","last_peered":"2024-04-25T23:02:40.169501+0000","last_clean":"2024-04-25T23:02:40.169501+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:40.169501+0000","last_undegraded":"2024-04-25T23:02:40.169501+0000","last_fullsized":"2024-04-25T23:02:40.169501+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095256+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095256+0000","last_peered":"2024-04-25T23:02:42.095256+0000","last_clean":"2024-04-25T23:02:42.095256+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095256+0000","last_undegraded":"2024-04-25T23:02:42.095256+0000","last_fullsized":"2024-04-25T23:02:42.095256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":594,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185003+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:40.185003+0000","last_peered":"2024-04-25T23:02:40.185003+0000","last_clean":"2024-04-25T23:02:40.185003+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:40.185003+0000","last_undegraded":"2024-04-25T23:02:40.185003+0000","last_fullsized":"2024-04-25T23:02:40.185003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":524,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095344+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:42.095344+0000","last_peered":"2024-04-25T23:02:42.095344+0000","last_clean":"2024-04-25T23:02:42.095344+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:42.095344+0000","last_undegraded":"2024-04-25T23:02:42.095344+0000","last_fullsized":"2024-04-25T23:02:42.095344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":484,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.101687+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:42.101687+0000","last_peered":"2024-04-25T23:02:42.101687+0000","last_clean":"2024-04-25T23:02:42.101687+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:42.101687+0000","last_undegraded":"2024-04-25T23:02:42.101687+0000","last_fullsized":"2024-04-25T23:02:42.101687+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:29.984646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1026,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183906+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:40.183906+0000","last_peered":"2024-04-25T23:02:40.183906+0000","last_clean":"2024-04-25T23:02:40.183906+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:40.183906+0000","last_undegraded":"2024-04-25T23:02:40.183906+0000","last_fullsized":"2024-04-25T23:02:40.183906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":974,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183319+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:40.183319+0000","last_peered":"2024-04-25T23:02:40.183319+0000","last_clean":"2024-04-25T23:02:40.183319+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:40.183319+0000","last_undegraded":"2024-04-25T23:02:40.183319+0000","last_fullsized":"2024-04-25T23:02:40.183319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.182977+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:40.182977+0000","last_peered":"2024-04-25T23:02:40.182977+0000","last_clean":"2024-04-25T23:02:40.182977+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:40.182977+0000","last_undegraded":"2024-04-25T23:02:40.182977+0000","last_fullsized":"2024-04-25T23:02:40.182977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1054,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-25T23:02:39.666517+0000","last_change":"2024-04-25T23:02:40.171937+0000","last_active":"2024-04-25T23:02:40.171937+0000","last_peered":"2024-04-25T23:02:39.666517+0000","last_clean":"2024-04-25T22:59:32.893370+0000","last_became_active":"2024-04-25T23:02:16.336400+0000","last_became_peered":"2024-04-25T23:02:16.336400+0000","last_unstale":"2024-04-25T23:02:39.666517+0000","last_undegraded":"2024-04-25T23:02:39.666517+0000","last_fullsized":"2024-04-25T23:02:16.204485+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092854+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.092854+0000","last_peered":"2024-04-25T23:02:42.092854+0000","last_clean":"2024-04-25T23:02:42.092854+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.092854+0000","last_undegraded":"2024-04-25T23:02:42.092854+0000","last_fullsized":"2024-04-25T23:02:42.092854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1103,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169468+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:40.169468+0000","last_peered":"2024-04-25T23:02:40.169468+0000","last_clean":"2024-04-25T23:02:40.169468+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:40.169468+0000","last_undegraded":"2024-04-25T23:02:40.169468+0000","last_fullsized":"2024-04-25T23:02:40.169468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184392+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:40.184392+0000","last_peered":"2024-04-25T23:02:40.184392+0000","last_clean":"2024-04-25T23:02:40.184392+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:40.184392+0000","last_undegraded":"2024-04-25T23:02:40.184392+0000","last_fullsized":"2024-04-25T23:02:40.184392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":639,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184583+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:40.184583+0000","last_peered":"2024-04-25T23:02:40.184583+0000","last_clean":"2024-04-25T23:02:40.184583+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:40.184583+0000","last_undegraded":"2024-04-25T23:02:40.184583+0000","last_fullsized":"2024-04-25T23:02:40.184583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094227+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:42.094227+0000","last_peered":"2024-04-25T23:02:42.094227+0000","last_clean":"2024-04-25T23:02:42.094227+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:42.094227+0000","last_undegraded":"2024-04-25T23:02:42.094227+0000","last_fullsized":"2024-04-25T23:02:42.094227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.167888+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:40.167888+0000","last_peered":"2024-04-25T23:02:40.167888+0000","last_clean":"2024-04-25T23:02:40.167888+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:40.167888+0000","last_undegraded":"2024-04-25T23:02:40.167888+0000","last_fullsized":"2024-04-25T23:02:40.167888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093292+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093292+0000","last_peered":"2024-04-25T23:02:42.093292+0000","last_clean":"2024-04-25T23:02:42.093292+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093292+0000","last_undegraded":"2024-04-25T23:02:42.093292+0000","last_fullsized":"2024-04-25T23:02:42.093292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095361+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:42.095361+0000","last_peered":"2024-04-25T23:02:42.095361+0000","last_clean":"2024-04-25T23:02:42.095361+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:42.095361+0000","last_undegraded":"2024-04-25T23:02:42.095361+0000","last_fullsized":"2024-04-25T23:02:42.095361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":658,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169921+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:40.169921+0000","last_peered":"2024-04-25T23:02:40.169921+0000","last_clean":"2024-04-25T23:02:40.169921+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:40.169921+0000","last_undegraded":"2024-04-25T23:02:40.169921+0000","last_fullsized":"2024-04-25T23:02:40.169921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":948,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185289+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:40.185289+0000","last_peered":"2024-04-25T23:02:40.185289+0000","last_clean":"2024-04-25T23:02:40.185289+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:40.185289+0000","last_undegraded":"2024-04-25T23:02:40.185289+0000","last_fullsized":"2024-04-25T23:02:40.185289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":571,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095167+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095167+0000","last_peered":"2024-04-25T23:02:42.095167+0000","last_clean":"2024-04-25T23:02:42.095167+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095167+0000","last_undegraded":"2024-04-25T23:02:42.095167+0000","last_fullsized":"2024-04-25T23:02:42.095167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:37.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169444+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:40.169444+0000","last_peered":"2024-04-25T23:02:40.169444+0000","last_clean":"2024-04-25T23:02:40.169444+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:40.169444+0000","last_undegraded":"2024-04-25T23:02:40.169444+0000","last_fullsized":"2024-04-25T23:02:40.169444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":631,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093898+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:42.093898+0000","last_peered":"2024-04-25T23:02:42.093898+0000","last_clean":"2024-04-25T23:02:42.093898+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:42.093898+0000","last_undegraded":"2024-04-25T23:02:42.093898+0000","last_fullsized":"2024-04-25T23:02:42.093898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1036,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168047+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:40.168047+0000","last_peered":"2024-04-25T23:02:40.168047+0000","last_clean":"2024-04-25T23:02:40.168047+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:40.168047+0000","last_undegraded":"2024-04-25T23:02:40.168047+0000","last_fullsized":"2024-04-25T23:02:40.168047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":686,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183192+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:40.183192+0000","last_peered":"2024-04-25T23:02:40.183192+0000","last_clean":"2024-04-25T23:02:40.183192+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:40.183192+0000","last_undegraded":"2024-04-25T23:02:40.183192+0000","last_fullsized":"2024-04-25T23:02:40.183192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":651,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094571+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:42.094571+0000","last_peered":"2024-04-25T23:02:42.094571+0000","last_clean":"2024-04-25T23:02:42.094571+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:42.094571+0000","last_undegraded":"2024-04-25T23:02:42.094571+0000","last_fullsized":"2024-04-25T23:02:42.094571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":714,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185092+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:40.185092+0000","last_peered":"2024-04-25T23:02:40.185092+0000","last_clean":"2024-04-25T23:02:40.185092+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:40.185092+0000","last_undegraded":"2024-04-25T23:02:40.185092+0000","last_fullsized":"2024-04-25T23:02:40.185092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":578,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094656+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:42.094656+0000","last_peered":"2024-04-25T23:02:42.094656+0000","last_clean":"2024-04-25T23:02:42.094656+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:42.094656+0000","last_undegraded":"2024-04-25T23:02:42.094656+0000","last_fullsized":"2024-04-25T23:02:42.094656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168758+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:40.168758+0000","last_peered":"2024-04-25T23:02:40.168758+0000","last_clean":"2024-04-25T23:02:40.168758+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:40.168758+0000","last_undegraded":"2024-04-25T23:02:40.168758+0000","last_fullsized":"2024-04-25T23:02:40.168758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":666,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170227+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:40.170227+0000","last_peered":"2024-04-25T23:02:40.170227+0000","last_clean":"2024-04-25T23:02:40.170227+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:40.170227+0000","last_undegraded":"2024-04-25T23:02:40.170227+0000","last_fullsized":"2024-04-25T23:02:40.170227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093598+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093598+0000","last_peered":"2024-04-25T23:02:42.093598+0000","last_clean":"2024-04-25T23:02:42.093598+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093598+0000","last_undegraded":"2024-04-25T23:02:42.093598+0000","last_fullsized":"2024-04-25T23:02:42.093598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169648+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:40.169648+0000","last_peered":"2024-04-25T23:02:40.169648+0000","last_clean":"2024-04-25T23:02:40.169648+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:40.169648+0000","last_undegraded":"2024-04-25T23:02:40.169648+0000","last_fullsized":"2024-04-25T23:02:40.169648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":239,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183202+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:40.183202+0000","last_peered":"2024-04-25T23:02:40.183202+0000","last_clean":"2024-04-25T23:02:40.183202+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:40.183202+0000","last_undegraded":"2024-04-25T23:02:40.183202+0000","last_fullsized":"2024-04-25T23:02:40.183202+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":333,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185652+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:40.185652+0000","last_peered":"2024-04-25T23:02:40.185652+0000","last_clean":"2024-04-25T23:02:40.185652+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:40.185652+0000","last_undegraded":"2024-04-25T23:02:40.185652+0000","last_fullsized":"2024-04-25T23:02:40.185652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":627,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093710+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:42.093710+0000","last_peered":"2024-04-25T23:02:42.093710+0000","last_clean":"2024-04-25T23:02:42.093710+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:42.093710+0000","last_undegraded":"2024-04-25T23:02:42.093710+0000","last_fullsized":"2024-04-25T23:02:42.093710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":447,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094936+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.094936+0000","last_peered":"2024-04-25T23:02:42.094936+0000","last_clean":"2024-04-25T23:02:42.094936+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.094936+0000","last_undegraded":"2024-04-25T23:02:42.094936+0000","last_fullsized":"2024-04-25T23:02:42.094936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093125+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:42.093125+0000","last_peered":"2024-04-25T23:02:42.093125+0000","last_clean":"2024-04-25T23:02:42.093125+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:42.093125+0000","last_undegraded":"2024-04-25T23:02:42.093125+0000","last_fullsized":"2024-04-25T23:02:42.093125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":667,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185961+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:40.185961+0000","last_peered":"2024-04-25T23:02:40.185961+0000","last_clean":"2024-04-25T23:02:40.185961+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:40.185961+0000","last_undegraded":"2024-04-25T23:02:40.185961+0000","last_fullsized":"2024-04-25T23:02:40.185961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184067+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:40.184067+0000","last_peered":"2024-04-25T23:02:40.184067+0000","last_clean":"2024-04-25T23:02:40.184067+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:40.184067+0000","last_undegraded":"2024-04-25T23:02:40.184067+0000","last_fullsized":"2024-04-25T23:02:40.184067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185364+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:40.185364+0000","last_peered":"2024-04-25T23:02:40.185364+0000","last_clean":"2024-04-25T23:02:40.185364+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:40.185364+0000","last_undegraded":"2024-04-25T23:02:40.185364+0000","last_fullsized":"2024-04-25T23:02:40.185364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":678,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170594+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:40.170594+0000","last_peered":"2024-04-25T23:02:40.170594+0000","last_clean":"2024-04-25T23:02:40.170594+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:40.170594+0000","last_undegraded":"2024-04-25T23:02:40.170594+0000","last_fullsized":"2024-04-25T23:02:40.170594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":304,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170886+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:40.170886+0000","last_peered":"2024-04-25T23:02:40.170886+0000","last_clean":"2024-04-25T23:02:40.170886+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:40.170886+0000","last_undegraded":"2024-04-25T23:02:40.170886+0000","last_fullsized":"2024-04-25T23:02:40.170886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":634,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184703+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:40.184703+0000","last_peered":"2024-04-25T23:02:40.184703+0000","last_clean":"2024-04-25T23:02:40.184703+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:40.184703+0000","last_undegraded":"2024-04-25T23:02:40.184703+0000","last_fullsized":"2024-04-25T23:02:40.184703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":291,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184602+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:40.184602+0000","last_peered":"2024-04-25T23:02:40.184602+0000","last_clean":"2024-04-25T23:02:40.184602+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:40.184602+0000","last_undegraded":"2024-04-25T23:02:40.184602+0000","last_fullsized":"2024-04-25T23:02:40.184602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":982,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185716+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:40.185716+0000","last_peered":"2024-04-25T23:02:40.185716+0000","last_clean":"2024-04-25T23:02:40.185716+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:40.185716+0000","last_undegraded":"2024-04-25T23:02:40.185716+0000","last_fullsized":"2024-04-25T23:02:40.185716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093232+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093232+0000","last_peered":"2024-04-25T23:02:42.093232+0000","last_clean":"2024-04-25T23:02:42.093232+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093232+0000","last_undegraded":"2024-04-25T23:02:42.093232+0000","last_fullsized":"2024-04-25T23:02:42.093232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":903,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184881+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:40.184881+0000","last_peered":"2024-04-25T23:02:40.184881+0000","last_clean":"2024-04-25T23:02:40.184881+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:40.184881+0000","last_undegraded":"2024-04-25T23:02:40.184881+0000","last_fullsized":"2024-04-25T23:02:40.184881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093409+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093409+0000","last_peered":"2024-04-25T23:02:42.093409+0000","last_clean":"2024-04-25T23:02:42.093409+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093409+0000","last_undegraded":"2024-04-25T23:02:42.093409+0000","last_fullsized":"2024-04-25T23:02:42.093409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":941,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169770+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:40.169770+0000","last_peered":"2024-04-25T23:02:40.169770+0000","last_clean":"2024-04-25T23:02:40.169770+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:40.169770+0000","last_undegraded":"2024-04-25T23:02:40.169770+0000","last_fullsized":"2024-04-25T23:02:40.169770+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":382,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183576+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:40.183576+0000","last_peered":"2024-04-25T23:02:40.183576+0000","last_clean":"2024-04-25T23:02:40.183576+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:40.183576+0000","last_undegraded":"2024-04-25T23:02:40.183576+0000","last_fullsized":"2024-04-25T23:02:40.183576+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185668+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:40.185668+0000","last_peered":"2024-04-25T23:02:40.185668+0000","last_clean":"2024-04-25T23:02:40.185668+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:40.185668+0000","last_undegraded":"2024-04-25T23:02:40.185668+0000","last_fullsized":"2024-04-25T23:02:40.185668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":807,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169120+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:40.169120+0000","last_peered":"2024-04-25T23:02:40.169120+0000","last_clean":"2024-04-25T23:02:40.169120+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:40.169120+0000","last_undegraded":"2024-04-25T23:02:40.169120+0000","last_fullsized":"2024-04-25T23:02:40.169120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1052,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185919+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:40.185919+0000","last_peered":"2024-04-25T23:02:40.185919+0000","last_clean":"2024-04-25T23:02:40.185919+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:40.185919+0000","last_undegraded":"2024-04-25T23:02:40.185919+0000","last_fullsized":"2024-04-25T23:02:40.185919+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183428+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:40.183428+0000","last_peered":"2024-04-25T23:02:40.183428+0000","last_clean":"2024-04-25T23:02:40.183428+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:40.183428+0000","last_undegraded":"2024-04-25T23:02:40.183428+0000","last_fullsized":"2024-04-25T23:02:40.183428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":359,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168632+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:40.168632+0000","last_peered":"2024-04-25T23:02:40.168632+0000","last_clean":"2024-04-25T23:02:40.168632+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:40.168632+0000","last_undegraded":"2024-04-25T23:02:40.168632+0000","last_fullsized":"2024-04-25T23:02:40.168632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095534+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095534+0000","last_peered":"2024-04-25T23:02:42.095534+0000","last_clean":"2024-04-25T23:02:42.095534+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095534+0000","last_undegraded":"2024-04-25T23:02:42.095534+0000","last_fullsized":"2024-04-25T23:02:42.095534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168963+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:40.168963+0000","last_peered":"2024-04-25T23:02:40.168963+0000","last_clean":"2024-04-25T23:02:40.168963+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:40.168963+0000","last_undegraded":"2024-04-25T23:02:40.168963+0000","last_fullsized":"2024-04-25T23:02:40.168963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":497,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092926+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.092926+0000","last_peered":"2024-04-25T23:02:42.092926+0000","last_clean":"2024-04-25T23:02:42.092926+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.092926+0000","last_undegraded":"2024-04-25T23:02:42.092926+0000","last_fullsized":"2024-04-25T23:02:42.092926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":884,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.176356+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:40.176356+0000","last_peered":"2024-04-25T23:02:40.176356+0000","last_clean":"2024-04-25T23:02:40.176356+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:40.176356+0000","last_undegraded":"2024-04-25T23:02:40.176356+0000","last_fullsized":"2024-04-25T23:02:40.176356+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184583+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:40.184583+0000","last_peered":"2024-04-25T23:02:40.184583+0000","last_clean":"2024-04-25T23:02:40.184583+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:40.184583+0000","last_undegraded":"2024-04-25T23:02:40.184583+0000","last_fullsized":"2024-04-25T23:02:40.184583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":239,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185396+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:40.185396+0000","last_peered":"2024-04-25T23:02:40.185396+0000","last_clean":"2024-04-25T23:02:40.185396+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:40.185396+0000","last_undegraded":"2024-04-25T23:02:40.185396+0000","last_fullsized":"2024-04-25T23:02:40.185396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":929,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169989+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:40.169989+0000","last_peered":"2024-04-25T23:02:40.169989+0000","last_clean":"2024-04-25T23:02:40.169989+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:40.169989+0000","last_undegraded":"2024-04-25T23:02:40.169989+0000","last_fullsized":"2024-04-25T23:02:40.169989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":446,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.186064+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:40.186064+0000","last_peered":"2024-04-25T23:02:40.186064+0000","last_clean":"2024-04-25T23:02:40.186064+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:40.186064+0000","last_undegraded":"2024-04-25T23:02:40.186064+0000","last_fullsized":"2024-04-25T23:02:40.186064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170294+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:40.170294+0000","last_peered":"2024-04-25T23:02:40.170294+0000","last_clean":"2024-04-25T23:02:40.170294+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:40.170294+0000","last_undegraded":"2024-04-25T23:02:40.170294+0000","last_fullsized":"2024-04-25T23:02:40.170294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":513,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094054+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:42.094054+0000","last_peered":"2024-04-25T23:02:42.094054+0000","last_clean":"2024-04-25T23:02:42.094054+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:42.094054+0000","last_undegraded":"2024-04-25T23:02:42.094054+0000","last_fullsized":"2024-04-25T23:02:42.094054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170146+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:40.170146+0000","last_peered":"2024-04-25T23:02:40.170146+0000","last_clean":"2024-04-25T23:02:40.170146+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:40.170146+0000","last_undegraded":"2024-04-25T23:02:40.170146+0000","last_fullsized":"2024-04-25T23:02:40.170146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095610+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095610+0000","last_peered":"2024-04-25T23:02:42.095610+0000","last_clean":"2024-04-25T23:02:42.095610+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095610+0000","last_undegraded":"2024-04-25T23:02:42.095610+0000","last_fullsized":"2024-04-25T23:02:42.095610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093609+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:42.093609+0000","last_peered":"2024-04-25T23:02:42.093609+0000","last_clean":"2024-04-25T23:02:42.093609+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:42.093609+0000","last_undegraded":"2024-04-25T23:02:42.093609+0000","last_fullsized":"2024-04-25T23:02:42.093609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170943+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:40.170943+0000","last_peered":"2024-04-25T23:02:40.170943+0000","last_clean":"2024-04-25T23:02:40.170943+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:40.170943+0000","last_undegraded":"2024-04-25T23:02:40.170943+0000","last_fullsized":"2024-04-25T23:02:40.170943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170523+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:40.170523+0000","last_peered":"2024-04-25T23:02:40.170523+0000","last_clean":"2024-04-25T23:02:40.170523+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:40.170523+0000","last_undegraded":"2024-04-25T23:02:40.170523+0000","last_fullsized":"2024-04-25T23:02:40.170523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168426+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:40.168426+0000","last_peered":"2024-04-25T23:02:40.168426+0000","last_clean":"2024-04-25T23:02:40.168426+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:40.168426+0000","last_undegraded":"2024-04-25T23:02:40.168426+0000","last_fullsized":"2024-04-25T23:02:40.168426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170404+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:40.170404+0000","last_peered":"2024-04-25T23:02:40.170404+0000","last_clean":"2024-04-25T23:02:40.170404+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:40.170404+0000","last_undegraded":"2024-04-25T23:02:40.170404+0000","last_fullsized":"2024-04-25T23:02:40.170404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185799+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:40.185799+0000","last_peered":"2024-04-25T23:02:40.185799+0000","last_clean":"2024-04-25T23:02:40.185799+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:40.185799+0000","last_undegraded":"2024-04-25T23:02:40.185799+0000","last_fullsized":"2024-04-25T23:02:40.185799+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093896+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:42.093896+0000","last_peered":"2024-04-25T23:02:42.093896+0000","last_clean":"2024-04-25T23:02:42.093896+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:42.093896+0000","last_undegraded":"2024-04-25T23:02:42.093896+0000","last_fullsized":"2024-04-25T23:02:42.093896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1000,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184286+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:40.184286+0000","last_peered":"2024-04-25T23:02:40.184286+0000","last_clean":"2024-04-25T23:02:40.184286+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:40.184286+0000","last_undegraded":"2024-04-25T23:02:40.184286+0000","last_fullsized":"2024-04-25T23:02:40.184286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":433,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185237+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:40.185237+0000","last_peered":"2024-04-25T23:02:40.185237+0000","last_clean":"2024-04-25T23:02:40.185237+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:40.185237+0000","last_undegraded":"2024-04-25T23:02:40.185237+0000","last_fullsized":"2024-04-25T23:02:40.185237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":992,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168568+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:40.168568+0000","last_peered":"2024-04-25T23:02:40.168568+0000","last_clean":"2024-04-25T23:02:40.168568+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:40.168568+0000","last_undegraded":"2024-04-25T23:02:40.168568+0000","last_fullsized":"2024-04-25T23:02:40.168568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094958+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.094958+0000","last_peered":"2024-04-25T23:02:42.094958+0000","last_clean":"2024-04-25T23:02:42.094958+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.094958+0000","last_undegraded":"2024-04-25T23:02:42.094958+0000","last_fullsized":"2024-04-25T23:02:42.094958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":376,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185445+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:40.185445+0000","last_peered":"2024-04-25T23:02:40.185445+0000","last_clean":"2024-04-25T23:02:40.185445+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:40.185445+0000","last_undegraded":"2024-04-25T23:02:40.185445+0000","last_fullsized":"2024-04-25T23:02:40.185445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":672,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168289+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:40.168289+0000","last_peered":"2024-04-25T23:02:40.168289+0000","last_clean":"2024-04-25T23:02:40.168289+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:40.168289+0000","last_undegraded":"2024-04-25T23:02:40.168289+0000","last_fullsized":"2024-04-25T23:02:40.168289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170701+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:40.170701+0000","last_peered":"2024-04-25T23:02:40.170701+0000","last_clean":"2024-04-25T23:02:40.170701+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:40.170701+0000","last_undegraded":"2024-04-25T23:02:40.170701+0000","last_fullsized":"2024-04-25T23:02:40.170701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1037,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168366+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:40.168366+0000","last_peered":"2024-04-25T23:02:40.168366+0000","last_clean":"2024-04-25T23:02:40.168366+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:40.168366+0000","last_undegraded":"2024-04-25T23:02:40.168366+0000","last_fullsized":"2024-04-25T23:02:40.168366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":503,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096211+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:42.096211+0000","last_peered":"2024-04-25T23:02:42.096211+0000","last_clean":"2024-04-25T23:02:42.096211+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:42.096211+0000","last_undegraded":"2024-04-25T23:02:42.096211+0000","last_fullsized":"2024-04-25T23:02:42.096211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":751,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168669+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:40.168669+0000","last_peered":"2024-04-25T23:02:40.168669+0000","last_clean":"2024-04-25T23:02:40.168669+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:40.168669+0000","last_undegraded":"2024-04-25T23:02:40.168669+0000","last_fullsized":"2024-04-25T23:02:40.168669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.169843+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:40.169843+0000","last_peered":"2024-04-25T23:02:40.169843+0000","last_clean":"2024-04-25T23:02:40.169843+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:40.169843+0000","last_undegraded":"2024-04-25T23:02:40.169843+0000","last_fullsized":"2024-04-25T23:02:40.169843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.168619+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:40.168619+0000","last_peered":"2024-04-25T23:02:40.168619+0000","last_clean":"2024-04-25T23:02:40.168619+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:40.168619+0000","last_undegraded":"2024-04-25T23:02:40.168619+0000","last_fullsized":"2024-04-25T23:02:40.168619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094896+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.094896+0000","last_peered":"2024-04-25T23:02:42.094896+0000","last_clean":"2024-04-25T23:02:42.094896+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.094896+0000","last_undegraded":"2024-04-25T23:02:42.094896+0000","last_fullsized":"2024-04-25T23:02:42.094896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093622+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093622+0000","last_peered":"2024-04-25T23:02:42.093622+0000","last_clean":"2024-04-25T23:02:42.093622+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093622+0000","last_undegraded":"2024-04-25T23:02:42.093622+0000","last_fullsized":"2024-04-25T23:02:42.093622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094850+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:42.094850+0000","last_peered":"2024-04-25T23:02:42.094850+0000","last_clean":"2024-04-25T23:02:42.094850+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:42.094850+0000","last_undegraded":"2024-04-25T23:02:42.094850+0000","last_fullsized":"2024-04-25T23:02:42.094850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093911+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.093911+0000","last_peered":"2024-04-25T23:02:42.093911+0000","last_clean":"2024-04-25T23:02:42.093911+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.093911+0000","last_undegraded":"2024-04-25T23:02:42.093911+0000","last_fullsized":"2024-04-25T23:02:42.093911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":592,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184286+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:40.184286+0000","last_peered":"2024-04-25T23:02:40.184286+0000","last_clean":"2024-04-25T23:02:40.184286+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:40.184286+0000","last_undegraded":"2024-04-25T23:02:40.184286+0000","last_fullsized":"2024-04-25T23:02:40.184286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.185064+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:40.185064+0000","last_peered":"2024-04-25T23:02:40.185064+0000","last_clean":"2024-04-25T23:02:40.185064+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:40.185064+0000","last_undegraded":"2024-04-25T23:02:40.185064+0000","last_fullsized":"2024-04-25T23:02:40.185064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":654,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.184214+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:40.184214+0000","last_peered":"2024-04-25T23:02:40.184214+0000","last_clean":"2024-04-25T23:02:40.184214+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:40.184214+0000","last_undegraded":"2024-04-25T23:02:40.184214+0000","last_fullsized":"2024-04-25T23:02:40.184214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":444,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094599+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094599+0000","last_peered":"2024-04-25T23:02:42.094599+0000","last_clean":"2024-04-25T23:02:42.094599+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094599+0000","last_undegraded":"2024-04-25T23:02:42.094599+0000","last_fullsized":"2024-04-25T23:02:42.094599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093692+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:42.093692+0000","last_peered":"2024-04-25T23:02:42.093692+0000","last_clean":"2024-04-25T23:02:42.093692+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:42.093692+0000","last_undegraded":"2024-04-25T23:02:42.093692+0000","last_fullsized":"2024-04-25T23:02:42.093692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170234+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:40.170234+0000","last_peered":"2024-04-25T23:02:40.170234+0000","last_clean":"2024-04-25T23:02:40.170234+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:40.170234+0000","last_undegraded":"2024-04-25T23:02:40.170234+0000","last_fullsized":"2024-04-25T23:02:40.170234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":653,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.183421+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:40.183421+0000","last_peered":"2024-04-25T23:02:40.183421+0000","last_clean":"2024-04-25T23:02:40.183421+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:40.183421+0000","last_undegraded":"2024-04-25T23:02:40.183421+0000","last_fullsized":"2024-04-25T23:02:40.183421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T23:02:40.170026+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:40.170026+0000","last_peered":"2024-04-25T23:02:40.170026+0000","last_clean":"2024-04-25T23:02:40.170026+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:40.170026+0000","last_undegraded":"2024-04-25T23:02:40.170026+0000","last_fullsized":"2024-04-25T23:02:40.170026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142136,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229704,"statfs":{"total":96636764160,"available":96491216896,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177872,"kb_used_data":80124,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193968,"statfs":{"total":96636764160,"available":96454623232,"internally_reserved":0,"allocated":82046976,"data_stored":81558012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179000,"kb_used_data":89576,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192840,"statfs":{"total":96636764160,"available":96453468160,"internally_reserved":0,"allocated":91725824,"data_stored":91216610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:48.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:48.859 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:48.862 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:48.874 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-04-25T23:02:48.598320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":499044,"kb_used_data":253808,"kb_used_omap":8,"kb_used_meta":245175,"kb_avail":282616476,"statfs":{"total":289910292480,"available":289399271424,"internally_reserved":0,"allocated":259899392,"data_stored":258365132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":251059221},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002599"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096437+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:42.096437+0000","last_peered":"2024-04-25T23:02:42.096437+0000","last_clean":"2024-04-25T23:02:42.096437+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:42.096437+0000","last_undegraded":"2024-04-25T23:02:42.096437+0000","last_fullsized":"2024-04-25T23:02:42.096437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.770809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":601,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095514+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095514+0000","last_peered":"2024-04-25T23:02:42.095514+0000","last_clean":"2024-04-25T23:02:42.095514+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095514+0000","last_undegraded":"2024-04-25T23:02:42.095514+0000","last_fullsized":"2024-04-25T23:02:42.095514+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":911,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180224+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:42.180224+0000","last_peered":"2024-04-25T23:02:42.180224+0000","last_clean":"2024-04-25T23:02:42.180224+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:42.180224+0000","last_undegraded":"2024-04-25T23:02:42.180224+0000","last_fullsized":"2024-04-25T23:02:42.180224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":575,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180022+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:42.180022+0000","last_peered":"2024-04-25T23:02:42.180022+0000","last_clean":"2024-04-25T23:02:42.180022+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:42.180022+0000","last_undegraded":"2024-04-25T23:02:42.180022+0000","last_fullsized":"2024-04-25T23:02:42.180022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094052+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:42.094052+0000","last_peered":"2024-04-25T23:02:42.094052+0000","last_clean":"2024-04-25T23:02:42.094052+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:42.094052+0000","last_undegraded":"2024-04-25T23:02:42.094052+0000","last_fullsized":"2024-04-25T23:02:42.094052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":551,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179685+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:42.179685+0000","last_peered":"2024-04-25T23:02:42.179685+0000","last_clean":"2024-04-25T23:02:42.179685+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:42.179685+0000","last_undegraded":"2024-04-25T23:02:42.179685+0000","last_fullsized":"2024-04-25T23:02:42.179685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179119+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:42.179119+0000","last_peered":"2024-04-25T23:02:42.179119+0000","last_clean":"2024-04-25T23:02:42.179119+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:42.179119+0000","last_undegraded":"2024-04-25T23:02:42.179119+0000","last_fullsized":"2024-04-25T23:02:42.179119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":584,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179014+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:42.179014+0000","last_peered":"2024-04-25T23:02:42.179014+0000","last_clean":"2024-04-25T23:02:42.179014+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:42.179014+0000","last_undegraded":"2024-04-25T23:02:42.179014+0000","last_fullsized":"2024-04-25T23:02:42.179014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":936,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180749+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:42.180749+0000","last_peered":"2024-04-25T23:02:42.180749+0000","last_clean":"2024-04-25T23:02:42.180749+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:42.180749+0000","last_undegraded":"2024-04-25T23:02:42.180749+0000","last_fullsized":"2024-04-25T23:02:42.180749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095256+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095256+0000","last_peered":"2024-04-25T23:02:42.095256+0000","last_clean":"2024-04-25T23:02:42.095256+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095256+0000","last_undegraded":"2024-04-25T23:02:42.095256+0000","last_fullsized":"2024-04-25T23:02:42.095256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180197+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:42.180197+0000","last_peered":"2024-04-25T23:02:42.180197+0000","last_clean":"2024-04-25T23:02:42.180197+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:42.180197+0000","last_undegraded":"2024-04-25T23:02:42.180197+0000","last_fullsized":"2024-04-25T23:02:42.180197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":524,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095344+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:42.095344+0000","last_peered":"2024-04-25T23:02:42.095344+0000","last_clean":"2024-04-25T23:02:42.095344+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:42.095344+0000","last_undegraded":"2024-04-25T23:02:42.095344+0000","last_fullsized":"2024-04-25T23:02:42.095344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":484,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.101687+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:42.101687+0000","last_peered":"2024-04-25T23:02:42.101687+0000","last_clean":"2024-04-25T23:02:42.101687+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:42.101687+0000","last_undegraded":"2024-04-25T23:02:42.101687+0000","last_fullsized":"2024-04-25T23:02:42.101687+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:29.984646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1030,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179637+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:42.179637+0000","last_peered":"2024-04-25T23:02:42.179637+0000","last_clean":"2024-04-25T23:02:42.179637+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:42.179637+0000","last_undegraded":"2024-04-25T23:02:42.179637+0000","last_fullsized":"2024-04-25T23:02:42.179637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":978,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179031+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:42.179031+0000","last_peered":"2024-04-25T23:02:42.179031+0000","last_clean":"2024-04-25T23:02:42.179031+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:42.179031+0000","last_undegraded":"2024-04-25T23:02:42.179031+0000","last_fullsized":"2024-04-25T23:02:42.179031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1064,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181872+0000","last_change":"2024-04-25T23:02:41.179727+0000","last_active":"2024-04-25T23:02:42.181872+0000","last_peered":"2024-04-25T23:02:42.181872+0000","last_clean":"2024-04-25T23:02:42.181872+0000","last_became_active":"2024-04-25T23:02:41.176566+0000","last_became_peered":"2024-04-25T23:02:41.176566+0000","last_unstale":"2024-04-25T23:02:42.181872+0000","last_undegraded":"2024-04-25T23:02:42.181872+0000","last_fullsized":"2024-04-25T23:02:42.181872+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092854+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.092854+0000","last_peered":"2024-04-25T23:02:42.092854+0000","last_clean":"2024-04-25T23:02:42.092854+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.092854+0000","last_undegraded":"2024-04-25T23:02:42.092854+0000","last_fullsized":"2024-04-25T23:02:42.092854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180702+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:42.180702+0000","last_peered":"2024-04-25T23:02:42.180702+0000","last_clean":"2024-04-25T23:02:42.180702+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:42.180702+0000","last_undegraded":"2024-04-25T23:02:42.180702+0000","last_fullsized":"2024-04-25T23:02:42.180702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":600,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180568+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:42.180568+0000","last_peered":"2024-04-25T23:02:42.180568+0000","last_clean":"2024-04-25T23:02:42.180568+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:42.180568+0000","last_undegraded":"2024-04-25T23:02:42.180568+0000","last_fullsized":"2024-04-25T23:02:42.180568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":643,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180679+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:42.180679+0000","last_peered":"2024-04-25T23:02:42.180679+0000","last_clean":"2024-04-25T23:02:42.180679+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:42.180679+0000","last_undegraded":"2024-04-25T23:02:42.180679+0000","last_fullsized":"2024-04-25T23:02:42.180679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094227+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:42.094227+0000","last_peered":"2024-04-25T23:02:42.094227+0000","last_clean":"2024-04-25T23:02:42.094227+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:42.094227+0000","last_undegraded":"2024-04-25T23:02:42.094227+0000","last_fullsized":"2024-04-25T23:02:42.094227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":581,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.178890+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:42.178890+0000","last_peered":"2024-04-25T23:02:42.178890+0000","last_clean":"2024-04-25T23:02:42.178890+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:42.178890+0000","last_undegraded":"2024-04-25T23:02:42.178890+0000","last_fullsized":"2024-04-25T23:02:42.178890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093292+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093292+0000","last_peered":"2024-04-25T23:02:42.093292+0000","last_clean":"2024-04-25T23:02:42.093292+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093292+0000","last_undegraded":"2024-04-25T23:02:42.093292+0000","last_fullsized":"2024-04-25T23:02:42.093292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095361+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:42.095361+0000","last_peered":"2024-04-25T23:02:42.095361+0000","last_clean":"2024-04-25T23:02:42.095361+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:42.095361+0000","last_undegraded":"2024-04-25T23:02:42.095361+0000","last_fullsized":"2024-04-25T23:02:42.095361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":662,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180855+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:42.180855+0000","last_peered":"2024-04-25T23:02:42.180855+0000","last_clean":"2024-04-25T23:02:42.180855+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:42.180855+0000","last_undegraded":"2024-04-25T23:02:42.180855+0000","last_fullsized":"2024-04-25T23:02:42.180855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":952,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180444+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:42.180444+0000","last_peered":"2024-04-25T23:02:42.180444+0000","last_clean":"2024-04-25T23:02:42.180444+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:42.180444+0000","last_undegraded":"2024-04-25T23:02:42.180444+0000","last_fullsized":"2024-04-25T23:02:42.180444+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":571,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095167+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095167+0000","last_peered":"2024-04-25T23:02:42.095167+0000","last_clean":"2024-04-25T23:02:42.095167+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095167+0000","last_undegraded":"2024-04-25T23:02:42.095167+0000","last_fullsized":"2024-04-25T23:02:42.095167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:37.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":949,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180379+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:42.180379+0000","last_peered":"2024-04-25T23:02:42.180379+0000","last_clean":"2024-04-25T23:02:42.180379+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:42.180379+0000","last_undegraded":"2024-04-25T23:02:42.180379+0000","last_fullsized":"2024-04-25T23:02:42.180379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":631,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093898+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:42.093898+0000","last_peered":"2024-04-25T23:02:42.093898+0000","last_clean":"2024-04-25T23:02:42.093898+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:42.093898+0000","last_undegraded":"2024-04-25T23:02:42.093898+0000","last_fullsized":"2024-04-25T23:02:42.093898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1040,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179123+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:42.179123+0000","last_peered":"2024-04-25T23:02:42.179123+0000","last_clean":"2024-04-25T23:02:42.179123+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:42.179123+0000","last_undegraded":"2024-04-25T23:02:42.179123+0000","last_fullsized":"2024-04-25T23:02:42.179123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":690,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179373+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:42.179373+0000","last_peered":"2024-04-25T23:02:42.179373+0000","last_clean":"2024-04-25T23:02:42.179373+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:42.179373+0000","last_undegraded":"2024-04-25T23:02:42.179373+0000","last_fullsized":"2024-04-25T23:02:42.179373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":651,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094571+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:42.094571+0000","last_peered":"2024-04-25T23:02:42.094571+0000","last_clean":"2024-04-25T23:02:42.094571+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:42.094571+0000","last_undegraded":"2024-04-25T23:02:42.094571+0000","last_fullsized":"2024-04-25T23:02:42.094571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":718,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181460+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:42.181460+0000","last_peered":"2024-04-25T23:02:42.181460+0000","last_clean":"2024-04-25T23:02:42.181460+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:42.181460+0000","last_undegraded":"2024-04-25T23:02:42.181460+0000","last_fullsized":"2024-04-25T23:02:42.181460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":578,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094656+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:42.094656+0000","last_peered":"2024-04-25T23:02:42.094656+0000","last_clean":"2024-04-25T23:02:42.094656+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:42.094656+0000","last_undegraded":"2024-04-25T23:02:42.094656+0000","last_fullsized":"2024-04-25T23:02:42.094656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":218,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179724+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:42.179724+0000","last_peered":"2024-04-25T23:02:42.179724+0000","last_clean":"2024-04-25T23:02:42.179724+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:42.179724+0000","last_undegraded":"2024-04-25T23:02:42.179724+0000","last_fullsized":"2024-04-25T23:02:42.179724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":670,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181624+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:42.181624+0000","last_peered":"2024-04-25T23:02:42.181624+0000","last_clean":"2024-04-25T23:02:42.181624+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:42.181624+0000","last_undegraded":"2024-04-25T23:02:42.181624+0000","last_fullsized":"2024-04-25T23:02:42.181624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093598+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093598+0000","last_peered":"2024-04-25T23:02:42.093598+0000","last_clean":"2024-04-25T23:02:42.093598+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093598+0000","last_undegraded":"2024-04-25T23:02:42.093598+0000","last_fullsized":"2024-04-25T23:02:42.093598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180991+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:42.180991+0000","last_peered":"2024-04-25T23:02:42.180991+0000","last_clean":"2024-04-25T23:02:42.180991+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:42.180991+0000","last_undegraded":"2024-04-25T23:02:42.180991+0000","last_fullsized":"2024-04-25T23:02:42.180991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179421+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:42.179421+0000","last_peered":"2024-04-25T23:02:42.179421+0000","last_clean":"2024-04-25T23:02:42.179421+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:42.179421+0000","last_undegraded":"2024-04-25T23:02:42.179421+0000","last_fullsized":"2024-04-25T23:02:42.179421+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":337,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181609+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:42.181609+0000","last_peered":"2024-04-25T23:02:42.181609+0000","last_clean":"2024-04-25T23:02:42.181609+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:42.181609+0000","last_undegraded":"2024-04-25T23:02:42.181609+0000","last_fullsized":"2024-04-25T23:02:42.181609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":627,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093710+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:42.093710+0000","last_peered":"2024-04-25T23:02:42.093710+0000","last_clean":"2024-04-25T23:02:42.093710+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:42.093710+0000","last_undegraded":"2024-04-25T23:02:42.093710+0000","last_fullsized":"2024-04-25T23:02:42.093710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":447,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094936+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.094936+0000","last_peered":"2024-04-25T23:02:42.094936+0000","last_clean":"2024-04-25T23:02:42.094936+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.094936+0000","last_undegraded":"2024-04-25T23:02:42.094936+0000","last_fullsized":"2024-04-25T23:02:42.094936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093125+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:42.093125+0000","last_peered":"2024-04-25T23:02:42.093125+0000","last_clean":"2024-04-25T23:02:42.093125+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:42.093125+0000","last_undegraded":"2024-04-25T23:02:42.093125+0000","last_fullsized":"2024-04-25T23:02:42.093125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":671,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181076+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:42.181076+0000","last_peered":"2024-04-25T23:02:42.181076+0000","last_clean":"2024-04-25T23:02:42.181076+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:42.181076+0000","last_undegraded":"2024-04-25T23:02:42.181076+0000","last_fullsized":"2024-04-25T23:02:42.181076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":616,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179993+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:42.179993+0000","last_peered":"2024-04-25T23:02:42.179993+0000","last_clean":"2024-04-25T23:02:42.179993+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:42.179993+0000","last_undegraded":"2024-04-25T23:02:42.179993+0000","last_fullsized":"2024-04-25T23:02:42.179993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":241,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181446+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:42.181446+0000","last_peered":"2024-04-25T23:02:42.181446+0000","last_clean":"2024-04-25T23:02:42.181446+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:42.181446+0000","last_undegraded":"2024-04-25T23:02:42.181446+0000","last_fullsized":"2024-04-25T23:02:42.181446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":682,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180483+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:42.180483+0000","last_peered":"2024-04-25T23:02:42.180483+0000","last_clean":"2024-04-25T23:02:42.180483+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:42.180483+0000","last_undegraded":"2024-04-25T23:02:42.180483+0000","last_fullsized":"2024-04-25T23:02:42.180483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":308,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181027+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:42.181027+0000","last_peered":"2024-04-25T23:02:42.181027+0000","last_clean":"2024-04-25T23:02:42.181027+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:42.181027+0000","last_undegraded":"2024-04-25T23:02:42.181027+0000","last_fullsized":"2024-04-25T23:02:42.181027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180897+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.180897+0000","last_peered":"2024-04-25T23:02:42.180897+0000","last_clean":"2024-04-25T23:02:42.180897+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:42.180897+0000","last_undegraded":"2024-04-25T23:02:42.180897+0000","last_fullsized":"2024-04-25T23:02:42.180897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180633+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:42.180633+0000","last_peered":"2024-04-25T23:02:42.180633+0000","last_clean":"2024-04-25T23:02:42.180633+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:42.180633+0000","last_undegraded":"2024-04-25T23:02:42.180633+0000","last_fullsized":"2024-04-25T23:02:42.180633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":986,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180790+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:42.180790+0000","last_peered":"2024-04-25T23:02:42.180790+0000","last_clean":"2024-04-25T23:02:42.180790+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:42.180790+0000","last_undegraded":"2024-04-25T23:02:42.180790+0000","last_fullsized":"2024-04-25T23:02:42.180790+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093232+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093232+0000","last_peered":"2024-04-25T23:02:42.093232+0000","last_clean":"2024-04-25T23:02:42.093232+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093232+0000","last_undegraded":"2024-04-25T23:02:42.093232+0000","last_fullsized":"2024-04-25T23:02:42.093232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":907,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180786+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:42.180786+0000","last_peered":"2024-04-25T23:02:42.180786+0000","last_clean":"2024-04-25T23:02:42.180786+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:42.180786+0000","last_undegraded":"2024-04-25T23:02:42.180786+0000","last_fullsized":"2024-04-25T23:02:42.180786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093409+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093409+0000","last_peered":"2024-04-25T23:02:42.093409+0000","last_clean":"2024-04-25T23:02:42.093409+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093409+0000","last_undegraded":"2024-04-25T23:02:42.093409+0000","last_fullsized":"2024-04-25T23:02:42.093409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":945,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181061+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:42.181061+0000","last_peered":"2024-04-25T23:02:42.181061+0000","last_clean":"2024-04-25T23:02:42.181061+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:42.181061+0000","last_undegraded":"2024-04-25T23:02:42.181061+0000","last_fullsized":"2024-04-25T23:02:42.181061+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":386,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180214+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:42.180214+0000","last_peered":"2024-04-25T23:02:42.180214+0000","last_clean":"2024-04-25T23:02:42.180214+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:42.180214+0000","last_undegraded":"2024-04-25T23:02:42.180214+0000","last_fullsized":"2024-04-25T23:02:42.180214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181741+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:42.181741+0000","last_peered":"2024-04-25T23:02:42.181741+0000","last_clean":"2024-04-25T23:02:42.181741+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:42.181741+0000","last_undegraded":"2024-04-25T23:02:42.181741+0000","last_fullsized":"2024-04-25T23:02:42.181741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":811,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179963+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:42.179963+0000","last_peered":"2024-04-25T23:02:42.179963+0000","last_clean":"2024-04-25T23:02:42.179963+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:42.179963+0000","last_undegraded":"2024-04-25T23:02:42.179963+0000","last_fullsized":"2024-04-25T23:02:42.179963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1056,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179934+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:42.179934+0000","last_peered":"2024-04-25T23:02:42.179934+0000","last_clean":"2024-04-25T23:02:42.179934+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:42.179934+0000","last_undegraded":"2024-04-25T23:02:42.179934+0000","last_fullsized":"2024-04-25T23:02:42.179934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":363,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179676+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:42.179676+0000","last_peered":"2024-04-25T23:02:42.179676+0000","last_clean":"2024-04-25T23:02:42.179676+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:42.179676+0000","last_undegraded":"2024-04-25T23:02:42.179676+0000","last_fullsized":"2024-04-25T23:02:42.179676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095534+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095534+0000","last_peered":"2024-04-25T23:02:42.095534+0000","last_clean":"2024-04-25T23:02:42.095534+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095534+0000","last_undegraded":"2024-04-25T23:02:42.095534+0000","last_fullsized":"2024-04-25T23:02:42.095534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180262+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:42.180262+0000","last_peered":"2024-04-25T23:02:42.180262+0000","last_clean":"2024-04-25T23:02:42.180262+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:42.180262+0000","last_undegraded":"2024-04-25T23:02:42.180262+0000","last_fullsized":"2024-04-25T23:02:42.180262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":497,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092926+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.092926+0000","last_peered":"2024-04-25T23:02:42.092926+0000","last_clean":"2024-04-25T23:02:42.092926+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.092926+0000","last_undegraded":"2024-04-25T23:02:42.092926+0000","last_fullsized":"2024-04-25T23:02:42.092926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":888,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181390+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:42.181390+0000","last_peered":"2024-04-25T23:02:42.181390+0000","last_clean":"2024-04-25T23:02:42.181390+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:42.181390+0000","last_undegraded":"2024-04-25T23:02:42.181390+0000","last_fullsized":"2024-04-25T23:02:42.181390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180650+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:42.180650+0000","last_peered":"2024-04-25T23:02:42.180650+0000","last_clean":"2024-04-25T23:02:42.180650+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:42.180650+0000","last_undegraded":"2024-04-25T23:02:42.180650+0000","last_fullsized":"2024-04-25T23:02:42.180650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181465+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:42.181465+0000","last_peered":"2024-04-25T23:02:42.181465+0000","last_clean":"2024-04-25T23:02:42.181465+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:42.181465+0000","last_undegraded":"2024-04-25T23:02:42.181465+0000","last_fullsized":"2024-04-25T23:02:42.181465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":933,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181262+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:42.181262+0000","last_peered":"2024-04-25T23:02:42.181262+0000","last_clean":"2024-04-25T23:02:42.181262+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:42.181262+0000","last_undegraded":"2024-04-25T23:02:42.181262+0000","last_fullsized":"2024-04-25T23:02:42.181262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":450,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181371+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:42.181371+0000","last_peered":"2024-04-25T23:02:42.181371+0000","last_clean":"2024-04-25T23:02:42.181371+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:42.181371+0000","last_undegraded":"2024-04-25T23:02:42.181371+0000","last_fullsized":"2024-04-25T23:02:42.181371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181052+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:42.181052+0000","last_peered":"2024-04-25T23:02:42.181052+0000","last_clean":"2024-04-25T23:02:42.181052+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:42.181052+0000","last_undegraded":"2024-04-25T23:02:42.181052+0000","last_fullsized":"2024-04-25T23:02:42.181052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":513,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094054+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:42.094054+0000","last_peered":"2024-04-25T23:02:42.094054+0000","last_clean":"2024-04-25T23:02:42.094054+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:42.094054+0000","last_undegraded":"2024-04-25T23:02:42.094054+0000","last_fullsized":"2024-04-25T23:02:42.094054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":227,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180770+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:42.180770+0000","last_peered":"2024-04-25T23:02:42.180770+0000","last_clean":"2024-04-25T23:02:42.180770+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:42.180770+0000","last_undegraded":"2024-04-25T23:02:42.180770+0000","last_fullsized":"2024-04-25T23:02:42.180770+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095610+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095610+0000","last_peered":"2024-04-25T23:02:42.095610+0000","last_clean":"2024-04-25T23:02:42.095610+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095610+0000","last_undegraded":"2024-04-25T23:02:42.095610+0000","last_fullsized":"2024-04-25T23:02:42.095610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093609+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:42.093609+0000","last_peered":"2024-04-25T23:02:42.093609+0000","last_clean":"2024-04-25T23:02:42.093609+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:42.093609+0000","last_undegraded":"2024-04-25T23:02:42.093609+0000","last_fullsized":"2024-04-25T23:02:42.093609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":238,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181863+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:42.181863+0000","last_peered":"2024-04-25T23:02:42.181863+0000","last_clean":"2024-04-25T23:02:42.181863+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:42.181863+0000","last_undegraded":"2024-04-25T23:02:42.181863+0000","last_fullsized":"2024-04-25T23:02:42.181863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181900+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:42.181900+0000","last_peered":"2024-04-25T23:02:42.181900+0000","last_clean":"2024-04-25T23:02:42.181900+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:42.181900+0000","last_undegraded":"2024-04-25T23:02:42.181900+0000","last_fullsized":"2024-04-25T23:02:42.181900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":573,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179307+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:42.179307+0000","last_peered":"2024-04-25T23:02:42.179307+0000","last_clean":"2024-04-25T23:02:42.179307+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:42.179307+0000","last_undegraded":"2024-04-25T23:02:42.179307+0000","last_fullsized":"2024-04-25T23:02:42.179307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":277,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181694+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:42.181694+0000","last_peered":"2024-04-25T23:02:42.181694+0000","last_clean":"2024-04-25T23:02:42.181694+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:42.181694+0000","last_undegraded":"2024-04-25T23:02:42.181694+0000","last_fullsized":"2024-04-25T23:02:42.181694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181671+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:42.181671+0000","last_peered":"2024-04-25T23:02:42.181671+0000","last_clean":"2024-04-25T23:02:42.181671+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:42.181671+0000","last_undegraded":"2024-04-25T23:02:42.181671+0000","last_fullsized":"2024-04-25T23:02:42.181671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093896+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:42.093896+0000","last_peered":"2024-04-25T23:02:42.093896+0000","last_clean":"2024-04-25T23:02:42.093896+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:42.093896+0000","last_undegraded":"2024-04-25T23:02:42.093896+0000","last_fullsized":"2024-04-25T23:02:42.093896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1004,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180129+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:42.180129+0000","last_peered":"2024-04-25T23:02:42.180129+0000","last_clean":"2024-04-25T23:02:42.180129+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:42.180129+0000","last_undegraded":"2024-04-25T23:02:42.180129+0000","last_fullsized":"2024-04-25T23:02:42.180129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181167+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:42.181167+0000","last_peered":"2024-04-25T23:02:42.181167+0000","last_clean":"2024-04-25T23:02:42.181167+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:42.181167+0000","last_undegraded":"2024-04-25T23:02:42.181167+0000","last_fullsized":"2024-04-25T23:02:42.181167+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":996,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179445+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:42.179445+0000","last_peered":"2024-04-25T23:02:42.179445+0000","last_clean":"2024-04-25T23:02:42.179445+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:42.179445+0000","last_undegraded":"2024-04-25T23:02:42.179445+0000","last_fullsized":"2024-04-25T23:02:42.179445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094958+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.094958+0000","last_peered":"2024-04-25T23:02:42.094958+0000","last_clean":"2024-04-25T23:02:42.094958+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.094958+0000","last_undegraded":"2024-04-25T23:02:42.094958+0000","last_fullsized":"2024-04-25T23:02:42.094958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181287+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:42.181287+0000","last_peered":"2024-04-25T23:02:42.181287+0000","last_clean":"2024-04-25T23:02:42.181287+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:42.181287+0000","last_undegraded":"2024-04-25T23:02:42.181287+0000","last_fullsized":"2024-04-25T23:02:42.181287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":676,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179182+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:42.179182+0000","last_peered":"2024-04-25T23:02:42.179182+0000","last_clean":"2024-04-25T23:02:42.179182+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:42.179182+0000","last_undegraded":"2024-04-25T23:02:42.179182+0000","last_fullsized":"2024-04-25T23:02:42.179182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":235,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181681+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:42.181681+0000","last_peered":"2024-04-25T23:02:42.181681+0000","last_clean":"2024-04-25T23:02:42.181681+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:42.181681+0000","last_undegraded":"2024-04-25T23:02:42.181681+0000","last_fullsized":"2024-04-25T23:02:42.181681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1041,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179154+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:42.179154+0000","last_peered":"2024-04-25T23:02:42.179154+0000","last_clean":"2024-04-25T23:02:42.179154+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:42.179154+0000","last_undegraded":"2024-04-25T23:02:42.179154+0000","last_fullsized":"2024-04-25T23:02:42.179154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":503,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096211+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:42.096211+0000","last_peered":"2024-04-25T23:02:42.096211+0000","last_clean":"2024-04-25T23:02:42.096211+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:42.096211+0000","last_undegraded":"2024-04-25T23:02:42.096211+0000","last_fullsized":"2024-04-25T23:02:42.096211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":755,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180096+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:42.180096+0000","last_peered":"2024-04-25T23:02:42.180096+0000","last_clean":"2024-04-25T23:02:42.180096+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:42.180096+0000","last_undegraded":"2024-04-25T23:02:42.180096+0000","last_fullsized":"2024-04-25T23:02:42.180096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":637,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180742+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:42.180742+0000","last_peered":"2024-04-25T23:02:42.180742+0000","last_clean":"2024-04-25T23:02:42.180742+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:42.180742+0000","last_undegraded":"2024-04-25T23:02:42.180742+0000","last_fullsized":"2024-04-25T23:02:42.180742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179716+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:42.179716+0000","last_peered":"2024-04-25T23:02:42.179716+0000","last_clean":"2024-04-25T23:02:42.179716+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:42.179716+0000","last_undegraded":"2024-04-25T23:02:42.179716+0000","last_fullsized":"2024-04-25T23:02:42.179716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094896+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.094896+0000","last_peered":"2024-04-25T23:02:42.094896+0000","last_clean":"2024-04-25T23:02:42.094896+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.094896+0000","last_undegraded":"2024-04-25T23:02:42.094896+0000","last_fullsized":"2024-04-25T23:02:42.094896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093622+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093622+0000","last_peered":"2024-04-25T23:02:42.093622+0000","last_clean":"2024-04-25T23:02:42.093622+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093622+0000","last_undegraded":"2024-04-25T23:02:42.093622+0000","last_fullsized":"2024-04-25T23:02:42.093622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094850+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:42.094850+0000","last_peered":"2024-04-25T23:02:42.094850+0000","last_clean":"2024-04-25T23:02:42.094850+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:42.094850+0000","last_undegraded":"2024-04-25T23:02:42.094850+0000","last_fullsized":"2024-04-25T23:02:42.094850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093911+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.093911+0000","last_peered":"2024-04-25T23:02:42.093911+0000","last_clean":"2024-04-25T23:02:42.093911+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.093911+0000","last_undegraded":"2024-04-25T23:02:42.093911+0000","last_fullsized":"2024-04-25T23:02:42.093911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":596,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181100+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:42.181100+0000","last_peered":"2024-04-25T23:02:42.181100+0000","last_clean":"2024-04-25T23:02:42.181100+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:42.181100+0000","last_undegraded":"2024-04-25T23:02:42.181100+0000","last_fullsized":"2024-04-25T23:02:42.181100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":658,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180308+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:42.180308+0000","last_peered":"2024-04-25T23:02:42.180308+0000","last_clean":"2024-04-25T23:02:42.180308+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:42.180308+0000","last_undegraded":"2024-04-25T23:02:42.180308+0000","last_fullsized":"2024-04-25T23:02:42.180308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":444,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094599+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094599+0000","last_peered":"2024-04-25T23:02:42.094599+0000","last_clean":"2024-04-25T23:02:42.094599+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094599+0000","last_undegraded":"2024-04-25T23:02:42.094599+0000","last_fullsized":"2024-04-25T23:02:42.094599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093692+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:42.093692+0000","last_peered":"2024-04-25T23:02:42.093692+0000","last_clean":"2024-04-25T23:02:42.093692+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:42.093692+0000","last_undegraded":"2024-04-25T23:02:42.093692+0000","last_fullsized":"2024-04-25T23:02:42.093692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":242,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":657,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179641+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:42.179641+0000","last_peered":"2024-04-25T23:02:42.179641+0000","last_clean":"2024-04-25T23:02:42.179641+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:42.179641+0000","last_undegraded":"2024-04-25T23:02:42.179641+0000","last_fullsized":"2024-04-25T23:02:42.179641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":287,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181484+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:42.181484+0000","last_peered":"2024-04-25T23:02:42.181484+0000","last_clean":"2024-04-25T23:02:42.181484+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:42.181484+0000","last_undegraded":"2024-04-25T23:02:42.181484+0000","last_fullsized":"2024-04-25T23:02:42.181484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142136,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229704,"statfs":{"total":96636764160,"available":96491216896,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738420,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177884,"kb_used_data":80140,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193956,"statfs":{"total":96636764160,"available":96454610944,"internally_reserved":0,"allocated":82063360,"data_stored":81566497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179024,"kb_used_data":89600,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192816,"statfs":{"total":96636764160,"available":96453443584,"internally_reserved":0,"allocated":91750400,"data_stored":91229381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:48.878 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T23:02:48.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-25T23:02:49.245 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T23:02:49.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T23:02:49.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:49.562 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:49.564 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:49.581 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-04-25T23:02:48.598320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":499044,"kb_used_data":253808,"kb_used_omap":8,"kb_used_meta":245175,"kb_avail":282616476,"statfs":{"total":289910292480,"available":289399271424,"internally_reserved":0,"allocated":259899392,"data_stored":258365132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":251059221},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002599"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096437+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:42.096437+0000","last_peered":"2024-04-25T23:02:42.096437+0000","last_clean":"2024-04-25T23:02:42.096437+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:42.096437+0000","last_undegraded":"2024-04-25T23:02:42.096437+0000","last_fullsized":"2024-04-25T23:02:42.096437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.770809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":601,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095514+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095514+0000","last_peered":"2024-04-25T23:02:42.095514+0000","last_clean":"2024-04-25T23:02:42.095514+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095514+0000","last_undegraded":"2024-04-25T23:02:42.095514+0000","last_fullsized":"2024-04-25T23:02:42.095514+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":911,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180224+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:42.180224+0000","last_peered":"2024-04-25T23:02:42.180224+0000","last_clean":"2024-04-25T23:02:42.180224+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:42.180224+0000","last_undegraded":"2024-04-25T23:02:42.180224+0000","last_fullsized":"2024-04-25T23:02:42.180224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":575,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180022+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:42.180022+0000","last_peered":"2024-04-25T23:02:42.180022+0000","last_clean":"2024-04-25T23:02:42.180022+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:42.180022+0000","last_undegraded":"2024-04-25T23:02:42.180022+0000","last_fullsized":"2024-04-25T23:02:42.180022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094052+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:42.094052+0000","last_peered":"2024-04-25T23:02:42.094052+0000","last_clean":"2024-04-25T23:02:42.094052+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:42.094052+0000","last_undegraded":"2024-04-25T23:02:42.094052+0000","last_fullsized":"2024-04-25T23:02:42.094052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":551,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179685+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:42.179685+0000","last_peered":"2024-04-25T23:02:42.179685+0000","last_clean":"2024-04-25T23:02:42.179685+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:42.179685+0000","last_undegraded":"2024-04-25T23:02:42.179685+0000","last_fullsized":"2024-04-25T23:02:42.179685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179119+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:42.179119+0000","last_peered":"2024-04-25T23:02:42.179119+0000","last_clean":"2024-04-25T23:02:42.179119+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:42.179119+0000","last_undegraded":"2024-04-25T23:02:42.179119+0000","last_fullsized":"2024-04-25T23:02:42.179119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":584,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179014+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:42.179014+0000","last_peered":"2024-04-25T23:02:42.179014+0000","last_clean":"2024-04-25T23:02:42.179014+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:42.179014+0000","last_undegraded":"2024-04-25T23:02:42.179014+0000","last_fullsized":"2024-04-25T23:02:42.179014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":936,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180749+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:42.180749+0000","last_peered":"2024-04-25T23:02:42.180749+0000","last_clean":"2024-04-25T23:02:42.180749+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:42.180749+0000","last_undegraded":"2024-04-25T23:02:42.180749+0000","last_fullsized":"2024-04-25T23:02:42.180749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095256+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095256+0000","last_peered":"2024-04-25T23:02:42.095256+0000","last_clean":"2024-04-25T23:02:42.095256+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095256+0000","last_undegraded":"2024-04-25T23:02:42.095256+0000","last_fullsized":"2024-04-25T23:02:42.095256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180197+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:42.180197+0000","last_peered":"2024-04-25T23:02:42.180197+0000","last_clean":"2024-04-25T23:02:42.180197+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:42.180197+0000","last_undegraded":"2024-04-25T23:02:42.180197+0000","last_fullsized":"2024-04-25T23:02:42.180197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":524,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095344+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:42.095344+0000","last_peered":"2024-04-25T23:02:42.095344+0000","last_clean":"2024-04-25T23:02:42.095344+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:42.095344+0000","last_undegraded":"2024-04-25T23:02:42.095344+0000","last_fullsized":"2024-04-25T23:02:42.095344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":484,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.101687+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:42.101687+0000","last_peered":"2024-04-25T23:02:42.101687+0000","last_clean":"2024-04-25T23:02:42.101687+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:42.101687+0000","last_undegraded":"2024-04-25T23:02:42.101687+0000","last_fullsized":"2024-04-25T23:02:42.101687+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:29.984646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1030,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179637+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:42.179637+0000","last_peered":"2024-04-25T23:02:42.179637+0000","last_clean":"2024-04-25T23:02:42.179637+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:42.179637+0000","last_undegraded":"2024-04-25T23:02:42.179637+0000","last_fullsized":"2024-04-25T23:02:42.179637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":978,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179031+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:42.179031+0000","last_peered":"2024-04-25T23:02:42.179031+0000","last_clean":"2024-04-25T23:02:42.179031+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:42.179031+0000","last_undegraded":"2024-04-25T23:02:42.179031+0000","last_fullsized":"2024-04-25T23:02:42.179031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1064,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181872+0000","last_change":"2024-04-25T23:02:41.179727+0000","last_active":"2024-04-25T23:02:42.181872+0000","last_peered":"2024-04-25T23:02:42.181872+0000","last_clean":"2024-04-25T23:02:42.181872+0000","last_became_active":"2024-04-25T23:02:41.176566+0000","last_became_peered":"2024-04-25T23:02:41.176566+0000","last_unstale":"2024-04-25T23:02:42.181872+0000","last_undegraded":"2024-04-25T23:02:42.181872+0000","last_fullsized":"2024-04-25T23:02:42.181872+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092854+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.092854+0000","last_peered":"2024-04-25T23:02:42.092854+0000","last_clean":"2024-04-25T23:02:42.092854+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.092854+0000","last_undegraded":"2024-04-25T23:02:42.092854+0000","last_fullsized":"2024-04-25T23:02:42.092854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180702+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:42.180702+0000","last_peered":"2024-04-25T23:02:42.180702+0000","last_clean":"2024-04-25T23:02:42.180702+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:42.180702+0000","last_undegraded":"2024-04-25T23:02:42.180702+0000","last_fullsized":"2024-04-25T23:02:42.180702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":600,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180568+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:42.180568+0000","last_peered":"2024-04-25T23:02:42.180568+0000","last_clean":"2024-04-25T23:02:42.180568+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:42.180568+0000","last_undegraded":"2024-04-25T23:02:42.180568+0000","last_fullsized":"2024-04-25T23:02:42.180568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":643,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180679+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:42.180679+0000","last_peered":"2024-04-25T23:02:42.180679+0000","last_clean":"2024-04-25T23:02:42.180679+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:42.180679+0000","last_undegraded":"2024-04-25T23:02:42.180679+0000","last_fullsized":"2024-04-25T23:02:42.180679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094227+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:42.094227+0000","last_peered":"2024-04-25T23:02:42.094227+0000","last_clean":"2024-04-25T23:02:42.094227+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:42.094227+0000","last_undegraded":"2024-04-25T23:02:42.094227+0000","last_fullsized":"2024-04-25T23:02:42.094227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":581,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.178890+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:42.178890+0000","last_peered":"2024-04-25T23:02:42.178890+0000","last_clean":"2024-04-25T23:02:42.178890+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:42.178890+0000","last_undegraded":"2024-04-25T23:02:42.178890+0000","last_fullsized":"2024-04-25T23:02:42.178890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093292+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093292+0000","last_peered":"2024-04-25T23:02:42.093292+0000","last_clean":"2024-04-25T23:02:42.093292+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093292+0000","last_undegraded":"2024-04-25T23:02:42.093292+0000","last_fullsized":"2024-04-25T23:02:42.093292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095361+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:42.095361+0000","last_peered":"2024-04-25T23:02:42.095361+0000","last_clean":"2024-04-25T23:02:42.095361+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:42.095361+0000","last_undegraded":"2024-04-25T23:02:42.095361+0000","last_fullsized":"2024-04-25T23:02:42.095361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":662,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180855+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:42.180855+0000","last_peered":"2024-04-25T23:02:42.180855+0000","last_clean":"2024-04-25T23:02:42.180855+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:42.180855+0000","last_undegraded":"2024-04-25T23:02:42.180855+0000","last_fullsized":"2024-04-25T23:02:42.180855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":952,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180444+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:42.180444+0000","last_peered":"2024-04-25T23:02:42.180444+0000","last_clean":"2024-04-25T23:02:42.180444+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:42.180444+0000","last_undegraded":"2024-04-25T23:02:42.180444+0000","last_fullsized":"2024-04-25T23:02:42.180444+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":571,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095167+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095167+0000","last_peered":"2024-04-25T23:02:42.095167+0000","last_clean":"2024-04-25T23:02:42.095167+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095167+0000","last_undegraded":"2024-04-25T23:02:42.095167+0000","last_fullsized":"2024-04-25T23:02:42.095167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:37.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":949,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180379+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:42.180379+0000","last_peered":"2024-04-25T23:02:42.180379+0000","last_clean":"2024-04-25T23:02:42.180379+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:42.180379+0000","last_undegraded":"2024-04-25T23:02:42.180379+0000","last_fullsized":"2024-04-25T23:02:42.180379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":631,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093898+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:42.093898+0000","last_peered":"2024-04-25T23:02:42.093898+0000","last_clean":"2024-04-25T23:02:42.093898+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:42.093898+0000","last_undegraded":"2024-04-25T23:02:42.093898+0000","last_fullsized":"2024-04-25T23:02:42.093898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1040,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179123+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:42.179123+0000","last_peered":"2024-04-25T23:02:42.179123+0000","last_clean":"2024-04-25T23:02:42.179123+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:42.179123+0000","last_undegraded":"2024-04-25T23:02:42.179123+0000","last_fullsized":"2024-04-25T23:02:42.179123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":690,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179373+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:42.179373+0000","last_peered":"2024-04-25T23:02:42.179373+0000","last_clean":"2024-04-25T23:02:42.179373+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:42.179373+0000","last_undegraded":"2024-04-25T23:02:42.179373+0000","last_fullsized":"2024-04-25T23:02:42.179373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":651,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094571+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:42.094571+0000","last_peered":"2024-04-25T23:02:42.094571+0000","last_clean":"2024-04-25T23:02:42.094571+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:42.094571+0000","last_undegraded":"2024-04-25T23:02:42.094571+0000","last_fullsized":"2024-04-25T23:02:42.094571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":718,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181460+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:42.181460+0000","last_peered":"2024-04-25T23:02:42.181460+0000","last_clean":"2024-04-25T23:02:42.181460+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:42.181460+0000","last_undegraded":"2024-04-25T23:02:42.181460+0000","last_fullsized":"2024-04-25T23:02:42.181460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":578,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094656+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:42.094656+0000","last_peered":"2024-04-25T23:02:42.094656+0000","last_clean":"2024-04-25T23:02:42.094656+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:42.094656+0000","last_undegraded":"2024-04-25T23:02:42.094656+0000","last_fullsized":"2024-04-25T23:02:42.094656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":218,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179724+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:42.179724+0000","last_peered":"2024-04-25T23:02:42.179724+0000","last_clean":"2024-04-25T23:02:42.179724+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:42.179724+0000","last_undegraded":"2024-04-25T23:02:42.179724+0000","last_fullsized":"2024-04-25T23:02:42.179724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":670,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181624+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:42.181624+0000","last_peered":"2024-04-25T23:02:42.181624+0000","last_clean":"2024-04-25T23:02:42.181624+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:42.181624+0000","last_undegraded":"2024-04-25T23:02:42.181624+0000","last_fullsized":"2024-04-25T23:02:42.181624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093598+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093598+0000","last_peered":"2024-04-25T23:02:42.093598+0000","last_clean":"2024-04-25T23:02:42.093598+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093598+0000","last_undegraded":"2024-04-25T23:02:42.093598+0000","last_fullsized":"2024-04-25T23:02:42.093598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180991+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:42.180991+0000","last_peered":"2024-04-25T23:02:42.180991+0000","last_clean":"2024-04-25T23:02:42.180991+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:42.180991+0000","last_undegraded":"2024-04-25T23:02:42.180991+0000","last_fullsized":"2024-04-25T23:02:42.180991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179421+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:42.179421+0000","last_peered":"2024-04-25T23:02:42.179421+0000","last_clean":"2024-04-25T23:02:42.179421+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:42.179421+0000","last_undegraded":"2024-04-25T23:02:42.179421+0000","last_fullsized":"2024-04-25T23:02:42.179421+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":337,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181609+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:42.181609+0000","last_peered":"2024-04-25T23:02:42.181609+0000","last_clean":"2024-04-25T23:02:42.181609+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:42.181609+0000","last_undegraded":"2024-04-25T23:02:42.181609+0000","last_fullsized":"2024-04-25T23:02:42.181609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":627,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093710+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:42.093710+0000","last_peered":"2024-04-25T23:02:42.093710+0000","last_clean":"2024-04-25T23:02:42.093710+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:42.093710+0000","last_undegraded":"2024-04-25T23:02:42.093710+0000","last_fullsized":"2024-04-25T23:02:42.093710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":447,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094936+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.094936+0000","last_peered":"2024-04-25T23:02:42.094936+0000","last_clean":"2024-04-25T23:02:42.094936+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.094936+0000","last_undegraded":"2024-04-25T23:02:42.094936+0000","last_fullsized":"2024-04-25T23:02:42.094936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093125+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:42.093125+0000","last_peered":"2024-04-25T23:02:42.093125+0000","last_clean":"2024-04-25T23:02:42.093125+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:42.093125+0000","last_undegraded":"2024-04-25T23:02:42.093125+0000","last_fullsized":"2024-04-25T23:02:42.093125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":671,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181076+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:42.181076+0000","last_peered":"2024-04-25T23:02:42.181076+0000","last_clean":"2024-04-25T23:02:42.181076+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:42.181076+0000","last_undegraded":"2024-04-25T23:02:42.181076+0000","last_fullsized":"2024-04-25T23:02:42.181076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":616,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179993+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:42.179993+0000","last_peered":"2024-04-25T23:02:42.179993+0000","last_clean":"2024-04-25T23:02:42.179993+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:42.179993+0000","last_undegraded":"2024-04-25T23:02:42.179993+0000","last_fullsized":"2024-04-25T23:02:42.179993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":241,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181446+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:42.181446+0000","last_peered":"2024-04-25T23:02:42.181446+0000","last_clean":"2024-04-25T23:02:42.181446+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:42.181446+0000","last_undegraded":"2024-04-25T23:02:42.181446+0000","last_fullsized":"2024-04-25T23:02:42.181446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":682,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180483+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:42.180483+0000","last_peered":"2024-04-25T23:02:42.180483+0000","last_clean":"2024-04-25T23:02:42.180483+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:42.180483+0000","last_undegraded":"2024-04-25T23:02:42.180483+0000","last_fullsized":"2024-04-25T23:02:42.180483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":308,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181027+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:42.181027+0000","last_peered":"2024-04-25T23:02:42.181027+0000","last_clean":"2024-04-25T23:02:42.181027+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:42.181027+0000","last_undegraded":"2024-04-25T23:02:42.181027+0000","last_fullsized":"2024-04-25T23:02:42.181027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180897+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.180897+0000","last_peered":"2024-04-25T23:02:42.180897+0000","last_clean":"2024-04-25T23:02:42.180897+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:42.180897+0000","last_undegraded":"2024-04-25T23:02:42.180897+0000","last_fullsized":"2024-04-25T23:02:42.180897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180633+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:42.180633+0000","last_peered":"2024-04-25T23:02:42.180633+0000","last_clean":"2024-04-25T23:02:42.180633+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:42.180633+0000","last_undegraded":"2024-04-25T23:02:42.180633+0000","last_fullsized":"2024-04-25T23:02:42.180633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":986,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180790+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:42.180790+0000","last_peered":"2024-04-25T23:02:42.180790+0000","last_clean":"2024-04-25T23:02:42.180790+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:42.180790+0000","last_undegraded":"2024-04-25T23:02:42.180790+0000","last_fullsized":"2024-04-25T23:02:42.180790+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093232+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093232+0000","last_peered":"2024-04-25T23:02:42.093232+0000","last_clean":"2024-04-25T23:02:42.093232+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093232+0000","last_undegraded":"2024-04-25T23:02:42.093232+0000","last_fullsized":"2024-04-25T23:02:42.093232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":907,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180786+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:42.180786+0000","last_peered":"2024-04-25T23:02:42.180786+0000","last_clean":"2024-04-25T23:02:42.180786+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:42.180786+0000","last_undegraded":"2024-04-25T23:02:42.180786+0000","last_fullsized":"2024-04-25T23:02:42.180786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093409+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093409+0000","last_peered":"2024-04-25T23:02:42.093409+0000","last_clean":"2024-04-25T23:02:42.093409+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093409+0000","last_undegraded":"2024-04-25T23:02:42.093409+0000","last_fullsized":"2024-04-25T23:02:42.093409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":945,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181061+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:42.181061+0000","last_peered":"2024-04-25T23:02:42.181061+0000","last_clean":"2024-04-25T23:02:42.181061+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:42.181061+0000","last_undegraded":"2024-04-25T23:02:42.181061+0000","last_fullsized":"2024-04-25T23:02:42.181061+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":386,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180214+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:42.180214+0000","last_peered":"2024-04-25T23:02:42.180214+0000","last_clean":"2024-04-25T23:02:42.180214+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:42.180214+0000","last_undegraded":"2024-04-25T23:02:42.180214+0000","last_fullsized":"2024-04-25T23:02:42.180214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181741+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:42.181741+0000","last_peered":"2024-04-25T23:02:42.181741+0000","last_clean":"2024-04-25T23:02:42.181741+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:42.181741+0000","last_undegraded":"2024-04-25T23:02:42.181741+0000","last_fullsized":"2024-04-25T23:02:42.181741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":811,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179963+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:42.179963+0000","last_peered":"2024-04-25T23:02:42.179963+0000","last_clean":"2024-04-25T23:02:42.179963+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:42.179963+0000","last_undegraded":"2024-04-25T23:02:42.179963+0000","last_fullsized":"2024-04-25T23:02:42.179963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1056,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179934+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:42.179934+0000","last_peered":"2024-04-25T23:02:42.179934+0000","last_clean":"2024-04-25T23:02:42.179934+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:42.179934+0000","last_undegraded":"2024-04-25T23:02:42.179934+0000","last_fullsized":"2024-04-25T23:02:42.179934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":363,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179676+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:42.179676+0000","last_peered":"2024-04-25T23:02:42.179676+0000","last_clean":"2024-04-25T23:02:42.179676+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:42.179676+0000","last_undegraded":"2024-04-25T23:02:42.179676+0000","last_fullsized":"2024-04-25T23:02:42.179676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095534+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095534+0000","last_peered":"2024-04-25T23:02:42.095534+0000","last_clean":"2024-04-25T23:02:42.095534+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095534+0000","last_undegraded":"2024-04-25T23:02:42.095534+0000","last_fullsized":"2024-04-25T23:02:42.095534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180262+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:42.180262+0000","last_peered":"2024-04-25T23:02:42.180262+0000","last_clean":"2024-04-25T23:02:42.180262+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:42.180262+0000","last_undegraded":"2024-04-25T23:02:42.180262+0000","last_fullsized":"2024-04-25T23:02:42.180262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":497,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092926+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.092926+0000","last_peered":"2024-04-25T23:02:42.092926+0000","last_clean":"2024-04-25T23:02:42.092926+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.092926+0000","last_undegraded":"2024-04-25T23:02:42.092926+0000","last_fullsized":"2024-04-25T23:02:42.092926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":888,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181390+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:42.181390+0000","last_peered":"2024-04-25T23:02:42.181390+0000","last_clean":"2024-04-25T23:02:42.181390+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:42.181390+0000","last_undegraded":"2024-04-25T23:02:42.181390+0000","last_fullsized":"2024-04-25T23:02:42.181390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180650+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:42.180650+0000","last_peered":"2024-04-25T23:02:42.180650+0000","last_clean":"2024-04-25T23:02:42.180650+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:42.180650+0000","last_undegraded":"2024-04-25T23:02:42.180650+0000","last_fullsized":"2024-04-25T23:02:42.180650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181465+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:42.181465+0000","last_peered":"2024-04-25T23:02:42.181465+0000","last_clean":"2024-04-25T23:02:42.181465+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:42.181465+0000","last_undegraded":"2024-04-25T23:02:42.181465+0000","last_fullsized":"2024-04-25T23:02:42.181465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":933,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181262+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:42.181262+0000","last_peered":"2024-04-25T23:02:42.181262+0000","last_clean":"2024-04-25T23:02:42.181262+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:42.181262+0000","last_undegraded":"2024-04-25T23:02:42.181262+0000","last_fullsized":"2024-04-25T23:02:42.181262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":450,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181371+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:42.181371+0000","last_peered":"2024-04-25T23:02:42.181371+0000","last_clean":"2024-04-25T23:02:42.181371+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:42.181371+0000","last_undegraded":"2024-04-25T23:02:42.181371+0000","last_fullsized":"2024-04-25T23:02:42.181371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181052+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:42.181052+0000","last_peered":"2024-04-25T23:02:42.181052+0000","last_clean":"2024-04-25T23:02:42.181052+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:42.181052+0000","last_undegraded":"2024-04-25T23:02:42.181052+0000","last_fullsized":"2024-04-25T23:02:42.181052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":513,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094054+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:42.094054+0000","last_peered":"2024-04-25T23:02:42.094054+0000","last_clean":"2024-04-25T23:02:42.094054+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:42.094054+0000","last_undegraded":"2024-04-25T23:02:42.094054+0000","last_fullsized":"2024-04-25T23:02:42.094054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":227,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180770+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:42.180770+0000","last_peered":"2024-04-25T23:02:42.180770+0000","last_clean":"2024-04-25T23:02:42.180770+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:42.180770+0000","last_undegraded":"2024-04-25T23:02:42.180770+0000","last_fullsized":"2024-04-25T23:02:42.180770+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095610+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095610+0000","last_peered":"2024-04-25T23:02:42.095610+0000","last_clean":"2024-04-25T23:02:42.095610+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095610+0000","last_undegraded":"2024-04-25T23:02:42.095610+0000","last_fullsized":"2024-04-25T23:02:42.095610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093609+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:42.093609+0000","last_peered":"2024-04-25T23:02:42.093609+0000","last_clean":"2024-04-25T23:02:42.093609+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:42.093609+0000","last_undegraded":"2024-04-25T23:02:42.093609+0000","last_fullsized":"2024-04-25T23:02:42.093609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":238,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181863+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:42.181863+0000","last_peered":"2024-04-25T23:02:42.181863+0000","last_clean":"2024-04-25T23:02:42.181863+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:42.181863+0000","last_undegraded":"2024-04-25T23:02:42.181863+0000","last_fullsized":"2024-04-25T23:02:42.181863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181900+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:42.181900+0000","last_peered":"2024-04-25T23:02:42.181900+0000","last_clean":"2024-04-25T23:02:42.181900+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:42.181900+0000","last_undegraded":"2024-04-25T23:02:42.181900+0000","last_fullsized":"2024-04-25T23:02:42.181900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":573,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179307+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:42.179307+0000","last_peered":"2024-04-25T23:02:42.179307+0000","last_clean":"2024-04-25T23:02:42.179307+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:42.179307+0000","last_undegraded":"2024-04-25T23:02:42.179307+0000","last_fullsized":"2024-04-25T23:02:42.179307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":277,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181694+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:42.181694+0000","last_peered":"2024-04-25T23:02:42.181694+0000","last_clean":"2024-04-25T23:02:42.181694+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:42.181694+0000","last_undegraded":"2024-04-25T23:02:42.181694+0000","last_fullsized":"2024-04-25T23:02:42.181694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181671+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:42.181671+0000","last_peered":"2024-04-25T23:02:42.181671+0000","last_clean":"2024-04-25T23:02:42.181671+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:42.181671+0000","last_undegraded":"2024-04-25T23:02:42.181671+0000","last_fullsized":"2024-04-25T23:02:42.181671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093896+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:42.093896+0000","last_peered":"2024-04-25T23:02:42.093896+0000","last_clean":"2024-04-25T23:02:42.093896+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:42.093896+0000","last_undegraded":"2024-04-25T23:02:42.093896+0000","last_fullsized":"2024-04-25T23:02:42.093896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1004,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180129+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:42.180129+0000","last_peered":"2024-04-25T23:02:42.180129+0000","last_clean":"2024-04-25T23:02:42.180129+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:42.180129+0000","last_undegraded":"2024-04-25T23:02:42.180129+0000","last_fullsized":"2024-04-25T23:02:42.180129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181167+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:42.181167+0000","last_peered":"2024-04-25T23:02:42.181167+0000","last_clean":"2024-04-25T23:02:42.181167+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:42.181167+0000","last_undegraded":"2024-04-25T23:02:42.181167+0000","last_fullsized":"2024-04-25T23:02:42.181167+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":996,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179445+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:42.179445+0000","last_peered":"2024-04-25T23:02:42.179445+0000","last_clean":"2024-04-25T23:02:42.179445+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:42.179445+0000","last_undegraded":"2024-04-25T23:02:42.179445+0000","last_fullsized":"2024-04-25T23:02:42.179445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094958+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.094958+0000","last_peered":"2024-04-25T23:02:42.094958+0000","last_clean":"2024-04-25T23:02:42.094958+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.094958+0000","last_undegraded":"2024-04-25T23:02:42.094958+0000","last_fullsized":"2024-04-25T23:02:42.094958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181287+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:42.181287+0000","last_peered":"2024-04-25T23:02:42.181287+0000","last_clean":"2024-04-25T23:02:42.181287+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:42.181287+0000","last_undegraded":"2024-04-25T23:02:42.181287+0000","last_fullsized":"2024-04-25T23:02:42.181287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":676,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179182+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:42.179182+0000","last_peered":"2024-04-25T23:02:42.179182+0000","last_clean":"2024-04-25T23:02:42.179182+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:42.179182+0000","last_undegraded":"2024-04-25T23:02:42.179182+0000","last_fullsized":"2024-04-25T23:02:42.179182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":235,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181681+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:42.181681+0000","last_peered":"2024-04-25T23:02:42.181681+0000","last_clean":"2024-04-25T23:02:42.181681+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:42.181681+0000","last_undegraded":"2024-04-25T23:02:42.181681+0000","last_fullsized":"2024-04-25T23:02:42.181681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1041,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179154+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:42.179154+0000","last_peered":"2024-04-25T23:02:42.179154+0000","last_clean":"2024-04-25T23:02:42.179154+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:42.179154+0000","last_undegraded":"2024-04-25T23:02:42.179154+0000","last_fullsized":"2024-04-25T23:02:42.179154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":503,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096211+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:42.096211+0000","last_peered":"2024-04-25T23:02:42.096211+0000","last_clean":"2024-04-25T23:02:42.096211+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:42.096211+0000","last_undegraded":"2024-04-25T23:02:42.096211+0000","last_fullsized":"2024-04-25T23:02:42.096211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":755,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180096+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:42.180096+0000","last_peered":"2024-04-25T23:02:42.180096+0000","last_clean":"2024-04-25T23:02:42.180096+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:42.180096+0000","last_undegraded":"2024-04-25T23:02:42.180096+0000","last_fullsized":"2024-04-25T23:02:42.180096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":637,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180742+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:42.180742+0000","last_peered":"2024-04-25T23:02:42.180742+0000","last_clean":"2024-04-25T23:02:42.180742+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:42.180742+0000","last_undegraded":"2024-04-25T23:02:42.180742+0000","last_fullsized":"2024-04-25T23:02:42.180742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179716+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:42.179716+0000","last_peered":"2024-04-25T23:02:42.179716+0000","last_clean":"2024-04-25T23:02:42.179716+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:42.179716+0000","last_undegraded":"2024-04-25T23:02:42.179716+0000","last_fullsized":"2024-04-25T23:02:42.179716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094896+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.094896+0000","last_peered":"2024-04-25T23:02:42.094896+0000","last_clean":"2024-04-25T23:02:42.094896+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.094896+0000","last_undegraded":"2024-04-25T23:02:42.094896+0000","last_fullsized":"2024-04-25T23:02:42.094896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093622+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093622+0000","last_peered":"2024-04-25T23:02:42.093622+0000","last_clean":"2024-04-25T23:02:42.093622+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093622+0000","last_undegraded":"2024-04-25T23:02:42.093622+0000","last_fullsized":"2024-04-25T23:02:42.093622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094850+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:42.094850+0000","last_peered":"2024-04-25T23:02:42.094850+0000","last_clean":"2024-04-25T23:02:42.094850+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:42.094850+0000","last_undegraded":"2024-04-25T23:02:42.094850+0000","last_fullsized":"2024-04-25T23:02:42.094850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093911+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.093911+0000","last_peered":"2024-04-25T23:02:42.093911+0000","last_clean":"2024-04-25T23:02:42.093911+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.093911+0000","last_undegraded":"2024-04-25T23:02:42.093911+0000","last_fullsized":"2024-04-25T23:02:42.093911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":596,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181100+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:42.181100+0000","last_peered":"2024-04-25T23:02:42.181100+0000","last_clean":"2024-04-25T23:02:42.181100+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:42.181100+0000","last_undegraded":"2024-04-25T23:02:42.181100+0000","last_fullsized":"2024-04-25T23:02:42.181100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":658,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180308+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:42.180308+0000","last_peered":"2024-04-25T23:02:42.180308+0000","last_clean":"2024-04-25T23:02:42.180308+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:42.180308+0000","last_undegraded":"2024-04-25T23:02:42.180308+0000","last_fullsized":"2024-04-25T23:02:42.180308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":444,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094599+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094599+0000","last_peered":"2024-04-25T23:02:42.094599+0000","last_clean":"2024-04-25T23:02:42.094599+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094599+0000","last_undegraded":"2024-04-25T23:02:42.094599+0000","last_fullsized":"2024-04-25T23:02:42.094599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093692+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:42.093692+0000","last_peered":"2024-04-25T23:02:42.093692+0000","last_clean":"2024-04-25T23:02:42.093692+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:42.093692+0000","last_undegraded":"2024-04-25T23:02:42.093692+0000","last_fullsized":"2024-04-25T23:02:42.093692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":242,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":657,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179641+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:42.179641+0000","last_peered":"2024-04-25T23:02:42.179641+0000","last_clean":"2024-04-25T23:02:42.179641+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:42.179641+0000","last_undegraded":"2024-04-25T23:02:42.179641+0000","last_fullsized":"2024-04-25T23:02:42.179641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":287,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181484+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:42.181484+0000","last_peered":"2024-04-25T23:02:42.181484+0000","last_clean":"2024-04-25T23:02:42.181484+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:42.181484+0000","last_undegraded":"2024-04-25T23:02:42.181484+0000","last_fullsized":"2024-04-25T23:02:42.181484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142136,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229704,"statfs":{"total":96636764160,"available":96491216896,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738420,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177884,"kb_used_data":80140,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193956,"statfs":{"total":96636764160,"available":96454610944,"internally_reserved":0,"allocated":82063360,"data_stored":81566497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179024,"kb_used_data":89600,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192816,"statfs":{"total":96636764160,"available":96453443584,"internally_reserved":0,"allocated":91750400,"data_stored":91229381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:49.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:49.943 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:49.945 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:49.962 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-04-25T23:02:48.598320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":499044,"kb_used_data":253808,"kb_used_omap":8,"kb_used_meta":245175,"kb_avail":282616476,"statfs":{"total":289910292480,"available":289399271424,"internally_reserved":0,"allocated":259899392,"data_stored":258365132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":251059221},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002599"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096437+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:42.096437+0000","last_peered":"2024-04-25T23:02:42.096437+0000","last_clean":"2024-04-25T23:02:42.096437+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:42.096437+0000","last_undegraded":"2024-04-25T23:02:42.096437+0000","last_fullsized":"2024-04-25T23:02:42.096437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.770809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":601,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095514+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095514+0000","last_peered":"2024-04-25T23:02:42.095514+0000","last_clean":"2024-04-25T23:02:42.095514+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095514+0000","last_undegraded":"2024-04-25T23:02:42.095514+0000","last_fullsized":"2024-04-25T23:02:42.095514+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":911,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180224+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:42.180224+0000","last_peered":"2024-04-25T23:02:42.180224+0000","last_clean":"2024-04-25T23:02:42.180224+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:42.180224+0000","last_undegraded":"2024-04-25T23:02:42.180224+0000","last_fullsized":"2024-04-25T23:02:42.180224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":575,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180022+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:42.180022+0000","last_peered":"2024-04-25T23:02:42.180022+0000","last_clean":"2024-04-25T23:02:42.180022+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:42.180022+0000","last_undegraded":"2024-04-25T23:02:42.180022+0000","last_fullsized":"2024-04-25T23:02:42.180022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094052+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:42.094052+0000","last_peered":"2024-04-25T23:02:42.094052+0000","last_clean":"2024-04-25T23:02:42.094052+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:42.094052+0000","last_undegraded":"2024-04-25T23:02:42.094052+0000","last_fullsized":"2024-04-25T23:02:42.094052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":551,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179685+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:42.179685+0000","last_peered":"2024-04-25T23:02:42.179685+0000","last_clean":"2024-04-25T23:02:42.179685+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:42.179685+0000","last_undegraded":"2024-04-25T23:02:42.179685+0000","last_fullsized":"2024-04-25T23:02:42.179685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179119+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:42.179119+0000","last_peered":"2024-04-25T23:02:42.179119+0000","last_clean":"2024-04-25T23:02:42.179119+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:42.179119+0000","last_undegraded":"2024-04-25T23:02:42.179119+0000","last_fullsized":"2024-04-25T23:02:42.179119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":584,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179014+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:42.179014+0000","last_peered":"2024-04-25T23:02:42.179014+0000","last_clean":"2024-04-25T23:02:42.179014+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:42.179014+0000","last_undegraded":"2024-04-25T23:02:42.179014+0000","last_fullsized":"2024-04-25T23:02:42.179014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":936,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180749+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:42.180749+0000","last_peered":"2024-04-25T23:02:42.180749+0000","last_clean":"2024-04-25T23:02:42.180749+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:42.180749+0000","last_undegraded":"2024-04-25T23:02:42.180749+0000","last_fullsized":"2024-04-25T23:02:42.180749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095256+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095256+0000","last_peered":"2024-04-25T23:02:42.095256+0000","last_clean":"2024-04-25T23:02:42.095256+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095256+0000","last_undegraded":"2024-04-25T23:02:42.095256+0000","last_fullsized":"2024-04-25T23:02:42.095256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180197+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:42.180197+0000","last_peered":"2024-04-25T23:02:42.180197+0000","last_clean":"2024-04-25T23:02:42.180197+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:42.180197+0000","last_undegraded":"2024-04-25T23:02:42.180197+0000","last_fullsized":"2024-04-25T23:02:42.180197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":524,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095344+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:42.095344+0000","last_peered":"2024-04-25T23:02:42.095344+0000","last_clean":"2024-04-25T23:02:42.095344+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:42.095344+0000","last_undegraded":"2024-04-25T23:02:42.095344+0000","last_fullsized":"2024-04-25T23:02:42.095344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":484,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.101687+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:42.101687+0000","last_peered":"2024-04-25T23:02:42.101687+0000","last_clean":"2024-04-25T23:02:42.101687+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:42.101687+0000","last_undegraded":"2024-04-25T23:02:42.101687+0000","last_fullsized":"2024-04-25T23:02:42.101687+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:29.984646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1030,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179637+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:42.179637+0000","last_peered":"2024-04-25T23:02:42.179637+0000","last_clean":"2024-04-25T23:02:42.179637+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:42.179637+0000","last_undegraded":"2024-04-25T23:02:42.179637+0000","last_fullsized":"2024-04-25T23:02:42.179637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":978,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179031+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:42.179031+0000","last_peered":"2024-04-25T23:02:42.179031+0000","last_clean":"2024-04-25T23:02:42.179031+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:42.179031+0000","last_undegraded":"2024-04-25T23:02:42.179031+0000","last_fullsized":"2024-04-25T23:02:42.179031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1064,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181872+0000","last_change":"2024-04-25T23:02:41.179727+0000","last_active":"2024-04-25T23:02:42.181872+0000","last_peered":"2024-04-25T23:02:42.181872+0000","last_clean":"2024-04-25T23:02:42.181872+0000","last_became_active":"2024-04-25T23:02:41.176566+0000","last_became_peered":"2024-04-25T23:02:41.176566+0000","last_unstale":"2024-04-25T23:02:42.181872+0000","last_undegraded":"2024-04-25T23:02:42.181872+0000","last_fullsized":"2024-04-25T23:02:42.181872+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092854+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.092854+0000","last_peered":"2024-04-25T23:02:42.092854+0000","last_clean":"2024-04-25T23:02:42.092854+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.092854+0000","last_undegraded":"2024-04-25T23:02:42.092854+0000","last_fullsized":"2024-04-25T23:02:42.092854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180702+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:42.180702+0000","last_peered":"2024-04-25T23:02:42.180702+0000","last_clean":"2024-04-25T23:02:42.180702+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:42.180702+0000","last_undegraded":"2024-04-25T23:02:42.180702+0000","last_fullsized":"2024-04-25T23:02:42.180702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":600,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180568+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:42.180568+0000","last_peered":"2024-04-25T23:02:42.180568+0000","last_clean":"2024-04-25T23:02:42.180568+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:42.180568+0000","last_undegraded":"2024-04-25T23:02:42.180568+0000","last_fullsized":"2024-04-25T23:02:42.180568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":643,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180679+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:42.180679+0000","last_peered":"2024-04-25T23:02:42.180679+0000","last_clean":"2024-04-25T23:02:42.180679+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:42.180679+0000","last_undegraded":"2024-04-25T23:02:42.180679+0000","last_fullsized":"2024-04-25T23:02:42.180679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094227+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:42.094227+0000","last_peered":"2024-04-25T23:02:42.094227+0000","last_clean":"2024-04-25T23:02:42.094227+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:42.094227+0000","last_undegraded":"2024-04-25T23:02:42.094227+0000","last_fullsized":"2024-04-25T23:02:42.094227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":581,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.178890+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:42.178890+0000","last_peered":"2024-04-25T23:02:42.178890+0000","last_clean":"2024-04-25T23:02:42.178890+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:42.178890+0000","last_undegraded":"2024-04-25T23:02:42.178890+0000","last_fullsized":"2024-04-25T23:02:42.178890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093292+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093292+0000","last_peered":"2024-04-25T23:02:42.093292+0000","last_clean":"2024-04-25T23:02:42.093292+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093292+0000","last_undegraded":"2024-04-25T23:02:42.093292+0000","last_fullsized":"2024-04-25T23:02:42.093292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095361+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:42.095361+0000","last_peered":"2024-04-25T23:02:42.095361+0000","last_clean":"2024-04-25T23:02:42.095361+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:42.095361+0000","last_undegraded":"2024-04-25T23:02:42.095361+0000","last_fullsized":"2024-04-25T23:02:42.095361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":662,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180855+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:42.180855+0000","last_peered":"2024-04-25T23:02:42.180855+0000","last_clean":"2024-04-25T23:02:42.180855+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:42.180855+0000","last_undegraded":"2024-04-25T23:02:42.180855+0000","last_fullsized":"2024-04-25T23:02:42.180855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":952,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180444+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:42.180444+0000","last_peered":"2024-04-25T23:02:42.180444+0000","last_clean":"2024-04-25T23:02:42.180444+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:42.180444+0000","last_undegraded":"2024-04-25T23:02:42.180444+0000","last_fullsized":"2024-04-25T23:02:42.180444+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":571,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095167+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095167+0000","last_peered":"2024-04-25T23:02:42.095167+0000","last_clean":"2024-04-25T23:02:42.095167+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095167+0000","last_undegraded":"2024-04-25T23:02:42.095167+0000","last_fullsized":"2024-04-25T23:02:42.095167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:37.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":949,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180379+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:42.180379+0000","last_peered":"2024-04-25T23:02:42.180379+0000","last_clean":"2024-04-25T23:02:42.180379+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:42.180379+0000","last_undegraded":"2024-04-25T23:02:42.180379+0000","last_fullsized":"2024-04-25T23:02:42.180379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":631,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093898+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:42.093898+0000","last_peered":"2024-04-25T23:02:42.093898+0000","last_clean":"2024-04-25T23:02:42.093898+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:42.093898+0000","last_undegraded":"2024-04-25T23:02:42.093898+0000","last_fullsized":"2024-04-25T23:02:42.093898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1040,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179123+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:42.179123+0000","last_peered":"2024-04-25T23:02:42.179123+0000","last_clean":"2024-04-25T23:02:42.179123+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:42.179123+0000","last_undegraded":"2024-04-25T23:02:42.179123+0000","last_fullsized":"2024-04-25T23:02:42.179123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":690,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179373+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:42.179373+0000","last_peered":"2024-04-25T23:02:42.179373+0000","last_clean":"2024-04-25T23:02:42.179373+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:42.179373+0000","last_undegraded":"2024-04-25T23:02:42.179373+0000","last_fullsized":"2024-04-25T23:02:42.179373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":651,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094571+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:42.094571+0000","last_peered":"2024-04-25T23:02:42.094571+0000","last_clean":"2024-04-25T23:02:42.094571+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:42.094571+0000","last_undegraded":"2024-04-25T23:02:42.094571+0000","last_fullsized":"2024-04-25T23:02:42.094571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":718,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181460+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:42.181460+0000","last_peered":"2024-04-25T23:02:42.181460+0000","last_clean":"2024-04-25T23:02:42.181460+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:42.181460+0000","last_undegraded":"2024-04-25T23:02:42.181460+0000","last_fullsized":"2024-04-25T23:02:42.181460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":578,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094656+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:42.094656+0000","last_peered":"2024-04-25T23:02:42.094656+0000","last_clean":"2024-04-25T23:02:42.094656+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:42.094656+0000","last_undegraded":"2024-04-25T23:02:42.094656+0000","last_fullsized":"2024-04-25T23:02:42.094656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":218,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179724+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:42.179724+0000","last_peered":"2024-04-25T23:02:42.179724+0000","last_clean":"2024-04-25T23:02:42.179724+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:42.179724+0000","last_undegraded":"2024-04-25T23:02:42.179724+0000","last_fullsized":"2024-04-25T23:02:42.179724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":670,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181624+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:42.181624+0000","last_peered":"2024-04-25T23:02:42.181624+0000","last_clean":"2024-04-25T23:02:42.181624+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:42.181624+0000","last_undegraded":"2024-04-25T23:02:42.181624+0000","last_fullsized":"2024-04-25T23:02:42.181624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093598+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093598+0000","last_peered":"2024-04-25T23:02:42.093598+0000","last_clean":"2024-04-25T23:02:42.093598+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093598+0000","last_undegraded":"2024-04-25T23:02:42.093598+0000","last_fullsized":"2024-04-25T23:02:42.093598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180991+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:42.180991+0000","last_peered":"2024-04-25T23:02:42.180991+0000","last_clean":"2024-04-25T23:02:42.180991+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:42.180991+0000","last_undegraded":"2024-04-25T23:02:42.180991+0000","last_fullsized":"2024-04-25T23:02:42.180991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179421+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:42.179421+0000","last_peered":"2024-04-25T23:02:42.179421+0000","last_clean":"2024-04-25T23:02:42.179421+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:42.179421+0000","last_undegraded":"2024-04-25T23:02:42.179421+0000","last_fullsized":"2024-04-25T23:02:42.179421+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":337,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181609+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:42.181609+0000","last_peered":"2024-04-25T23:02:42.181609+0000","last_clean":"2024-04-25T23:02:42.181609+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:42.181609+0000","last_undegraded":"2024-04-25T23:02:42.181609+0000","last_fullsized":"2024-04-25T23:02:42.181609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":627,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093710+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:42.093710+0000","last_peered":"2024-04-25T23:02:42.093710+0000","last_clean":"2024-04-25T23:02:42.093710+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:42.093710+0000","last_undegraded":"2024-04-25T23:02:42.093710+0000","last_fullsized":"2024-04-25T23:02:42.093710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":447,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094936+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.094936+0000","last_peered":"2024-04-25T23:02:42.094936+0000","last_clean":"2024-04-25T23:02:42.094936+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.094936+0000","last_undegraded":"2024-04-25T23:02:42.094936+0000","last_fullsized":"2024-04-25T23:02:42.094936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093125+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:42.093125+0000","last_peered":"2024-04-25T23:02:42.093125+0000","last_clean":"2024-04-25T23:02:42.093125+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:42.093125+0000","last_undegraded":"2024-04-25T23:02:42.093125+0000","last_fullsized":"2024-04-25T23:02:42.093125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":671,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181076+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:42.181076+0000","last_peered":"2024-04-25T23:02:42.181076+0000","last_clean":"2024-04-25T23:02:42.181076+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:42.181076+0000","last_undegraded":"2024-04-25T23:02:42.181076+0000","last_fullsized":"2024-04-25T23:02:42.181076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":616,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179993+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:42.179993+0000","last_peered":"2024-04-25T23:02:42.179993+0000","last_clean":"2024-04-25T23:02:42.179993+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:42.179993+0000","last_undegraded":"2024-04-25T23:02:42.179993+0000","last_fullsized":"2024-04-25T23:02:42.179993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":241,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181446+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:42.181446+0000","last_peered":"2024-04-25T23:02:42.181446+0000","last_clean":"2024-04-25T23:02:42.181446+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:42.181446+0000","last_undegraded":"2024-04-25T23:02:42.181446+0000","last_fullsized":"2024-04-25T23:02:42.181446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":682,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180483+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:42.180483+0000","last_peered":"2024-04-25T23:02:42.180483+0000","last_clean":"2024-04-25T23:02:42.180483+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:42.180483+0000","last_undegraded":"2024-04-25T23:02:42.180483+0000","last_fullsized":"2024-04-25T23:02:42.180483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":308,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181027+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:42.181027+0000","last_peered":"2024-04-25T23:02:42.181027+0000","last_clean":"2024-04-25T23:02:42.181027+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:42.181027+0000","last_undegraded":"2024-04-25T23:02:42.181027+0000","last_fullsized":"2024-04-25T23:02:42.181027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180897+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.180897+0000","last_peered":"2024-04-25T23:02:42.180897+0000","last_clean":"2024-04-25T23:02:42.180897+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:42.180897+0000","last_undegraded":"2024-04-25T23:02:42.180897+0000","last_fullsized":"2024-04-25T23:02:42.180897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180633+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:42.180633+0000","last_peered":"2024-04-25T23:02:42.180633+0000","last_clean":"2024-04-25T23:02:42.180633+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:42.180633+0000","last_undegraded":"2024-04-25T23:02:42.180633+0000","last_fullsized":"2024-04-25T23:02:42.180633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":986,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180790+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:42.180790+0000","last_peered":"2024-04-25T23:02:42.180790+0000","last_clean":"2024-04-25T23:02:42.180790+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:42.180790+0000","last_undegraded":"2024-04-25T23:02:42.180790+0000","last_fullsized":"2024-04-25T23:02:42.180790+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093232+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093232+0000","last_peered":"2024-04-25T23:02:42.093232+0000","last_clean":"2024-04-25T23:02:42.093232+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093232+0000","last_undegraded":"2024-04-25T23:02:42.093232+0000","last_fullsized":"2024-04-25T23:02:42.093232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":907,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180786+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:42.180786+0000","last_peered":"2024-04-25T23:02:42.180786+0000","last_clean":"2024-04-25T23:02:42.180786+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:42.180786+0000","last_undegraded":"2024-04-25T23:02:42.180786+0000","last_fullsized":"2024-04-25T23:02:42.180786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093409+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093409+0000","last_peered":"2024-04-25T23:02:42.093409+0000","last_clean":"2024-04-25T23:02:42.093409+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093409+0000","last_undegraded":"2024-04-25T23:02:42.093409+0000","last_fullsized":"2024-04-25T23:02:42.093409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":945,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181061+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:42.181061+0000","last_peered":"2024-04-25T23:02:42.181061+0000","last_clean":"2024-04-25T23:02:42.181061+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:42.181061+0000","last_undegraded":"2024-04-25T23:02:42.181061+0000","last_fullsized":"2024-04-25T23:02:42.181061+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":386,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180214+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:42.180214+0000","last_peered":"2024-04-25T23:02:42.180214+0000","last_clean":"2024-04-25T23:02:42.180214+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:42.180214+0000","last_undegraded":"2024-04-25T23:02:42.180214+0000","last_fullsized":"2024-04-25T23:02:42.180214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181741+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:42.181741+0000","last_peered":"2024-04-25T23:02:42.181741+0000","last_clean":"2024-04-25T23:02:42.181741+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:42.181741+0000","last_undegraded":"2024-04-25T23:02:42.181741+0000","last_fullsized":"2024-04-25T23:02:42.181741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":811,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179963+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:42.179963+0000","last_peered":"2024-04-25T23:02:42.179963+0000","last_clean":"2024-04-25T23:02:42.179963+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:42.179963+0000","last_undegraded":"2024-04-25T23:02:42.179963+0000","last_fullsized":"2024-04-25T23:02:42.179963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1056,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179934+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:42.179934+0000","last_peered":"2024-04-25T23:02:42.179934+0000","last_clean":"2024-04-25T23:02:42.179934+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:42.179934+0000","last_undegraded":"2024-04-25T23:02:42.179934+0000","last_fullsized":"2024-04-25T23:02:42.179934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":363,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179676+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:42.179676+0000","last_peered":"2024-04-25T23:02:42.179676+0000","last_clean":"2024-04-25T23:02:42.179676+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:42.179676+0000","last_undegraded":"2024-04-25T23:02:42.179676+0000","last_fullsized":"2024-04-25T23:02:42.179676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095534+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095534+0000","last_peered":"2024-04-25T23:02:42.095534+0000","last_clean":"2024-04-25T23:02:42.095534+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095534+0000","last_undegraded":"2024-04-25T23:02:42.095534+0000","last_fullsized":"2024-04-25T23:02:42.095534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180262+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:42.180262+0000","last_peered":"2024-04-25T23:02:42.180262+0000","last_clean":"2024-04-25T23:02:42.180262+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:42.180262+0000","last_undegraded":"2024-04-25T23:02:42.180262+0000","last_fullsized":"2024-04-25T23:02:42.180262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":497,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092926+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.092926+0000","last_peered":"2024-04-25T23:02:42.092926+0000","last_clean":"2024-04-25T23:02:42.092926+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.092926+0000","last_undegraded":"2024-04-25T23:02:42.092926+0000","last_fullsized":"2024-04-25T23:02:42.092926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":888,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181390+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:42.181390+0000","last_peered":"2024-04-25T23:02:42.181390+0000","last_clean":"2024-04-25T23:02:42.181390+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:42.181390+0000","last_undegraded":"2024-04-25T23:02:42.181390+0000","last_fullsized":"2024-04-25T23:02:42.181390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180650+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:42.180650+0000","last_peered":"2024-04-25T23:02:42.180650+0000","last_clean":"2024-04-25T23:02:42.180650+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:42.180650+0000","last_undegraded":"2024-04-25T23:02:42.180650+0000","last_fullsized":"2024-04-25T23:02:42.180650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181465+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:42.181465+0000","last_peered":"2024-04-25T23:02:42.181465+0000","last_clean":"2024-04-25T23:02:42.181465+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:42.181465+0000","last_undegraded":"2024-04-25T23:02:42.181465+0000","last_fullsized":"2024-04-25T23:02:42.181465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":933,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181262+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:42.181262+0000","last_peered":"2024-04-25T23:02:42.181262+0000","last_clean":"2024-04-25T23:02:42.181262+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:42.181262+0000","last_undegraded":"2024-04-25T23:02:42.181262+0000","last_fullsized":"2024-04-25T23:02:42.181262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":450,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181371+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:42.181371+0000","last_peered":"2024-04-25T23:02:42.181371+0000","last_clean":"2024-04-25T23:02:42.181371+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:42.181371+0000","last_undegraded":"2024-04-25T23:02:42.181371+0000","last_fullsized":"2024-04-25T23:02:42.181371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181052+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:42.181052+0000","last_peered":"2024-04-25T23:02:42.181052+0000","last_clean":"2024-04-25T23:02:42.181052+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:42.181052+0000","last_undegraded":"2024-04-25T23:02:42.181052+0000","last_fullsized":"2024-04-25T23:02:42.181052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":513,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094054+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:42.094054+0000","last_peered":"2024-04-25T23:02:42.094054+0000","last_clean":"2024-04-25T23:02:42.094054+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:42.094054+0000","last_undegraded":"2024-04-25T23:02:42.094054+0000","last_fullsized":"2024-04-25T23:02:42.094054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":227,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180770+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:42.180770+0000","last_peered":"2024-04-25T23:02:42.180770+0000","last_clean":"2024-04-25T23:02:42.180770+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:42.180770+0000","last_undegraded":"2024-04-25T23:02:42.180770+0000","last_fullsized":"2024-04-25T23:02:42.180770+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095610+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095610+0000","last_peered":"2024-04-25T23:02:42.095610+0000","last_clean":"2024-04-25T23:02:42.095610+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095610+0000","last_undegraded":"2024-04-25T23:02:42.095610+0000","last_fullsized":"2024-04-25T23:02:42.095610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093609+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:42.093609+0000","last_peered":"2024-04-25T23:02:42.093609+0000","last_clean":"2024-04-25T23:02:42.093609+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:42.093609+0000","last_undegraded":"2024-04-25T23:02:42.093609+0000","last_fullsized":"2024-04-25T23:02:42.093609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":238,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181863+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:42.181863+0000","last_peered":"2024-04-25T23:02:42.181863+0000","last_clean":"2024-04-25T23:02:42.181863+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:42.181863+0000","last_undegraded":"2024-04-25T23:02:42.181863+0000","last_fullsized":"2024-04-25T23:02:42.181863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181900+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:42.181900+0000","last_peered":"2024-04-25T23:02:42.181900+0000","last_clean":"2024-04-25T23:02:42.181900+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:42.181900+0000","last_undegraded":"2024-04-25T23:02:42.181900+0000","last_fullsized":"2024-04-25T23:02:42.181900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":573,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179307+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:42.179307+0000","last_peered":"2024-04-25T23:02:42.179307+0000","last_clean":"2024-04-25T23:02:42.179307+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:42.179307+0000","last_undegraded":"2024-04-25T23:02:42.179307+0000","last_fullsized":"2024-04-25T23:02:42.179307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":277,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181694+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:42.181694+0000","last_peered":"2024-04-25T23:02:42.181694+0000","last_clean":"2024-04-25T23:02:42.181694+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:42.181694+0000","last_undegraded":"2024-04-25T23:02:42.181694+0000","last_fullsized":"2024-04-25T23:02:42.181694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181671+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:42.181671+0000","last_peered":"2024-04-25T23:02:42.181671+0000","last_clean":"2024-04-25T23:02:42.181671+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:42.181671+0000","last_undegraded":"2024-04-25T23:02:42.181671+0000","last_fullsized":"2024-04-25T23:02:42.181671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093896+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:42.093896+0000","last_peered":"2024-04-25T23:02:42.093896+0000","last_clean":"2024-04-25T23:02:42.093896+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:42.093896+0000","last_undegraded":"2024-04-25T23:02:42.093896+0000","last_fullsized":"2024-04-25T23:02:42.093896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1004,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180129+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:42.180129+0000","last_peered":"2024-04-25T23:02:42.180129+0000","last_clean":"2024-04-25T23:02:42.180129+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:42.180129+0000","last_undegraded":"2024-04-25T23:02:42.180129+0000","last_fullsized":"2024-04-25T23:02:42.180129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181167+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:42.181167+0000","last_peered":"2024-04-25T23:02:42.181167+0000","last_clean":"2024-04-25T23:02:42.181167+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:42.181167+0000","last_undegraded":"2024-04-25T23:02:42.181167+0000","last_fullsized":"2024-04-25T23:02:42.181167+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":996,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179445+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:42.179445+0000","last_peered":"2024-04-25T23:02:42.179445+0000","last_clean":"2024-04-25T23:02:42.179445+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:42.179445+0000","last_undegraded":"2024-04-25T23:02:42.179445+0000","last_fullsized":"2024-04-25T23:02:42.179445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094958+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.094958+0000","last_peered":"2024-04-25T23:02:42.094958+0000","last_clean":"2024-04-25T23:02:42.094958+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.094958+0000","last_undegraded":"2024-04-25T23:02:42.094958+0000","last_fullsized":"2024-04-25T23:02:42.094958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181287+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:42.181287+0000","last_peered":"2024-04-25T23:02:42.181287+0000","last_clean":"2024-04-25T23:02:42.181287+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:42.181287+0000","last_undegraded":"2024-04-25T23:02:42.181287+0000","last_fullsized":"2024-04-25T23:02:42.181287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":676,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179182+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:42.179182+0000","last_peered":"2024-04-25T23:02:42.179182+0000","last_clean":"2024-04-25T23:02:42.179182+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:42.179182+0000","last_undegraded":"2024-04-25T23:02:42.179182+0000","last_fullsized":"2024-04-25T23:02:42.179182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":235,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181681+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:42.181681+0000","last_peered":"2024-04-25T23:02:42.181681+0000","last_clean":"2024-04-25T23:02:42.181681+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:42.181681+0000","last_undegraded":"2024-04-25T23:02:42.181681+0000","last_fullsized":"2024-04-25T23:02:42.181681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1041,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179154+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:42.179154+0000","last_peered":"2024-04-25T23:02:42.179154+0000","last_clean":"2024-04-25T23:02:42.179154+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:42.179154+0000","last_undegraded":"2024-04-25T23:02:42.179154+0000","last_fullsized":"2024-04-25T23:02:42.179154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":503,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096211+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:42.096211+0000","last_peered":"2024-04-25T23:02:42.096211+0000","last_clean":"2024-04-25T23:02:42.096211+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:42.096211+0000","last_undegraded":"2024-04-25T23:02:42.096211+0000","last_fullsized":"2024-04-25T23:02:42.096211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":755,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180096+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:42.180096+0000","last_peered":"2024-04-25T23:02:42.180096+0000","last_clean":"2024-04-25T23:02:42.180096+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:42.180096+0000","last_undegraded":"2024-04-25T23:02:42.180096+0000","last_fullsized":"2024-04-25T23:02:42.180096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":637,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180742+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:42.180742+0000","last_peered":"2024-04-25T23:02:42.180742+0000","last_clean":"2024-04-25T23:02:42.180742+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:42.180742+0000","last_undegraded":"2024-04-25T23:02:42.180742+0000","last_fullsized":"2024-04-25T23:02:42.180742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179716+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:42.179716+0000","last_peered":"2024-04-25T23:02:42.179716+0000","last_clean":"2024-04-25T23:02:42.179716+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:42.179716+0000","last_undegraded":"2024-04-25T23:02:42.179716+0000","last_fullsized":"2024-04-25T23:02:42.179716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094896+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.094896+0000","last_peered":"2024-04-25T23:02:42.094896+0000","last_clean":"2024-04-25T23:02:42.094896+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.094896+0000","last_undegraded":"2024-04-25T23:02:42.094896+0000","last_fullsized":"2024-04-25T23:02:42.094896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093622+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093622+0000","last_peered":"2024-04-25T23:02:42.093622+0000","last_clean":"2024-04-25T23:02:42.093622+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093622+0000","last_undegraded":"2024-04-25T23:02:42.093622+0000","last_fullsized":"2024-04-25T23:02:42.093622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094850+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:42.094850+0000","last_peered":"2024-04-25T23:02:42.094850+0000","last_clean":"2024-04-25T23:02:42.094850+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:42.094850+0000","last_undegraded":"2024-04-25T23:02:42.094850+0000","last_fullsized":"2024-04-25T23:02:42.094850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093911+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.093911+0000","last_peered":"2024-04-25T23:02:42.093911+0000","last_clean":"2024-04-25T23:02:42.093911+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.093911+0000","last_undegraded":"2024-04-25T23:02:42.093911+0000","last_fullsized":"2024-04-25T23:02:42.093911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":596,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181100+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:42.181100+0000","last_peered":"2024-04-25T23:02:42.181100+0000","last_clean":"2024-04-25T23:02:42.181100+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:42.181100+0000","last_undegraded":"2024-04-25T23:02:42.181100+0000","last_fullsized":"2024-04-25T23:02:42.181100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":658,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180308+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:42.180308+0000","last_peered":"2024-04-25T23:02:42.180308+0000","last_clean":"2024-04-25T23:02:42.180308+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:42.180308+0000","last_undegraded":"2024-04-25T23:02:42.180308+0000","last_fullsized":"2024-04-25T23:02:42.180308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":444,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094599+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094599+0000","last_peered":"2024-04-25T23:02:42.094599+0000","last_clean":"2024-04-25T23:02:42.094599+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094599+0000","last_undegraded":"2024-04-25T23:02:42.094599+0000","last_fullsized":"2024-04-25T23:02:42.094599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093692+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:42.093692+0000","last_peered":"2024-04-25T23:02:42.093692+0000","last_clean":"2024-04-25T23:02:42.093692+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:42.093692+0000","last_undegraded":"2024-04-25T23:02:42.093692+0000","last_fullsized":"2024-04-25T23:02:42.093692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":242,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":657,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179641+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:42.179641+0000","last_peered":"2024-04-25T23:02:42.179641+0000","last_clean":"2024-04-25T23:02:42.179641+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:42.179641+0000","last_undegraded":"2024-04-25T23:02:42.179641+0000","last_fullsized":"2024-04-25T23:02:42.179641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":287,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181484+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:42.181484+0000","last_peered":"2024-04-25T23:02:42.181484+0000","last_clean":"2024-04-25T23:02:42.181484+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:42.181484+0000","last_undegraded":"2024-04-25T23:02:42.181484+0000","last_fullsized":"2024-04-25T23:02:42.181484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142136,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229704,"statfs":{"total":96636764160,"available":96491216896,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738420,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177884,"kb_used_data":80140,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193956,"statfs":{"total":96636764160,"available":96454610944,"internally_reserved":0,"allocated":82063360,"data_stored":81566497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179024,"kb_used_data":89600,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192816,"statfs":{"total":96636764160,"available":96453443584,"internally_reserved":0,"allocated":91750400,"data_stored":91229381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:49.966 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T23:02:49.966 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:50.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:50.306 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:50.323 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-04-25T23:02:48.598320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":499044,"kb_used_data":253808,"kb_used_omap":8,"kb_used_meta":245175,"kb_avail":282616476,"statfs":{"total":289910292480,"available":289399271424,"internally_reserved":0,"allocated":259899392,"data_stored":258365132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":251059221},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1227,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002599"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096437+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:42.096437+0000","last_peered":"2024-04-25T23:02:42.096437+0000","last_clean":"2024-04-25T23:02:42.096437+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:42.096437+0000","last_undegraded":"2024-04-25T23:02:42.096437+0000","last_fullsized":"2024-04-25T23:02:42.096437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.770809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":601,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095514+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095514+0000","last_peered":"2024-04-25T23:02:42.095514+0000","last_clean":"2024-04-25T23:02:42.095514+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095514+0000","last_undegraded":"2024-04-25T23:02:42.095514+0000","last_fullsized":"2024-04-25T23:02:42.095514+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":911,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180224+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:42.180224+0000","last_peered":"2024-04-25T23:02:42.180224+0000","last_clean":"2024-04-25T23:02:42.180224+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:42.180224+0000","last_undegraded":"2024-04-25T23:02:42.180224+0000","last_fullsized":"2024-04-25T23:02:42.180224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":575,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180022+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:42.180022+0000","last_peered":"2024-04-25T23:02:42.180022+0000","last_clean":"2024-04-25T23:02:42.180022+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:42.180022+0000","last_undegraded":"2024-04-25T23:02:42.180022+0000","last_fullsized":"2024-04-25T23:02:42.180022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094052+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:42.094052+0000","last_peered":"2024-04-25T23:02:42.094052+0000","last_clean":"2024-04-25T23:02:42.094052+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:42.094052+0000","last_undegraded":"2024-04-25T23:02:42.094052+0000","last_fullsized":"2024-04-25T23:02:42.094052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":551,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179685+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:42.179685+0000","last_peered":"2024-04-25T23:02:42.179685+0000","last_clean":"2024-04-25T23:02:42.179685+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:42.179685+0000","last_undegraded":"2024-04-25T23:02:42.179685+0000","last_fullsized":"2024-04-25T23:02:42.179685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179119+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:42.179119+0000","last_peered":"2024-04-25T23:02:42.179119+0000","last_clean":"2024-04-25T23:02:42.179119+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:42.179119+0000","last_undegraded":"2024-04-25T23:02:42.179119+0000","last_fullsized":"2024-04-25T23:02:42.179119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":584,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179014+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:42.179014+0000","last_peered":"2024-04-25T23:02:42.179014+0000","last_clean":"2024-04-25T23:02:42.179014+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:42.179014+0000","last_undegraded":"2024-04-25T23:02:42.179014+0000","last_fullsized":"2024-04-25T23:02:42.179014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":936,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180749+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:42.180749+0000","last_peered":"2024-04-25T23:02:42.180749+0000","last_clean":"2024-04-25T23:02:42.180749+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:42.180749+0000","last_undegraded":"2024-04-25T23:02:42.180749+0000","last_fullsized":"2024-04-25T23:02:42.180749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095256+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095256+0000","last_peered":"2024-04-25T23:02:42.095256+0000","last_clean":"2024-04-25T23:02:42.095256+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095256+0000","last_undegraded":"2024-04-25T23:02:42.095256+0000","last_fullsized":"2024-04-25T23:02:42.095256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180197+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:42.180197+0000","last_peered":"2024-04-25T23:02:42.180197+0000","last_clean":"2024-04-25T23:02:42.180197+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:42.180197+0000","last_undegraded":"2024-04-25T23:02:42.180197+0000","last_fullsized":"2024-04-25T23:02:42.180197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":524,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095344+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:42.095344+0000","last_peered":"2024-04-25T23:02:42.095344+0000","last_clean":"2024-04-25T23:02:42.095344+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:42.095344+0000","last_undegraded":"2024-04-25T23:02:42.095344+0000","last_fullsized":"2024-04-25T23:02:42.095344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":484,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.101687+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:42.101687+0000","last_peered":"2024-04-25T23:02:42.101687+0000","last_clean":"2024-04-25T23:02:42.101687+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:42.101687+0000","last_undegraded":"2024-04-25T23:02:42.101687+0000","last_fullsized":"2024-04-25T23:02:42.101687+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:29.984646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1030,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179637+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:42.179637+0000","last_peered":"2024-04-25T23:02:42.179637+0000","last_clean":"2024-04-25T23:02:42.179637+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:42.179637+0000","last_undegraded":"2024-04-25T23:02:42.179637+0000","last_fullsized":"2024-04-25T23:02:42.179637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":978,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179031+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:42.179031+0000","last_peered":"2024-04-25T23:02:42.179031+0000","last_clean":"2024-04-25T23:02:42.179031+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:42.179031+0000","last_undegraded":"2024-04-25T23:02:42.179031+0000","last_fullsized":"2024-04-25T23:02:42.179031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1064,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181872+0000","last_change":"2024-04-25T23:02:41.179727+0000","last_active":"2024-04-25T23:02:42.181872+0000","last_peered":"2024-04-25T23:02:42.181872+0000","last_clean":"2024-04-25T23:02:42.181872+0000","last_became_active":"2024-04-25T23:02:41.176566+0000","last_became_peered":"2024-04-25T23:02:41.176566+0000","last_unstale":"2024-04-25T23:02:42.181872+0000","last_undegraded":"2024-04-25T23:02:42.181872+0000","last_fullsized":"2024-04-25T23:02:42.181872+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092854+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.092854+0000","last_peered":"2024-04-25T23:02:42.092854+0000","last_clean":"2024-04-25T23:02:42.092854+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.092854+0000","last_undegraded":"2024-04-25T23:02:42.092854+0000","last_fullsized":"2024-04-25T23:02:42.092854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180702+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:42.180702+0000","last_peered":"2024-04-25T23:02:42.180702+0000","last_clean":"2024-04-25T23:02:42.180702+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:42.180702+0000","last_undegraded":"2024-04-25T23:02:42.180702+0000","last_fullsized":"2024-04-25T23:02:42.180702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":600,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180568+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:42.180568+0000","last_peered":"2024-04-25T23:02:42.180568+0000","last_clean":"2024-04-25T23:02:42.180568+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:42.180568+0000","last_undegraded":"2024-04-25T23:02:42.180568+0000","last_fullsized":"2024-04-25T23:02:42.180568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":643,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180679+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:42.180679+0000","last_peered":"2024-04-25T23:02:42.180679+0000","last_clean":"2024-04-25T23:02:42.180679+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:42.180679+0000","last_undegraded":"2024-04-25T23:02:42.180679+0000","last_fullsized":"2024-04-25T23:02:42.180679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094227+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:42.094227+0000","last_peered":"2024-04-25T23:02:42.094227+0000","last_clean":"2024-04-25T23:02:42.094227+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:42.094227+0000","last_undegraded":"2024-04-25T23:02:42.094227+0000","last_fullsized":"2024-04-25T23:02:42.094227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":581,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.178890+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:42.178890+0000","last_peered":"2024-04-25T23:02:42.178890+0000","last_clean":"2024-04-25T23:02:42.178890+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:42.178890+0000","last_undegraded":"2024-04-25T23:02:42.178890+0000","last_fullsized":"2024-04-25T23:02:42.178890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093292+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093292+0000","last_peered":"2024-04-25T23:02:42.093292+0000","last_clean":"2024-04-25T23:02:42.093292+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093292+0000","last_undegraded":"2024-04-25T23:02:42.093292+0000","last_fullsized":"2024-04-25T23:02:42.093292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095361+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:42.095361+0000","last_peered":"2024-04-25T23:02:42.095361+0000","last_clean":"2024-04-25T23:02:42.095361+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:42.095361+0000","last_undegraded":"2024-04-25T23:02:42.095361+0000","last_fullsized":"2024-04-25T23:02:42.095361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":662,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180855+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:42.180855+0000","last_peered":"2024-04-25T23:02:42.180855+0000","last_clean":"2024-04-25T23:02:42.180855+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:42.180855+0000","last_undegraded":"2024-04-25T23:02:42.180855+0000","last_fullsized":"2024-04-25T23:02:42.180855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":952,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180444+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:42.180444+0000","last_peered":"2024-04-25T23:02:42.180444+0000","last_clean":"2024-04-25T23:02:42.180444+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:42.180444+0000","last_undegraded":"2024-04-25T23:02:42.180444+0000","last_fullsized":"2024-04-25T23:02:42.180444+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":571,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095167+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095167+0000","last_peered":"2024-04-25T23:02:42.095167+0000","last_clean":"2024-04-25T23:02:42.095167+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095167+0000","last_undegraded":"2024-04-25T23:02:42.095167+0000","last_fullsized":"2024-04-25T23:02:42.095167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:37.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":949,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180379+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:42.180379+0000","last_peered":"2024-04-25T23:02:42.180379+0000","last_clean":"2024-04-25T23:02:42.180379+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:42.180379+0000","last_undegraded":"2024-04-25T23:02:42.180379+0000","last_fullsized":"2024-04-25T23:02:42.180379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":631,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093898+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:42.093898+0000","last_peered":"2024-04-25T23:02:42.093898+0000","last_clean":"2024-04-25T23:02:42.093898+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:42.093898+0000","last_undegraded":"2024-04-25T23:02:42.093898+0000","last_fullsized":"2024-04-25T23:02:42.093898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1040,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179123+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:42.179123+0000","last_peered":"2024-04-25T23:02:42.179123+0000","last_clean":"2024-04-25T23:02:42.179123+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:42.179123+0000","last_undegraded":"2024-04-25T23:02:42.179123+0000","last_fullsized":"2024-04-25T23:02:42.179123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":690,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179373+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:42.179373+0000","last_peered":"2024-04-25T23:02:42.179373+0000","last_clean":"2024-04-25T23:02:42.179373+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:42.179373+0000","last_undegraded":"2024-04-25T23:02:42.179373+0000","last_fullsized":"2024-04-25T23:02:42.179373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":651,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094571+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:42.094571+0000","last_peered":"2024-04-25T23:02:42.094571+0000","last_clean":"2024-04-25T23:02:42.094571+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:42.094571+0000","last_undegraded":"2024-04-25T23:02:42.094571+0000","last_fullsized":"2024-04-25T23:02:42.094571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":718,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181460+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:42.181460+0000","last_peered":"2024-04-25T23:02:42.181460+0000","last_clean":"2024-04-25T23:02:42.181460+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:42.181460+0000","last_undegraded":"2024-04-25T23:02:42.181460+0000","last_fullsized":"2024-04-25T23:02:42.181460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":578,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094656+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:42.094656+0000","last_peered":"2024-04-25T23:02:42.094656+0000","last_clean":"2024-04-25T23:02:42.094656+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:42.094656+0000","last_undegraded":"2024-04-25T23:02:42.094656+0000","last_fullsized":"2024-04-25T23:02:42.094656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":218,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179724+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:42.179724+0000","last_peered":"2024-04-25T23:02:42.179724+0000","last_clean":"2024-04-25T23:02:42.179724+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:42.179724+0000","last_undegraded":"2024-04-25T23:02:42.179724+0000","last_fullsized":"2024-04-25T23:02:42.179724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":670,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181624+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:42.181624+0000","last_peered":"2024-04-25T23:02:42.181624+0000","last_clean":"2024-04-25T23:02:42.181624+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:42.181624+0000","last_undegraded":"2024-04-25T23:02:42.181624+0000","last_fullsized":"2024-04-25T23:02:42.181624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093598+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093598+0000","last_peered":"2024-04-25T23:02:42.093598+0000","last_clean":"2024-04-25T23:02:42.093598+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093598+0000","last_undegraded":"2024-04-25T23:02:42.093598+0000","last_fullsized":"2024-04-25T23:02:42.093598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180991+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:42.180991+0000","last_peered":"2024-04-25T23:02:42.180991+0000","last_clean":"2024-04-25T23:02:42.180991+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:42.180991+0000","last_undegraded":"2024-04-25T23:02:42.180991+0000","last_fullsized":"2024-04-25T23:02:42.180991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179421+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:42.179421+0000","last_peered":"2024-04-25T23:02:42.179421+0000","last_clean":"2024-04-25T23:02:42.179421+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:42.179421+0000","last_undegraded":"2024-04-25T23:02:42.179421+0000","last_fullsized":"2024-04-25T23:02:42.179421+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":337,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181609+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:42.181609+0000","last_peered":"2024-04-25T23:02:42.181609+0000","last_clean":"2024-04-25T23:02:42.181609+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:42.181609+0000","last_undegraded":"2024-04-25T23:02:42.181609+0000","last_fullsized":"2024-04-25T23:02:42.181609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":627,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093710+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:42.093710+0000","last_peered":"2024-04-25T23:02:42.093710+0000","last_clean":"2024-04-25T23:02:42.093710+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:42.093710+0000","last_undegraded":"2024-04-25T23:02:42.093710+0000","last_fullsized":"2024-04-25T23:02:42.093710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":447,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094936+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.094936+0000","last_peered":"2024-04-25T23:02:42.094936+0000","last_clean":"2024-04-25T23:02:42.094936+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.094936+0000","last_undegraded":"2024-04-25T23:02:42.094936+0000","last_fullsized":"2024-04-25T23:02:42.094936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093125+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:42.093125+0000","last_peered":"2024-04-25T23:02:42.093125+0000","last_clean":"2024-04-25T23:02:42.093125+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:42.093125+0000","last_undegraded":"2024-04-25T23:02:42.093125+0000","last_fullsized":"2024-04-25T23:02:42.093125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":671,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181076+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:42.181076+0000","last_peered":"2024-04-25T23:02:42.181076+0000","last_clean":"2024-04-25T23:02:42.181076+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:42.181076+0000","last_undegraded":"2024-04-25T23:02:42.181076+0000","last_fullsized":"2024-04-25T23:02:42.181076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":616,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179993+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:42.179993+0000","last_peered":"2024-04-25T23:02:42.179993+0000","last_clean":"2024-04-25T23:02:42.179993+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:42.179993+0000","last_undegraded":"2024-04-25T23:02:42.179993+0000","last_fullsized":"2024-04-25T23:02:42.179993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":241,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181446+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:42.181446+0000","last_peered":"2024-04-25T23:02:42.181446+0000","last_clean":"2024-04-25T23:02:42.181446+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:42.181446+0000","last_undegraded":"2024-04-25T23:02:42.181446+0000","last_fullsized":"2024-04-25T23:02:42.181446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":682,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180483+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:42.180483+0000","last_peered":"2024-04-25T23:02:42.180483+0000","last_clean":"2024-04-25T23:02:42.180483+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:42.180483+0000","last_undegraded":"2024-04-25T23:02:42.180483+0000","last_fullsized":"2024-04-25T23:02:42.180483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":308,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181027+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:42.181027+0000","last_peered":"2024-04-25T23:02:42.181027+0000","last_clean":"2024-04-25T23:02:42.181027+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:42.181027+0000","last_undegraded":"2024-04-25T23:02:42.181027+0000","last_fullsized":"2024-04-25T23:02:42.181027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180897+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.180897+0000","last_peered":"2024-04-25T23:02:42.180897+0000","last_clean":"2024-04-25T23:02:42.180897+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:42.180897+0000","last_undegraded":"2024-04-25T23:02:42.180897+0000","last_fullsized":"2024-04-25T23:02:42.180897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180633+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:42.180633+0000","last_peered":"2024-04-25T23:02:42.180633+0000","last_clean":"2024-04-25T23:02:42.180633+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:42.180633+0000","last_undegraded":"2024-04-25T23:02:42.180633+0000","last_fullsized":"2024-04-25T23:02:42.180633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":986,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180790+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:42.180790+0000","last_peered":"2024-04-25T23:02:42.180790+0000","last_clean":"2024-04-25T23:02:42.180790+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:42.180790+0000","last_undegraded":"2024-04-25T23:02:42.180790+0000","last_fullsized":"2024-04-25T23:02:42.180790+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093232+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093232+0000","last_peered":"2024-04-25T23:02:42.093232+0000","last_clean":"2024-04-25T23:02:42.093232+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093232+0000","last_undegraded":"2024-04-25T23:02:42.093232+0000","last_fullsized":"2024-04-25T23:02:42.093232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":907,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180786+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:42.180786+0000","last_peered":"2024-04-25T23:02:42.180786+0000","last_clean":"2024-04-25T23:02:42.180786+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:42.180786+0000","last_undegraded":"2024-04-25T23:02:42.180786+0000","last_fullsized":"2024-04-25T23:02:42.180786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093409+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093409+0000","last_peered":"2024-04-25T23:02:42.093409+0000","last_clean":"2024-04-25T23:02:42.093409+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093409+0000","last_undegraded":"2024-04-25T23:02:42.093409+0000","last_fullsized":"2024-04-25T23:02:42.093409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":945,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181061+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:42.181061+0000","last_peered":"2024-04-25T23:02:42.181061+0000","last_clean":"2024-04-25T23:02:42.181061+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:42.181061+0000","last_undegraded":"2024-04-25T23:02:42.181061+0000","last_fullsized":"2024-04-25T23:02:42.181061+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":386,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180214+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:42.180214+0000","last_peered":"2024-04-25T23:02:42.180214+0000","last_clean":"2024-04-25T23:02:42.180214+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:42.180214+0000","last_undegraded":"2024-04-25T23:02:42.180214+0000","last_fullsized":"2024-04-25T23:02:42.180214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181741+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:42.181741+0000","last_peered":"2024-04-25T23:02:42.181741+0000","last_clean":"2024-04-25T23:02:42.181741+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:42.181741+0000","last_undegraded":"2024-04-25T23:02:42.181741+0000","last_fullsized":"2024-04-25T23:02:42.181741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":811,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179963+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:42.179963+0000","last_peered":"2024-04-25T23:02:42.179963+0000","last_clean":"2024-04-25T23:02:42.179963+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:42.179963+0000","last_undegraded":"2024-04-25T23:02:42.179963+0000","last_fullsized":"2024-04-25T23:02:42.179963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1056,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179934+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:42.179934+0000","last_peered":"2024-04-25T23:02:42.179934+0000","last_clean":"2024-04-25T23:02:42.179934+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:42.179934+0000","last_undegraded":"2024-04-25T23:02:42.179934+0000","last_fullsized":"2024-04-25T23:02:42.179934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":363,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179676+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:42.179676+0000","last_peered":"2024-04-25T23:02:42.179676+0000","last_clean":"2024-04-25T23:02:42.179676+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:42.179676+0000","last_undegraded":"2024-04-25T23:02:42.179676+0000","last_fullsized":"2024-04-25T23:02:42.179676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095534+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095534+0000","last_peered":"2024-04-25T23:02:42.095534+0000","last_clean":"2024-04-25T23:02:42.095534+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095534+0000","last_undegraded":"2024-04-25T23:02:42.095534+0000","last_fullsized":"2024-04-25T23:02:42.095534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180262+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:42.180262+0000","last_peered":"2024-04-25T23:02:42.180262+0000","last_clean":"2024-04-25T23:02:42.180262+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:42.180262+0000","last_undegraded":"2024-04-25T23:02:42.180262+0000","last_fullsized":"2024-04-25T23:02:42.180262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":497,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092926+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.092926+0000","last_peered":"2024-04-25T23:02:42.092926+0000","last_clean":"2024-04-25T23:02:42.092926+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.092926+0000","last_undegraded":"2024-04-25T23:02:42.092926+0000","last_fullsized":"2024-04-25T23:02:42.092926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":888,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181390+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:42.181390+0000","last_peered":"2024-04-25T23:02:42.181390+0000","last_clean":"2024-04-25T23:02:42.181390+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:42.181390+0000","last_undegraded":"2024-04-25T23:02:42.181390+0000","last_fullsized":"2024-04-25T23:02:42.181390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180650+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:42.180650+0000","last_peered":"2024-04-25T23:02:42.180650+0000","last_clean":"2024-04-25T23:02:42.180650+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:42.180650+0000","last_undegraded":"2024-04-25T23:02:42.180650+0000","last_fullsized":"2024-04-25T23:02:42.180650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181465+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:42.181465+0000","last_peered":"2024-04-25T23:02:42.181465+0000","last_clean":"2024-04-25T23:02:42.181465+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:42.181465+0000","last_undegraded":"2024-04-25T23:02:42.181465+0000","last_fullsized":"2024-04-25T23:02:42.181465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":933,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181262+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:42.181262+0000","last_peered":"2024-04-25T23:02:42.181262+0000","last_clean":"2024-04-25T23:02:42.181262+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:42.181262+0000","last_undegraded":"2024-04-25T23:02:42.181262+0000","last_fullsized":"2024-04-25T23:02:42.181262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":450,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181371+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:42.181371+0000","last_peered":"2024-04-25T23:02:42.181371+0000","last_clean":"2024-04-25T23:02:42.181371+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:42.181371+0000","last_undegraded":"2024-04-25T23:02:42.181371+0000","last_fullsized":"2024-04-25T23:02:42.181371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181052+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:42.181052+0000","last_peered":"2024-04-25T23:02:42.181052+0000","last_clean":"2024-04-25T23:02:42.181052+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:42.181052+0000","last_undegraded":"2024-04-25T23:02:42.181052+0000","last_fullsized":"2024-04-25T23:02:42.181052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":513,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094054+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:42.094054+0000","last_peered":"2024-04-25T23:02:42.094054+0000","last_clean":"2024-04-25T23:02:42.094054+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:42.094054+0000","last_undegraded":"2024-04-25T23:02:42.094054+0000","last_fullsized":"2024-04-25T23:02:42.094054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":227,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180770+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:42.180770+0000","last_peered":"2024-04-25T23:02:42.180770+0000","last_clean":"2024-04-25T23:02:42.180770+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:42.180770+0000","last_undegraded":"2024-04-25T23:02:42.180770+0000","last_fullsized":"2024-04-25T23:02:42.180770+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095610+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095610+0000","last_peered":"2024-04-25T23:02:42.095610+0000","last_clean":"2024-04-25T23:02:42.095610+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095610+0000","last_undegraded":"2024-04-25T23:02:42.095610+0000","last_fullsized":"2024-04-25T23:02:42.095610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093609+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:42.093609+0000","last_peered":"2024-04-25T23:02:42.093609+0000","last_clean":"2024-04-25T23:02:42.093609+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:42.093609+0000","last_undegraded":"2024-04-25T23:02:42.093609+0000","last_fullsized":"2024-04-25T23:02:42.093609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":238,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181863+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:42.181863+0000","last_peered":"2024-04-25T23:02:42.181863+0000","last_clean":"2024-04-25T23:02:42.181863+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:42.181863+0000","last_undegraded":"2024-04-25T23:02:42.181863+0000","last_fullsized":"2024-04-25T23:02:42.181863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181900+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:42.181900+0000","last_peered":"2024-04-25T23:02:42.181900+0000","last_clean":"2024-04-25T23:02:42.181900+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:42.181900+0000","last_undegraded":"2024-04-25T23:02:42.181900+0000","last_fullsized":"2024-04-25T23:02:42.181900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":573,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179307+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:42.179307+0000","last_peered":"2024-04-25T23:02:42.179307+0000","last_clean":"2024-04-25T23:02:42.179307+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:42.179307+0000","last_undegraded":"2024-04-25T23:02:42.179307+0000","last_fullsized":"2024-04-25T23:02:42.179307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":277,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181694+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:42.181694+0000","last_peered":"2024-04-25T23:02:42.181694+0000","last_clean":"2024-04-25T23:02:42.181694+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:42.181694+0000","last_undegraded":"2024-04-25T23:02:42.181694+0000","last_fullsized":"2024-04-25T23:02:42.181694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181671+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:42.181671+0000","last_peered":"2024-04-25T23:02:42.181671+0000","last_clean":"2024-04-25T23:02:42.181671+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:42.181671+0000","last_undegraded":"2024-04-25T23:02:42.181671+0000","last_fullsized":"2024-04-25T23:02:42.181671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093896+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:42.093896+0000","last_peered":"2024-04-25T23:02:42.093896+0000","last_clean":"2024-04-25T23:02:42.093896+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:42.093896+0000","last_undegraded":"2024-04-25T23:02:42.093896+0000","last_fullsized":"2024-04-25T23:02:42.093896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1004,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180129+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:42.180129+0000","last_peered":"2024-04-25T23:02:42.180129+0000","last_clean":"2024-04-25T23:02:42.180129+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:42.180129+0000","last_undegraded":"2024-04-25T23:02:42.180129+0000","last_fullsized":"2024-04-25T23:02:42.180129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181167+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:42.181167+0000","last_peered":"2024-04-25T23:02:42.181167+0000","last_clean":"2024-04-25T23:02:42.181167+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:42.181167+0000","last_undegraded":"2024-04-25T23:02:42.181167+0000","last_fullsized":"2024-04-25T23:02:42.181167+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":996,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179445+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:42.179445+0000","last_peered":"2024-04-25T23:02:42.179445+0000","last_clean":"2024-04-25T23:02:42.179445+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:42.179445+0000","last_undegraded":"2024-04-25T23:02:42.179445+0000","last_fullsized":"2024-04-25T23:02:42.179445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094958+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.094958+0000","last_peered":"2024-04-25T23:02:42.094958+0000","last_clean":"2024-04-25T23:02:42.094958+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.094958+0000","last_undegraded":"2024-04-25T23:02:42.094958+0000","last_fullsized":"2024-04-25T23:02:42.094958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181287+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:42.181287+0000","last_peered":"2024-04-25T23:02:42.181287+0000","last_clean":"2024-04-25T23:02:42.181287+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:42.181287+0000","last_undegraded":"2024-04-25T23:02:42.181287+0000","last_fullsized":"2024-04-25T23:02:42.181287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":676,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179182+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:42.179182+0000","last_peered":"2024-04-25T23:02:42.179182+0000","last_clean":"2024-04-25T23:02:42.179182+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:42.179182+0000","last_undegraded":"2024-04-25T23:02:42.179182+0000","last_fullsized":"2024-04-25T23:02:42.179182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":235,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181681+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:42.181681+0000","last_peered":"2024-04-25T23:02:42.181681+0000","last_clean":"2024-04-25T23:02:42.181681+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:42.181681+0000","last_undegraded":"2024-04-25T23:02:42.181681+0000","last_fullsized":"2024-04-25T23:02:42.181681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1041,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179154+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:42.179154+0000","last_peered":"2024-04-25T23:02:42.179154+0000","last_clean":"2024-04-25T23:02:42.179154+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:42.179154+0000","last_undegraded":"2024-04-25T23:02:42.179154+0000","last_fullsized":"2024-04-25T23:02:42.179154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":503,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096211+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:42.096211+0000","last_peered":"2024-04-25T23:02:42.096211+0000","last_clean":"2024-04-25T23:02:42.096211+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:42.096211+0000","last_undegraded":"2024-04-25T23:02:42.096211+0000","last_fullsized":"2024-04-25T23:02:42.096211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":755,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180096+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:42.180096+0000","last_peered":"2024-04-25T23:02:42.180096+0000","last_clean":"2024-04-25T23:02:42.180096+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:42.180096+0000","last_undegraded":"2024-04-25T23:02:42.180096+0000","last_fullsized":"2024-04-25T23:02:42.180096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":637,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180742+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:42.180742+0000","last_peered":"2024-04-25T23:02:42.180742+0000","last_clean":"2024-04-25T23:02:42.180742+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:42.180742+0000","last_undegraded":"2024-04-25T23:02:42.180742+0000","last_fullsized":"2024-04-25T23:02:42.180742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179716+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:42.179716+0000","last_peered":"2024-04-25T23:02:42.179716+0000","last_clean":"2024-04-25T23:02:42.179716+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:42.179716+0000","last_undegraded":"2024-04-25T23:02:42.179716+0000","last_fullsized":"2024-04-25T23:02:42.179716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094896+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.094896+0000","last_peered":"2024-04-25T23:02:42.094896+0000","last_clean":"2024-04-25T23:02:42.094896+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.094896+0000","last_undegraded":"2024-04-25T23:02:42.094896+0000","last_fullsized":"2024-04-25T23:02:42.094896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093622+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093622+0000","last_peered":"2024-04-25T23:02:42.093622+0000","last_clean":"2024-04-25T23:02:42.093622+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093622+0000","last_undegraded":"2024-04-25T23:02:42.093622+0000","last_fullsized":"2024-04-25T23:02:42.093622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094850+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:42.094850+0000","last_peered":"2024-04-25T23:02:42.094850+0000","last_clean":"2024-04-25T23:02:42.094850+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:42.094850+0000","last_undegraded":"2024-04-25T23:02:42.094850+0000","last_fullsized":"2024-04-25T23:02:42.094850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093911+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.093911+0000","last_peered":"2024-04-25T23:02:42.093911+0000","last_clean":"2024-04-25T23:02:42.093911+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.093911+0000","last_undegraded":"2024-04-25T23:02:42.093911+0000","last_fullsized":"2024-04-25T23:02:42.093911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":596,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181100+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:42.181100+0000","last_peered":"2024-04-25T23:02:42.181100+0000","last_clean":"2024-04-25T23:02:42.181100+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:42.181100+0000","last_undegraded":"2024-04-25T23:02:42.181100+0000","last_fullsized":"2024-04-25T23:02:42.181100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":658,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180308+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:42.180308+0000","last_peered":"2024-04-25T23:02:42.180308+0000","last_clean":"2024-04-25T23:02:42.180308+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:42.180308+0000","last_undegraded":"2024-04-25T23:02:42.180308+0000","last_fullsized":"2024-04-25T23:02:42.180308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":444,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094599+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094599+0000","last_peered":"2024-04-25T23:02:42.094599+0000","last_clean":"2024-04-25T23:02:42.094599+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094599+0000","last_undegraded":"2024-04-25T23:02:42.094599+0000","last_fullsized":"2024-04-25T23:02:42.094599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093692+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:42.093692+0000","last_peered":"2024-04-25T23:02:42.093692+0000","last_clean":"2024-04-25T23:02:42.093692+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:42.093692+0000","last_undegraded":"2024-04-25T23:02:42.093692+0000","last_fullsized":"2024-04-25T23:02:42.093692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":242,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":657,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179641+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:42.179641+0000","last_peered":"2024-04-25T23:02:42.179641+0000","last_clean":"2024-04-25T23:02:42.179641+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:42.179641+0000","last_undegraded":"2024-04-25T23:02:42.179641+0000","last_fullsized":"2024-04-25T23:02:42.179641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":287,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181484+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:42.181484+0000","last_peered":"2024-04-25T23:02:42.181484+0000","last_clean":"2024-04-25T23:02:42.181484+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:42.181484+0000","last_undegraded":"2024-04-25T23:02:42.181484+0000","last_fullsized":"2024-04-25T23:02:42.181484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142136,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229704,"statfs":{"total":96636764160,"available":96491216896,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738420,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177884,"kb_used_data":80140,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193956,"statfs":{"total":96636764160,"available":96454610944,"internally_reserved":0,"allocated":82063360,"data_stored":81566497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179024,"kb_used_data":89600,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192816,"statfs":{"total":96636764160,"available":96453443584,"internally_reserved":0,"allocated":91750400,"data_stored":91229381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:50.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:02:50.666 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:50.666 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":97,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T23:02:42.171953+0000","last_up_change":"2024-04-25T23:02:14.651926+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":21,"up_from":69,"up_thru":96,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6801","nonce":805033024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6803","nonce":805033024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6807","nonce":805033024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6805","nonce":805033024}]},"public_addr":"172.21.15.172:6801/805033024","cluster_addr":"172.21.15.172:6803/805033024","heartbeat_back_addr":"172.21.15.172:6807/805033024","heartbeat_front_addr":"172.21.15.172:6805/805033024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":21}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:02:51.686 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T23:02:51.687 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T23:02:51.850 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T23:02:51.850 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T23:02:51.850 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T23:02:51.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T23:02:52.150 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T23:02:52.168 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T23:02:52.169 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T23:02:52.323 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T23:02:52.323 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T23:02:52.323 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T23:02:52.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T23:02:52.634 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T23:02:52.653 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T23:02:52.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T23:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T23:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-25T23:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T23:02:52.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T23:02:53.102 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T23:02:53.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:02:53.413 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:02:53.415 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:02:53.432 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-04-25T23:02:52.599417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33254,"ondisk_log_size":33254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":499044,"kb_used_data":253808,"kb_used_omap":8,"kb_used_meta":245175,"kb_avail":282616476,"statfs":{"total":289910292480,"available":289399271424,"internally_reserved":0,"allocated":259899392,"data_stored":258365132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":251059221},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.424404"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096437+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:42.096437+0000","last_peered":"2024-04-25T23:02:42.096437+0000","last_clean":"2024-04-25T23:02:42.096437+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:42.096437+0000","last_undegraded":"2024-04-25T23:02:42.096437+0000","last_fullsized":"2024-04-25T23:02:42.096437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.770809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":601,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095514+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095514+0000","last_peered":"2024-04-25T23:02:42.095514+0000","last_clean":"2024-04-25T23:02:42.095514+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095514+0000","last_undegraded":"2024-04-25T23:02:42.095514+0000","last_fullsized":"2024-04-25T23:02:42.095514+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:37:52.330715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":911,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180224+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:42.180224+0000","last_peered":"2024-04-25T23:02:42.180224+0000","last_clean":"2024-04-25T23:02:42.180224+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:42.180224+0000","last_undegraded":"2024-04-25T23:02:42.180224+0000","last_fullsized":"2024-04-25T23:02:42.180224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:16.727176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":575,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180022+0000","last_change":"2024-04-25T22:59:06.806712+0000","last_active":"2024-04-25T23:02:42.180022+0000","last_peered":"2024-04-25T23:02:42.180022+0000","last_clean":"2024-04-25T23:02:42.180022+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:02:42.180022+0000","last_undegraded":"2024-04-25T23:02:42.180022+0000","last_fullsized":"2024-04-25T23:02:42.180022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094052+0000","last_change":"2024-04-25T23:02:25.091905+0000","last_active":"2024-04-25T23:02:42.094052+0000","last_peered":"2024-04-25T23:02:42.094052+0000","last_clean":"2024-04-25T23:02:42.094052+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:42.094052+0000","last_undegraded":"2024-04-25T23:02:42.094052+0000","last_fullsized":"2024-04-25T23:02:42.094052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:59.077218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":551,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179685+0000","last_change":"2024-04-25T22:59:06.800591+0000","last_active":"2024-04-25T23:02:42.179685+0000","last_peered":"2024-04-25T23:02:42.179685+0000","last_clean":"2024-04-25T23:02:42.179685+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:02:42.179685+0000","last_undegraded":"2024-04-25T23:02:42.179685+0000","last_fullsized":"2024-04-25T23:02:42.179685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179119+0000","last_change":"2024-04-25T22:59:06.798080+0000","last_active":"2024-04-25T23:02:42.179119+0000","last_peered":"2024-04-25T23:02:42.179119+0000","last_clean":"2024-04-25T23:02:42.179119+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:02:42.179119+0000","last_undegraded":"2024-04-25T23:02:42.179119+0000","last_fullsized":"2024-04-25T23:02:42.179119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:49:42.700755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":584,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179014+0000","last_change":"2024-04-25T22:59:06.808814+0000","last_active":"2024-04-25T23:02:42.179014+0000","last_peered":"2024-04-25T23:02:42.179014+0000","last_clean":"2024-04-25T23:02:42.179014+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:02:42.179014+0000","last_undegraded":"2024-04-25T23:02:42.179014+0000","last_fullsized":"2024-04-25T23:02:42.179014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:03.104733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":936,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180749+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:42.180749+0000","last_peered":"2024-04-25T23:02:42.180749+0000","last_clean":"2024-04-25T23:02:42.180749+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:42.180749+0000","last_undegraded":"2024-04-25T23:02:42.180749+0000","last_fullsized":"2024-04-25T23:02:42.180749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:26.524842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":541,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095256+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095256+0000","last_peered":"2024-04-25T23:02:42.095256+0000","last_clean":"2024-04-25T23:02:42.095256+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095256+0000","last_undegraded":"2024-04-25T23:02:42.095256+0000","last_fullsized":"2024-04-25T23:02:42.095256+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:12:09.034674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180197+0000","last_change":"2024-04-25T22:59:06.805913+0000","last_active":"2024-04-25T23:02:42.180197+0000","last_peered":"2024-04-25T23:02:42.180197+0000","last_clean":"2024-04-25T23:02:42.180197+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:02:42.180197+0000","last_undegraded":"2024-04-25T23:02:42.180197+0000","last_fullsized":"2024-04-25T23:02:42.180197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:42.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":524,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095344+0000","last_change":"2024-04-25T23:02:26.089914+0000","last_active":"2024-04-25T23:02:42.095344+0000","last_peered":"2024-04-25T23:02:42.095344+0000","last_clean":"2024-04-25T23:02:42.095344+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:42.095344+0000","last_undegraded":"2024-04-25T23:02:42.095344+0000","last_fullsized":"2024-04-25T23:02:42.095344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:21.343675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":484,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.101687+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:42.101687+0000","last_peered":"2024-04-25T23:02:42.101687+0000","last_clean":"2024-04-25T23:02:42.101687+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:42.101687+0000","last_undegraded":"2024-04-25T23:02:42.101687+0000","last_fullsized":"2024-04-25T23:02:42.101687+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:29.984646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1030,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179637+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:42.179637+0000","last_peered":"2024-04-25T23:02:42.179637+0000","last_clean":"2024-04-25T23:02:42.179637+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:42.179637+0000","last_undegraded":"2024-04-25T23:02:42.179637+0000","last_fullsized":"2024-04-25T23:02:42.179637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":978,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:21.105388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179031+0000","last_change":"2024-04-25T22:59:06.806288+0000","last_active":"2024-04-25T23:02:42.179031+0000","last_peered":"2024-04-25T23:02:42.179031+0000","last_clean":"2024-04-25T23:02:42.179031+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:02:42.179031+0000","last_undegraded":"2024-04-25T23:02:42.179031+0000","last_fullsized":"2024-04-25T23:02:42.179031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:57.629476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1064,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181872+0000","last_change":"2024-04-25T23:02:41.179727+0000","last_active":"2024-04-25T23:02:42.181872+0000","last_peered":"2024-04-25T23:02:42.181872+0000","last_clean":"2024-04-25T23:02:42.181872+0000","last_became_active":"2024-04-25T23:02:41.176566+0000","last_became_peered":"2024-04-25T23:02:41.176566+0000","last_unstale":"2024-04-25T23:02:42.181872+0000","last_undegraded":"2024-04-25T23:02:42.181872+0000","last_fullsized":"2024-04-25T23:02:42.181872+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092854+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.092854+0000","last_peered":"2024-04-25T23:02:42.092854+0000","last_clean":"2024-04-25T23:02:42.092854+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.092854+0000","last_undegraded":"2024-04-25T23:02:42.092854+0000","last_fullsized":"2024-04-25T23:02:42.092854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:37.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180702+0000","last_change":"2024-04-25T23:02:19.202187+0000","last_active":"2024-04-25T23:02:42.180702+0000","last_peered":"2024-04-25T23:02:42.180702+0000","last_clean":"2024-04-25T23:02:42.180702+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:02:42.180702+0000","last_undegraded":"2024-04-25T23:02:42.180702+0000","last_fullsized":"2024-04-25T23:02:42.180702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:20.539751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":600,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180568+0000","last_change":"2024-04-25T22:59:06.806875+0000","last_active":"2024-04-25T23:02:42.180568+0000","last_peered":"2024-04-25T23:02:42.180568+0000","last_clean":"2024-04-25T23:02:42.180568+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:02:42.180568+0000","last_undegraded":"2024-04-25T23:02:42.180568+0000","last_fullsized":"2024-04-25T23:02:42.180568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:46:10.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":643,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180679+0000","last_change":"2024-04-25T22:59:06.806063+0000","last_active":"2024-04-25T23:02:42.180679+0000","last_peered":"2024-04-25T23:02:42.180679+0000","last_clean":"2024-04-25T23:02:42.180679+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:02:42.180679+0000","last_undegraded":"2024-04-25T23:02:42.180679+0000","last_fullsized":"2024-04-25T23:02:42.180679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:18.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094227+0000","last_change":"2024-04-25T23:02:32.094349+0000","last_active":"2024-04-25T23:02:42.094227+0000","last_peered":"2024-04-25T23:02:42.094227+0000","last_clean":"2024-04-25T23:02:42.094227+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:42.094227+0000","last_undegraded":"2024-04-25T23:02:42.094227+0000","last_fullsized":"2024-04-25T23:02:42.094227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:21:43.902142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":581,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.178890+0000","last_change":"2024-04-25T22:59:06.791069+0000","last_active":"2024-04-25T23:02:42.178890+0000","last_peered":"2024-04-25T23:02:42.178890+0000","last_clean":"2024-04-25T23:02:42.178890+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:02:42.178890+0000","last_undegraded":"2024-04-25T23:02:42.178890+0000","last_fullsized":"2024-04-25T23:02:42.178890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:48.245738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093292+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093292+0000","last_peered":"2024-04-25T23:02:42.093292+0000","last_clean":"2024-04-25T23:02:42.093292+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093292+0000","last_undegraded":"2024-04-25T23:02:42.093292+0000","last_fullsized":"2024-04-25T23:02:42.093292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:02.183791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095361+0000","last_change":"2024-04-25T23:02:33.097160+0000","last_active":"2024-04-25T23:02:42.095361+0000","last_peered":"2024-04-25T23:02:42.095361+0000","last_clean":"2024-04-25T23:02:42.095361+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:42.095361+0000","last_undegraded":"2024-04-25T23:02:42.095361+0000","last_fullsized":"2024-04-25T23:02:42.095361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:28.704351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":662,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180855+0000","last_change":"2024-04-25T22:59:06.795580+0000","last_active":"2024-04-25T23:02:42.180855+0000","last_peered":"2024-04-25T23:02:42.180855+0000","last_clean":"2024-04-25T23:02:42.180855+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:02:42.180855+0000","last_undegraded":"2024-04-25T23:02:42.180855+0000","last_fullsized":"2024-04-25T23:02:42.180855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:49.164388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":952,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180444+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:42.180444+0000","last_peered":"2024-04-25T23:02:42.180444+0000","last_clean":"2024-04-25T23:02:42.180444+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:42.180444+0000","last_undegraded":"2024-04-25T23:02:42.180444+0000","last_fullsized":"2024-04-25T23:02:42.180444+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":571,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095167+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095167+0000","last_peered":"2024-04-25T23:02:42.095167+0000","last_clean":"2024-04-25T23:02:42.095167+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095167+0000","last_undegraded":"2024-04-25T23:02:42.095167+0000","last_fullsized":"2024-04-25T23:02:42.095167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:37.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":949,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180379+0000","last_change":"2024-04-25T23:02:23.198714+0000","last_active":"2024-04-25T23:02:42.180379+0000","last_peered":"2024-04-25T23:02:42.180379+0000","last_clean":"2024-04-25T23:02:42.180379+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:42.180379+0000","last_undegraded":"2024-04-25T23:02:42.180379+0000","last_fullsized":"2024-04-25T23:02:42.180379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":631,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093898+0000","last_change":"2024-04-25T23:02:30.084549+0000","last_active":"2024-04-25T23:02:42.093898+0000","last_peered":"2024-04-25T23:02:42.093898+0000","last_clean":"2024-04-25T23:02:42.093898+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:02:42.093898+0000","last_undegraded":"2024-04-25T23:02:42.093898+0000","last_fullsized":"2024-04-25T23:02:42.093898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:11.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1040,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179123+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:42.179123+0000","last_peered":"2024-04-25T23:02:42.179123+0000","last_clean":"2024-04-25T23:02:42.179123+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:42.179123+0000","last_undegraded":"2024-04-25T23:02:42.179123+0000","last_fullsized":"2024-04-25T23:02:42.179123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:12.014983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":690,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179373+0000","last_change":"2024-04-25T22:59:06.808440+0000","last_active":"2024-04-25T23:02:42.179373+0000","last_peered":"2024-04-25T23:02:42.179373+0000","last_clean":"2024-04-25T23:02:42.179373+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:02:42.179373+0000","last_undegraded":"2024-04-25T23:02:42.179373+0000","last_fullsized":"2024-04-25T23:02:42.179373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":651,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094571+0000","last_change":"2024-04-25T23:02:27.090221+0000","last_active":"2024-04-25T23:02:42.094571+0000","last_peered":"2024-04-25T23:02:42.094571+0000","last_clean":"2024-04-25T23:02:42.094571+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:02:42.094571+0000","last_undegraded":"2024-04-25T23:02:42.094571+0000","last_fullsized":"2024-04-25T23:02:42.094571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:52.397744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":718,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181460+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:42.181460+0000","last_peered":"2024-04-25T23:02:42.181460+0000","last_clean":"2024-04-25T23:02:42.181460+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:42.181460+0000","last_undegraded":"2024-04-25T23:02:42.181460+0000","last_fullsized":"2024-04-25T23:02:42.181460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":578,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094656+0000","last_change":"2024-04-25T23:02:20.082611+0000","last_active":"2024-04-25T23:02:42.094656+0000","last_peered":"2024-04-25T23:02:42.094656+0000","last_clean":"2024-04-25T23:02:42.094656+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:02:42.094656+0000","last_undegraded":"2024-04-25T23:02:42.094656+0000","last_fullsized":"2024-04-25T23:02:42.094656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":218,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179724+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:42.179724+0000","last_peered":"2024-04-25T23:02:42.179724+0000","last_clean":"2024-04-25T23:02:42.179724+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:42.179724+0000","last_undegraded":"2024-04-25T23:02:42.179724+0000","last_fullsized":"2024-04-25T23:02:42.179724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":670,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181624+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:42.181624+0000","last_peered":"2024-04-25T23:02:42.181624+0000","last_clean":"2024-04-25T23:02:42.181624+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:42.181624+0000","last_undegraded":"2024-04-25T23:02:42.181624+0000","last_fullsized":"2024-04-25T23:02:42.181624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:55.850750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093598+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093598+0000","last_peered":"2024-04-25T23:02:42.093598+0000","last_clean":"2024-04-25T23:02:42.093598+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093598+0000","last_undegraded":"2024-04-25T23:02:42.093598+0000","last_fullsized":"2024-04-25T23:02:42.093598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:52.631341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":629,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180991+0000","last_change":"2024-04-25T22:59:06.798335+0000","last_active":"2024-04-25T23:02:42.180991+0000","last_peered":"2024-04-25T23:02:42.180991+0000","last_clean":"2024-04-25T23:02:42.180991+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:42.180991+0000","last_undegraded":"2024-04-25T23:02:42.180991+0000","last_fullsized":"2024-04-25T23:02:42.180991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:51.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179421+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:42.179421+0000","last_peered":"2024-04-25T23:02:42.179421+0000","last_clean":"2024-04-25T23:02:42.179421+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:42.179421+0000","last_undegraded":"2024-04-25T23:02:42.179421+0000","last_fullsized":"2024-04-25T23:02:42.179421+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:08.318589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":337,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181609+0000","last_change":"2024-04-25T23:02:18.187522+0000","last_active":"2024-04-25T23:02:42.181609+0000","last_peered":"2024-04-25T23:02:42.181609+0000","last_clean":"2024-04-25T23:02:42.181609+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:42.181609+0000","last_undegraded":"2024-04-25T23:02:42.181609+0000","last_fullsized":"2024-04-25T23:02:42.181609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:04.770153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":627,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093710+0000","last_change":"2024-04-25T23:02:29.095907+0000","last_active":"2024-04-25T23:02:42.093710+0000","last_peered":"2024-04-25T23:02:42.093710+0000","last_clean":"2024-04-25T23:02:42.093710+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:02:42.093710+0000","last_undegraded":"2024-04-25T23:02:42.093710+0000","last_fullsized":"2024-04-25T23:02:42.093710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:57.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":447,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094936+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.094936+0000","last_peered":"2024-04-25T23:02:42.094936+0000","last_clean":"2024-04-25T23:02:42.094936+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.094936+0000","last_undegraded":"2024-04-25T23:02:42.094936+0000","last_fullsized":"2024-04-25T23:02:42.094936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:50.153879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093125+0000","last_change":"2024-04-25T23:02:22.090173+0000","last_active":"2024-04-25T23:02:42.093125+0000","last_peered":"2024-04-25T23:02:42.093125+0000","last_clean":"2024-04-25T23:02:42.093125+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:42.093125+0000","last_undegraded":"2024-04-25T23:02:42.093125+0000","last_fullsized":"2024-04-25T23:02:42.093125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:02.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"61'486","reported_seq":671,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181076+0000","last_change":"2024-04-25T23:02:18.189534+0000","last_active":"2024-04-25T23:02:42.181076+0000","last_peered":"2024-04-25T23:02:42.181076+0000","last_clean":"2024-04-25T23:02:42.181076+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:42.181076+0000","last_undegraded":"2024-04-25T23:02:42.181076+0000","last_fullsized":"2024-04-25T23:02:42.181076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:13.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":616,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179993+0000","last_change":"2024-04-25T22:59:06.799887+0000","last_active":"2024-04-25T23:02:42.179993+0000","last_peered":"2024-04-25T23:02:42.179993+0000","last_clean":"2024-04-25T23:02:42.179993+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:02:42.179993+0000","last_undegraded":"2024-04-25T23:02:42.179993+0000","last_fullsized":"2024-04-25T23:02:42.179993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:25.312630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":241,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181446+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:42.181446+0000","last_peered":"2024-04-25T23:02:42.181446+0000","last_clean":"2024-04-25T23:02:42.181446+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:42.181446+0000","last_undegraded":"2024-04-25T23:02:42.181446+0000","last_fullsized":"2024-04-25T23:02:42.181446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":682,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180483+0000","last_change":"2024-04-25T22:59:06.795407+0000","last_active":"2024-04-25T23:02:42.180483+0000","last_peered":"2024-04-25T23:02:42.180483+0000","last_clean":"2024-04-25T23:02:42.180483+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:02:42.180483+0000","last_undegraded":"2024-04-25T23:02:42.180483+0000","last_fullsized":"2024-04-25T23:02:42.180483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":308,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181027+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:42.181027+0000","last_peered":"2024-04-25T23:02:42.181027+0000","last_clean":"2024-04-25T23:02:42.181027+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:42.181027+0000","last_undegraded":"2024-04-25T23:02:42.181027+0000","last_fullsized":"2024-04-25T23:02:42.181027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180897+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.180897+0000","last_peered":"2024-04-25T23:02:42.180897+0000","last_clean":"2024-04-25T23:02:42.180897+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:02:42.180897+0000","last_undegraded":"2024-04-25T23:02:42.180897+0000","last_fullsized":"2024-04-25T23:02:42.180897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:22.368389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180633+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:42.180633+0000","last_peered":"2024-04-25T23:02:42.180633+0000","last_clean":"2024-04-25T23:02:42.180633+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:42.180633+0000","last_undegraded":"2024-04-25T23:02:42.180633+0000","last_fullsized":"2024-04-25T23:02:42.180633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":986,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180790+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:42.180790+0000","last_peered":"2024-04-25T23:02:42.180790+0000","last_clean":"2024-04-25T23:02:42.180790+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:42.180790+0000","last_undegraded":"2024-04-25T23:02:42.180790+0000","last_fullsized":"2024-04-25T23:02:42.180790+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093232+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093232+0000","last_peered":"2024-04-25T23:02:42.093232+0000","last_clean":"2024-04-25T23:02:42.093232+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093232+0000","last_undegraded":"2024-04-25T23:02:42.093232+0000","last_fullsized":"2024-04-25T23:02:42.093232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:33.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":907,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180786+0000","last_change":"2024-04-25T23:02:21.177048+0000","last_active":"2024-04-25T23:02:42.180786+0000","last_peered":"2024-04-25T23:02:42.180786+0000","last_clean":"2024-04-25T23:02:42.180786+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:42.180786+0000","last_undegraded":"2024-04-25T23:02:42.180786+0000","last_fullsized":"2024-04-25T23:02:42.180786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093409+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093409+0000","last_peered":"2024-04-25T23:02:42.093409+0000","last_clean":"2024-04-25T23:02:42.093409+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093409+0000","last_undegraded":"2024-04-25T23:02:42.093409+0000","last_fullsized":"2024-04-25T23:02:42.093409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:02.120036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":945,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181061+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:42.181061+0000","last_peered":"2024-04-25T23:02:42.181061+0000","last_clean":"2024-04-25T23:02:42.181061+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:42.181061+0000","last_undegraded":"2024-04-25T23:02:42.181061+0000","last_fullsized":"2024-04-25T23:02:42.181061+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:43.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":386,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180214+0000","last_change":"2024-04-25T23:02:15.190584+0000","last_active":"2024-04-25T23:02:42.180214+0000","last_peered":"2024-04-25T23:02:42.180214+0000","last_clean":"2024-04-25T23:02:42.180214+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:42.180214+0000","last_undegraded":"2024-04-25T23:02:42.180214+0000","last_fullsized":"2024-04-25T23:02:42.180214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:58:56.631123+0000","last_clean_scrub_stamp":"2024-04-25T22:58:56.631123+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:16.898864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181741+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:42.181741+0000","last_peered":"2024-04-25T23:02:42.181741+0000","last_clean":"2024-04-25T23:02:42.181741+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:42.181741+0000","last_undegraded":"2024-04-25T23:02:42.181741+0000","last_fullsized":"2024-04-25T23:02:42.181741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:12.550198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'625","reported_seq":811,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179963+0000","last_change":"2024-04-25T23:02:18.183083+0000","last_active":"2024-04-25T23:02:42.179963+0000","last_peered":"2024-04-25T23:02:42.179963+0000","last_clean":"2024-04-25T23:02:42.179963+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:02:42.179963+0000","last_undegraded":"2024-04-25T23:02:42.179963+0000","last_fullsized":"2024-04-25T23:02:42.179963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:20.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1056,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:24.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179934+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:42.179934+0000","last_peered":"2024-04-25T23:02:42.179934+0000","last_clean":"2024-04-25T23:02:42.179934+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:42.179934+0000","last_undegraded":"2024-04-25T23:02:42.179934+0000","last_fullsized":"2024-04-25T23:02:42.179934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:16.308126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":363,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179676+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:42.179676+0000","last_peered":"2024-04-25T23:02:42.179676+0000","last_clean":"2024-04-25T23:02:42.179676+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:42.179676+0000","last_undegraded":"2024-04-25T23:02:42.179676+0000","last_fullsized":"2024-04-25T23:02:42.179676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:06.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":598,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095534+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095534+0000","last_peered":"2024-04-25T23:02:42.095534+0000","last_clean":"2024-04-25T23:02:42.095534+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095534+0000","last_undegraded":"2024-04-25T23:02:42.095534+0000","last_fullsized":"2024-04-25T23:02:42.095534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:40.808970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180262+0000","last_change":"2024-04-25T23:02:15.190365+0000","last_active":"2024-04-25T23:02:42.180262+0000","last_peered":"2024-04-25T23:02:42.180262+0000","last_clean":"2024-04-25T23:02:42.180262+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:42.180262+0000","last_undegraded":"2024-04-25T23:02:42.180262+0000","last_fullsized":"2024-04-25T23:02:42.180262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:33.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":497,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.092926+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.092926+0000","last_peered":"2024-04-25T23:02:42.092926+0000","last_clean":"2024-04-25T23:02:42.092926+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.092926+0000","last_undegraded":"2024-04-25T23:02:42.092926+0000","last_fullsized":"2024-04-25T23:02:42.092926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:33.176054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":888,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181390+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:42.181390+0000","last_peered":"2024-04-25T23:02:42.181390+0000","last_clean":"2024-04-25T23:02:42.181390+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:42.181390+0000","last_undegraded":"2024-04-25T23:02:42.181390+0000","last_fullsized":"2024-04-25T23:02:42.181390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:49.127432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180650+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:42.180650+0000","last_peered":"2024-04-25T23:02:42.180650+0000","last_clean":"2024-04-25T23:02:42.180650+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:42.180650+0000","last_undegraded":"2024-04-25T23:02:42.180650+0000","last_fullsized":"2024-04-25T23:02:42.180650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:06.075383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181465+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:42.181465+0000","last_peered":"2024-04-25T23:02:42.181465+0000","last_clean":"2024-04-25T23:02:42.181465+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:42.181465+0000","last_undegraded":"2024-04-25T23:02:42.181465+0000","last_fullsized":"2024-04-25T23:02:42.181465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:13.580020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":933,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181262+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:42.181262+0000","last_peered":"2024-04-25T23:02:42.181262+0000","last_clean":"2024-04-25T23:02:42.181262+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:42.181262+0000","last_undegraded":"2024-04-25T23:02:42.181262+0000","last_fullsized":"2024-04-25T23:02:42.181262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:37.750116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":450,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181371+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:42.181371+0000","last_peered":"2024-04-25T23:02:42.181371+0000","last_clean":"2024-04-25T23:02:42.181371+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:42.181371+0000","last_undegraded":"2024-04-25T23:02:42.181371+0000","last_fullsized":"2024-04-25T23:02:42.181371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:22.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181052+0000","last_change":"2024-04-25T23:02:15.189346+0000","last_active":"2024-04-25T23:02:42.181052+0000","last_peered":"2024-04-25T23:02:42.181052+0000","last_clean":"2024-04-25T23:02:42.181052+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:42.181052+0000","last_undegraded":"2024-04-25T23:02:42.181052+0000","last_fullsized":"2024-04-25T23:02:42.181052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":513,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094054+0000","last_change":"2024-04-25T23:02:25.089808+0000","last_active":"2024-04-25T23:02:42.094054+0000","last_peered":"2024-04-25T23:02:42.094054+0000","last_clean":"2024-04-25T23:02:42.094054+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:42.094054+0000","last_undegraded":"2024-04-25T23:02:42.094054+0000","last_fullsized":"2024-04-25T23:02:42.094054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:16.298173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":227,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180770+0000","last_change":"2024-04-25T23:02:15.190515+0000","last_active":"2024-04-25T23:02:42.180770+0000","last_peered":"2024-04-25T23:02:42.180770+0000","last_clean":"2024-04-25T23:02:42.180770+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:42.180770+0000","last_undegraded":"2024-04-25T23:02:42.180770+0000","last_fullsized":"2024-04-25T23:02:42.180770+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:34:43.869535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095610+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095610+0000","last_peered":"2024-04-25T23:02:42.095610+0000","last_clean":"2024-04-25T23:02:42.095610+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095610+0000","last_undegraded":"2024-04-25T23:02:42.095610+0000","last_fullsized":"2024-04-25T23:02:42.095610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:13.550314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093609+0000","last_change":"2024-04-25T23:02:19.113135+0000","last_active":"2024-04-25T23:02:42.093609+0000","last_peered":"2024-04-25T23:02:42.093609+0000","last_clean":"2024-04-25T23:02:42.093609+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:02:42.093609+0000","last_undegraded":"2024-04-25T23:02:42.093609+0000","last_fullsized":"2024-04-25T23:02:42.093609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:05.166654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"62'59","reported_seq":238,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181863+0000","last_change":"2024-04-25T23:02:15.195293+0000","last_active":"2024-04-25T23:02:42.181863+0000","last_peered":"2024-04-25T23:02:42.181863+0000","last_clean":"2024-04-25T23:02:42.181863+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:02:42.181863+0000","last_undegraded":"2024-04-25T23:02:42.181863+0000","last_fullsized":"2024-04-25T23:02:42.181863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:47:38.286215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181900+0000","last_change":"2024-04-25T23:02:15.190933+0000","last_active":"2024-04-25T23:02:42.181900+0000","last_peered":"2024-04-25T23:02:42.181900+0000","last_clean":"2024-04-25T23:02:42.181900+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:02:42.181900+0000","last_undegraded":"2024-04-25T23:02:42.181900+0000","last_fullsized":"2024-04-25T23:02:42.181900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":573,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179307+0000","last_change":"2024-04-25T22:59:06.810373+0000","last_active":"2024-04-25T23:02:42.179307+0000","last_peered":"2024-04-25T23:02:42.179307+0000","last_clean":"2024-04-25T23:02:42.179307+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:42.179307+0000","last_undegraded":"2024-04-25T23:02:42.179307+0000","last_fullsized":"2024-04-25T23:02:42.179307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:58.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"62'106","reported_seq":277,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181694+0000","last_change":"2024-04-25T22:59:05.777278+0000","last_active":"2024-04-25T23:02:42.181694+0000","last_peered":"2024-04-25T23:02:42.181694+0000","last_clean":"2024-04-25T23:02:42.181694+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:02:42.181694+0000","last_undegraded":"2024-04-25T23:02:42.181694+0000","last_fullsized":"2024-04-25T23:02:42.181694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:59.870240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181671+0000","last_change":"2024-04-25T23:02:15.192740+0000","last_active":"2024-04-25T23:02:42.181671+0000","last_peered":"2024-04-25T23:02:42.181671+0000","last_clean":"2024-04-25T23:02:42.181671+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:42.181671+0000","last_undegraded":"2024-04-25T23:02:42.181671+0000","last_fullsized":"2024-04-25T23:02:42.181671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:11.300040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093896+0000","last_change":"2024-04-25T23:02:20.086134+0000","last_active":"2024-04-25T23:02:42.093896+0000","last_peered":"2024-04-25T23:02:42.093896+0000","last_clean":"2024-04-25T23:02:42.093896+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:02:42.093896+0000","last_undegraded":"2024-04-25T23:02:42.093896+0000","last_fullsized":"2024-04-25T23:02:42.093896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:43.532955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1004,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180129+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:42.180129+0000","last_peered":"2024-04-25T23:02:42.180129+0000","last_clean":"2024-04-25T23:02:42.180129+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:42.180129+0000","last_undegraded":"2024-04-25T23:02:42.180129+0000","last_fullsized":"2024-04-25T23:02:42.180129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:11:09.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"62'246","reported_seq":437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181167+0000","last_change":"2024-04-25T23:02:18.187730+0000","last_active":"2024-04-25T23:02:42.181167+0000","last_peered":"2024-04-25T23:02:42.181167+0000","last_clean":"2024-04-25T23:02:42.181167+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:42.181167+0000","last_undegraded":"2024-04-25T23:02:42.181167+0000","last_fullsized":"2024-04-25T23:02:42.181167+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:58.594964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":996,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179445+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:42.179445+0000","last_peered":"2024-04-25T23:02:42.179445+0000","last_clean":"2024-04-25T23:02:42.179445+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:42.179445+0000","last_undegraded":"2024-04-25T23:02:42.179445+0000","last_fullsized":"2024-04-25T23:02:42.179445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:34.115388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094958+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.094958+0000","last_peered":"2024-04-25T23:02:42.094958+0000","last_clean":"2024-04-25T23:02:42.094958+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.094958+0000","last_undegraded":"2024-04-25T23:02:42.094958+0000","last_fullsized":"2024-04-25T23:02:42.094958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:45:02.522450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181287+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:42.181287+0000","last_peered":"2024-04-25T23:02:42.181287+0000","last_clean":"2024-04-25T23:02:42.181287+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:42.181287+0000","last_undegraded":"2024-04-25T23:02:42.181287+0000","last_fullsized":"2024-04-25T23:02:42.181287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:12.020786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":676,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179182+0000","last_change":"2024-04-25T22:59:06.790660+0000","last_active":"2024-04-25T23:02:42.179182+0000","last_peered":"2024-04-25T23:02:42.179182+0000","last_clean":"2024-04-25T23:02:42.179182+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:02:42.179182+0000","last_undegraded":"2024-04-25T23:02:42.179182+0000","last_fullsized":"2024-04-25T23:02:42.179182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:54.260632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":235,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181681+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:42.181681+0000","last_peered":"2024-04-25T23:02:42.181681+0000","last_clean":"2024-04-25T23:02:42.181681+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:42.181681+0000","last_undegraded":"2024-04-25T23:02:42.181681+0000","last_fullsized":"2024-04-25T23:02:42.181681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:55.661335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1041,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179154+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:42.179154+0000","last_peered":"2024-04-25T23:02:42.179154+0000","last_clean":"2024-04-25T23:02:42.179154+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:42.179154+0000","last_undegraded":"2024-04-25T23:02:42.179154+0000","last_fullsized":"2024-04-25T23:02:42.179154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:08.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":503,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.096211+0000","last_change":"2024-04-25T23:02:22.088867+0000","last_active":"2024-04-25T23:02:42.096211+0000","last_peered":"2024-04-25T23:02:42.096211+0000","last_clean":"2024-04-25T23:02:42.096211+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:02:42.096211+0000","last_undegraded":"2024-04-25T23:02:42.096211+0000","last_fullsized":"2024-04-25T23:02:42.096211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:28:00.667336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"61'569","reported_seq":755,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180096+0000","last_change":"2024-04-25T23:02:18.182856+0000","last_active":"2024-04-25T23:02:42.180096+0000","last_peered":"2024-04-25T23:02:42.180096+0000","last_clean":"2024-04-25T23:02:42.180096+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:02:42.180096+0000","last_undegraded":"2024-04-25T23:02:42.180096+0000","last_fullsized":"2024-04-25T23:02:42.180096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:12:25.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":637,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180742+0000","last_change":"2024-04-25T22:59:06.795566+0000","last_active":"2024-04-25T23:02:42.180742+0000","last_peered":"2024-04-25T23:02:42.180742+0000","last_clean":"2024-04-25T23:02:42.180742+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:02:42.180742+0000","last_undegraded":"2024-04-25T23:02:42.180742+0000","last_fullsized":"2024-04-25T23:02:42.180742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:06.228299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179716+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:42.179716+0000","last_peered":"2024-04-25T23:02:42.179716+0000","last_clean":"2024-04-25T23:02:42.179716+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:42.179716+0000","last_undegraded":"2024-04-25T23:02:42.179716+0000","last_fullsized":"2024-04-25T23:02:42.179716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:41.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094896+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.094896+0000","last_peered":"2024-04-25T23:02:42.094896+0000","last_clean":"2024-04-25T23:02:42.094896+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.094896+0000","last_undegraded":"2024-04-25T23:02:42.094896+0000","last_fullsized":"2024-04-25T23:02:42.094896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:56.741891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":380,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093622+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093622+0000","last_peered":"2024-04-25T23:02:42.093622+0000","last_clean":"2024-04-25T23:02:42.093622+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093622+0000","last_undegraded":"2024-04-25T23:02:42.093622+0000","last_fullsized":"2024-04-25T23:02:42.093622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:01:00.324784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":543,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094850+0000","last_change":"2024-04-25T23:02:29.094226+0000","last_active":"2024-04-25T23:02:42.094850+0000","last_peered":"2024-04-25T23:02:42.094850+0000","last_clean":"2024-04-25T23:02:42.094850+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:02:42.094850+0000","last_undegraded":"2024-04-25T23:02:42.094850+0000","last_fullsized":"2024-04-25T23:02:42.094850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:17.822926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093911+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.093911+0000","last_peered":"2024-04-25T23:02:42.093911+0000","last_clean":"2024-04-25T23:02:42.093911+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.093911+0000","last_undegraded":"2024-04-25T23:02:42.093911+0000","last_fullsized":"2024-04-25T23:02:42.093911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:38.215380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":596,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179782+0000","last_change":"2024-04-25T22:59:06.806364+0000","last_active":"2024-04-25T23:02:42.179782+0000","last_peered":"2024-04-25T23:02:42.179782+0000","last_clean":"2024-04-25T23:02:42.179782+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:42.179782+0000","last_undegraded":"2024-04-25T23:02:42.179782+0000","last_fullsized":"2024-04-25T23:02:42.179782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:35.348303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":373,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181100+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:42.181100+0000","last_peered":"2024-04-25T23:02:42.181100+0000","last_clean":"2024-04-25T23:02:42.181100+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:42.181100+0000","last_undegraded":"2024-04-25T23:02:42.181100+0000","last_fullsized":"2024-04-25T23:02:42.181100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:59.093673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":658,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180308+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:42.180308+0000","last_peered":"2024-04-25T23:02:42.180308+0000","last_clean":"2024-04-25T23:02:42.180308+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:42.180308+0000","last_undegraded":"2024-04-25T23:02:42.180308+0000","last_fullsized":"2024-04-25T23:02:42.180308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:36.798588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":444,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094599+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094599+0000","last_peered":"2024-04-25T23:02:42.094599+0000","last_clean":"2024-04-25T23:02:42.094599+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094599+0000","last_undegraded":"2024-04-25T23:02:42.094599+0000","last_fullsized":"2024-04-25T23:02:42.094599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:06.702567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":645,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093692+0000","last_change":"2024-04-25T23:02:24.116023+0000","last_active":"2024-04-25T23:02:42.093692+0000","last_peered":"2024-04-25T23:02:42.093692+0000","last_clean":"2024-04-25T23:02:42.093692+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:42.093692+0000","last_undegraded":"2024-04-25T23:02:42.093692+0000","last_fullsized":"2024-04-25T23:02:42.093692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:43:06.073674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"61'59","reported_seq":242,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181508+0000","last_change":"2024-04-25T23:02:15.236144+0000","last_active":"2024-04-25T23:02:42.181508+0000","last_peered":"2024-04-25T23:02:42.181508+0000","last_clean":"2024-04-25T23:02:42.181508+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:42.181508+0000","last_undegraded":"2024-04-25T23:02:42.181508+0000","last_fullsized":"2024-04-25T23:02:42.181508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:01.461560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":657,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179641+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:42.179641+0000","last_peered":"2024-04-25T23:02:42.179641+0000","last_clean":"2024-04-25T23:02:42.179641+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:42.179641+0000","last_undegraded":"2024-04-25T23:02:42.179641+0000","last_fullsized":"2024-04-25T23:02:42.179641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:09.259288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":287,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181484+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:42.181484+0000","last_peered":"2024-04-25T23:02:42.181484+0000","last_clean":"2024-04-25T23:02:42.181484+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:42.181484+0000","last_undegraded":"2024-04-25T23:02:42.181484+0000","last_fullsized":"2024-04-25T23:02:42.181484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:28.263463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6466,"ondisk_log_size":6466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142136,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229704,"statfs":{"total":96636764160,"available":96491216896,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738421,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177884,"kb_used_data":80140,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94193956,"statfs":{"total":96636764160,"available":96454610944,"internally_reserved":0,"allocated":82063360,"data_stored":81566497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179024,"kb_used_data":89600,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192816,"statfs":{"total":96636764160,"available":96453443584,"internally_reserved":0,"allocated":91750400,"data_stored":91229381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:02:53.439 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.440 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.441 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.442 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.443 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.443 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.443 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.443 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.444 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.444 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.444 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.444 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.444 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.445 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.445 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.445 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.445 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.445 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.446 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.446 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.446 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.446 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.446 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.446 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.446 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.447 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.447 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.447 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.447 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.447 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.447 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.448 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.448 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T22:58:56.631123+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=58, tm_sec=56, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.448 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.448 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.448 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.448 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.449 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.450 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.451 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.452 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.453 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:02:53.454 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T23:03:13.454 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:03:13.782 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:03:13.784 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:03:13.802 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-04-25T23:03:12.606867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33273,"ondisk_log_size":33273,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":482376,"kb_used_data":253808,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282633144,"statfs":{"total":289910292480,"available":289416339456,"internally_reserved":0,"allocated":259899392,"data_stored":258365132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":234019861},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004395"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":609,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:43.652833+0000","last_change":"2024-04-25T23:02:40.088937+0000","last_active":"2024-04-25T23:02:43.652833+0000","last_peered":"2024-04-25T23:02:43.652833+0000","last_clean":"2024-04-25T23:02:43.652833+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:02:43.652833+0000","last_undegraded":"2024-04-25T23:02:43.652833+0000","last_fullsized":"2024-04-25T23:02:43.652833+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":602,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095651+0000","last_change":"2024-04-25T23:02:37.092925+0000","last_active":"2024-04-25T23:02:42.095651+0000","last_peered":"2024-04-25T23:02:42.095651+0000","last_clean":"2024-04-25T23:02:42.095651+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:02:42.095651+0000","last_undegraded":"2024-04-25T23:02:42.095651+0000","last_fullsized":"2024-04-25T23:02:42.095651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":912,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180403+0000","last_change":"2024-04-25T23:02:35.178275+0000","last_active":"2024-04-25T23:02:42.180403+0000","last_peered":"2024-04-25T23:02:42.180403+0000","last_clean":"2024-04-25T23:02:42.180403+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:02:42.180403+0000","last_undegraded":"2024-04-25T23:02:42.180403+0000","last_fullsized":"2024-04-25T23:02:42.180403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":585,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:03.285532+0000","last_change":"2024-04-25T23:03:03.285532+0000","last_active":"2024-04-25T23:03:03.285532+0000","last_peered":"2024-04-25T23:03:03.285532+0000","last_clean":"2024-04-25T23:03:03.285532+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:03:03.285532+0000","last_undegraded":"2024-04-25T23:03:03.285532+0000","last_fullsized":"2024-04-25T23:03:03.285532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'376","last_scrub_stamp":"2024-04-25T23:03:03.285265+0000","last_deep_scrub":"62'376","last_deep_scrub_stamp":"2024-04-25T23:03:03.285265+0000","last_clean_scrub_stamp":"2024-04-25T23:03:03.285265+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:29.830226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":661,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:57.938369+0000","last_change":"2024-04-25T23:02:57.938503+0000","last_active":"2024-04-25T23:02:57.938369+0000","last_peered":"2024-04-25T23:02:57.938369+0000","last_clean":"2024-04-25T23:02:57.938369+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:57.938369+0000","last_undegraded":"2024-04-25T23:02:57.938369+0000","last_fullsized":"2024-04-25T23:02:57.938369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'457","last_scrub_stamp":"2024-04-25T23:02:57.938083+0000","last_deep_scrub":"62'457","last_deep_scrub_stamp":"2024-04-25T23:02:57.938083+0000","last_clean_scrub_stamp":"2024-04-25T23:02:57.938083+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:35.315353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":560,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:06.365851+0000","last_change":"2024-04-25T23:03:06.365913+0000","last_active":"2024-04-25T23:03:06.365851+0000","last_peered":"2024-04-25T23:03:06.365851+0000","last_clean":"2024-04-25T23:03:06.365851+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:03:06.365851+0000","last_undegraded":"2024-04-25T23:03:06.365851+0000","last_fullsized":"2024-04-25T23:03:06.365851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'369","last_scrub_stamp":"2024-04-25T23:03:06.365652+0000","last_deep_scrub":"62'369","last_deep_scrub_stamp":"2024-04-25T23:03:06.365652+0000","last_clean_scrub_stamp":"2024-04-25T23:03:06.365652+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:08.242544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:10.312232+0000","last_change":"2024-04-25T23:03:10.312392+0000","last_active":"2024-04-25T23:03:10.312232+0000","last_peered":"2024-04-25T23:03:10.312232+0000","last_clean":"2024-04-25T23:03:10.312232+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:03:10.312232+0000","last_undegraded":"2024-04-25T23:03:10.312232+0000","last_fullsized":"2024-04-25T23:03:10.312232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'402","last_scrub_stamp":"2024-04-25T23:03:10.312005+0000","last_deep_scrub":"62'402","last_deep_scrub_stamp":"2024-04-25T23:03:10.312005+0000","last_clean_scrub_stamp":"2024-04-25T23:03:10.312005+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:38.565569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":593,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:09.341515+0000","last_change":"2024-04-25T23:03:09.341576+0000","last_active":"2024-04-25T23:03:09.341515+0000","last_peered":"2024-04-25T23:03:09.341515+0000","last_clean":"2024-04-25T23:03:09.341515+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:03:09.341515+0000","last_undegraded":"2024-04-25T23:03:09.341515+0000","last_fullsized":"2024-04-25T23:03:09.341515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'375","last_scrub_stamp":"2024-04-25T23:03:09.341315+0000","last_deep_scrub":"62'375","last_deep_scrub_stamp":"2024-04-25T23:03:09.341315+0000","last_clean_scrub_stamp":"2024-04-25T23:03:09.341315+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:50:27.205651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":937,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180919+0000","last_change":"2024-04-25T23:02:38.186352+0000","last_active":"2024-04-25T23:02:42.180919+0000","last_peered":"2024-04-25T23:02:42.180919+0000","last_clean":"2024-04-25T23:02:42.180919+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:02:42.180919+0000","last_undegraded":"2024-04-25T23:02:42.180919+0000","last_fullsized":"2024-04-25T23:02:42.180919+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":542,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095379+0000","last_change":"2024-04-25T23:02:32.091377+0000","last_active":"2024-04-25T23:02:42.095379+0000","last_peered":"2024-04-25T23:02:42.095379+0000","last_clean":"2024-04-25T23:02:42.095379+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:02:42.095379+0000","last_undegraded":"2024-04-25T23:02:42.095379+0000","last_fullsized":"2024-04-25T23:02:42.095379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":607,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:04.323634+0000","last_change":"2024-04-25T23:03:04.323827+0000","last_active":"2024-04-25T23:03:04.323634+0000","last_peered":"2024-04-25T23:03:04.323634+0000","last_clean":"2024-04-25T23:03:04.323634+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:03:04.323634+0000","last_undegraded":"2024-04-25T23:03:04.323634+0000","last_fullsized":"2024-04-25T23:03:04.323634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'390","last_scrub_stamp":"2024-04-25T23:03:04.323410+0000","last_deep_scrub":"62'390","last_deep_scrub_stamp":"2024-04-25T23:03:04.323410+0000","last_clean_scrub_stamp":"2024-04-25T23:03:04.323410+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:45.039133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":533,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:59.926287+0000","last_change":"2024-04-25T23:02:59.926353+0000","last_active":"2024-04-25T23:02:59.926287+0000","last_peered":"2024-04-25T23:02:59.926287+0000","last_clean":"2024-04-25T23:02:59.926287+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:59.926287+0000","last_undegraded":"2024-04-25T23:02:59.926287+0000","last_fullsized":"2024-04-25T23:02:59.926287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'359","last_scrub_stamp":"2024-04-25T23:02:59.926092+0000","last_deep_scrub":"62'359","last_deep_scrub_stamp":"2024-04-25T23:02:59.926092+0000","last_clean_scrub_stamp":"2024-04-25T23:02:59.926092+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:19.043551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":485,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:43.652729+0000","last_change":"2024-04-25T23:02:42.100829+0000","last_active":"2024-04-25T23:02:43.652729+0000","last_peered":"2024-04-25T23:02:43.652729+0000","last_clean":"2024-04-25T23:02:43.652729+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:02:43.652729+0000","last_undegraded":"2024-04-25T23:02:43.652729+0000","last_fullsized":"2024-04-25T23:02:43.652729+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1031,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179829+0000","last_change":"2024-04-25T23:02:27.179149+0000","last_active":"2024-04-25T23:02:42.179829+0000","last_peered":"2024-04-25T23:02:42.179829+0000","last_clean":"2024-04-25T23:02:42.179829+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:02:42.179829+0000","last_undegraded":"2024-04-25T23:02:42.179829+0000","last_fullsized":"2024-04-25T23:02:42.179829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":979,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180508+0000","last_change":"2024-04-25T23:02:24.203713+0000","last_active":"2024-04-25T23:02:42.180508+0000","last_peered":"2024-04-25T23:02:42.180508+0000","last_clean":"2024-04-25T23:02:42.180508+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:02:42.180508+0000","last_undegraded":"2024-04-25T23:02:42.180508+0000","last_fullsized":"2024-04-25T23:02:42.180508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:00.319428+0000","last_change":"2024-04-25T23:03:00.319582+0000","last_active":"2024-04-25T23:03:00.319428+0000","last_peered":"2024-04-25T23:03:00.319428+0000","last_clean":"2024-04-25T23:03:00.319428+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:03:00.319428+0000","last_undegraded":"2024-04-25T23:03:00.319428+0000","last_fullsized":"2024-04-25T23:03:00.319428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'426","last_scrub_stamp":"2024-04-25T23:03:00.319163+0000","last_deep_scrub":"62'426","last_deep_scrub_stamp":"2024-04-25T23:03:00.319163+0000","last_clean_scrub_stamp":"2024-04-25T23:03:00.319163+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:28.406086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1065,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.182009+0000","last_change":"2024-04-25T23:02:41.179727+0000","last_active":"2024-04-25T23:02:42.182009+0000","last_peered":"2024-04-25T23:02:42.182009+0000","last_clean":"2024-04-25T23:02:42.182009+0000","last_became_active":"2024-04-25T23:02:41.176566+0000","last_became_peered":"2024-04-25T23:02:41.176566+0000","last_unstale":"2024-04-25T23:02:42.182009+0000","last_undegraded":"2024-04-25T23:02:42.182009+0000","last_fullsized":"2024-04-25T23:02:42.182009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":600,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093010+0000","last_change":"2024-04-25T23:02:34.095443+0000","last_active":"2024-04-25T23:02:42.093010+0000","last_peered":"2024-04-25T23:02:42.093010+0000","last_clean":"2024-04-25T23:02:42.093010+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:02:42.093010+0000","last_undegraded":"2024-04-25T23:02:42.093010+0000","last_fullsized":"2024-04-25T23:02:42.093010+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:08.494921+0000","last_change":"2024-04-25T23:03:08.495079+0000","last_active":"2024-04-25T23:03:08.494921+0000","last_peered":"2024-04-25T23:03:08.494921+0000","last_clean":"2024-04-25T23:03:08.494921+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:03:08.494921+0000","last_undegraded":"2024-04-25T23:03:08.494921+0000","last_fullsized":"2024-04-25T23:03:08.494921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'458","last_scrub_stamp":"2024-04-25T23:03:08.494601+0000","last_deep_scrub":"62'458","last_deep_scrub_stamp":"2024-04-25T23:03:08.494601+0000","last_clean_scrub_stamp":"2024-04-25T23:03:08.494601+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:20:56.965750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":609,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:05.371453+0000","last_change":"2024-04-25T23:03:05.371622+0000","last_active":"2024-04-25T23:03:05.371453+0000","last_peered":"2024-04-25T23:03:05.371453+0000","last_clean":"2024-04-25T23:03:05.371453+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:03:05.371453+0000","last_undegraded":"2024-04-25T23:03:05.371453+0000","last_fullsized":"2024-04-25T23:03:05.371453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'424","last_scrub_stamp":"2024-04-25T23:03:05.371199+0000","last_deep_scrub":"62'424","last_deep_scrub_stamp":"2024-04-25T23:03:05.371199+0000","last_clean_scrub_stamp":"2024-04-25T23:03:05.371199+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:47.622388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:02.327170+0000","last_change":"2024-04-25T23:03:02.327229+0000","last_active":"2024-04-25T23:03:02.327170+0000","last_peered":"2024-04-25T23:03:02.327170+0000","last_clean":"2024-04-25T23:03:02.327170+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:03:02.327170+0000","last_undegraded":"2024-04-25T23:03:02.327170+0000","last_fullsized":"2024-04-25T23:03:02.327170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'421","last_scrub_stamp":"2024-04-25T23:03:02.326960+0000","last_deep_scrub":"62'421","last_deep_scrub_stamp":"2024-04-25T23:03:02.326960+0000","last_clean_scrub_stamp":"2024-04-25T23:03:02.326960+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:31.845124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":677,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:54.987658+0000","last_change":"2024-04-25T23:02:54.987725+0000","last_active":"2024-04-25T23:02:54.987658+0000","last_peered":"2024-04-25T23:02:54.987658+0000","last_clean":"2024-04-25T23:02:54.987658+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:54.987658+0000","last_undegraded":"2024-04-25T23:02:54.987658+0000","last_fullsized":"2024-04-25T23:02:54.987658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'463","last_scrub_stamp":"2024-04-25T23:02:54.987464+0000","last_deep_scrub":"62'463","last_deep_scrub_stamp":"2024-04-25T23:02:54.987464+0000","last_clean_scrub_stamp":"2024-04-25T23:02:54.987464+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:04.687394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:09.487880+0000","last_change":"2024-04-25T23:03:09.487943+0000","last_active":"2024-04-25T23:03:09.487880+0000","last_peered":"2024-04-25T23:03:09.487880+0000","last_clean":"2024-04-25T23:03:09.487880+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:03:09.487880+0000","last_undegraded":"2024-04-25T23:03:09.487880+0000","last_fullsized":"2024-04-25T23:03:09.487880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'397","last_scrub_stamp":"2024-04-25T23:03:09.487673+0000","last_deep_scrub":"62'397","last_deep_scrub_stamp":"2024-04-25T23:03:09.487673+0000","last_clean_scrub_stamp":"2024-04-25T23:03:09.487673+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:59.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":646,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093442+0000","last_change":"2024-04-25T23:02:36.090265+0000","last_active":"2024-04-25T23:02:42.093442+0000","last_peered":"2024-04-25T23:02:42.093442+0000","last_clean":"2024-04-25T23:02:42.093442+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:02:42.093442+0000","last_undegraded":"2024-04-25T23:02:42.093442+0000","last_fullsized":"2024-04-25T23:02:42.093442+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:53.959504+0000","last_change":"2024-04-25T23:02:53.959567+0000","last_active":"2024-04-25T23:02:53.959504+0000","last_peered":"2024-04-25T23:02:53.959504+0000","last_clean":"2024-04-25T23:02:53.959504+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:53.959504+0000","last_undegraded":"2024-04-25T23:02:53.959504+0000","last_fullsized":"2024-04-25T23:02:53.959504+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'430","last_scrub_stamp":"2024-04-25T23:02:53.959281+0000","last_deep_scrub":"62'430","last_deep_scrub_stamp":"2024-04-25T23:02:53.959281+0000","last_clean_scrub_stamp":"2024-04-25T23:02:53.959281+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:03.330188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":671,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:01.513559+0000","last_change":"2024-04-25T23:03:01.513616+0000","last_active":"2024-04-25T23:03:01.513559+0000","last_peered":"2024-04-25T23:03:01.513559+0000","last_clean":"2024-04-25T23:03:01.513559+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:03:01.513559+0000","last_undegraded":"2024-04-25T23:03:01.513559+0000","last_fullsized":"2024-04-25T23:03:01.513559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'464","last_scrub_stamp":"2024-04-25T23:03:01.513370+0000","last_deep_scrub":"62'464","last_deep_scrub_stamp":"2024-04-25T23:03:01.513370+0000","last_clean_scrub_stamp":"2024-04-25T23:03:01.513370+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.457089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":953,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180616+0000","last_change":"2024-04-25T23:02:36.179869+0000","last_active":"2024-04-25T23:02:42.180616+0000","last_peered":"2024-04-25T23:02:42.180616+0000","last_clean":"2024-04-25T23:02:42.180616+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:02:42.180616+0000","last_undegraded":"2024-04-25T23:02:42.180616+0000","last_fullsized":"2024-04-25T23:02:42.180616+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":572,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095314+0000","last_change":"2024-04-25T23:02:39.099715+0000","last_active":"2024-04-25T23:02:42.095314+0000","last_peered":"2024-04-25T23:02:42.095314+0000","last_clean":"2024-04-25T23:02:42.095314+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:02:42.095314+0000","last_undegraded":"2024-04-25T23:02:42.095314+0000","last_fullsized":"2024-04-25T23:02:42.095314+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":958,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:53.340640+0000","last_change":"2024-04-25T23:02:53.340706+0000","last_active":"2024-04-25T23:02:53.340640+0000","last_peered":"2024-04-25T23:02:53.340640+0000","last_clean":"2024-04-25T23:02:53.340640+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:53.340640+0000","last_undegraded":"2024-04-25T23:02:53.340640+0000","last_fullsized":"2024-04-25T23:02:53.340640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'390","last_scrub_stamp":"2024-04-25T23:02:53.340423+0000","last_deep_scrub":"62'390","last_deep_scrub_stamp":"2024-04-25T23:02:53.340423+0000","last_clean_scrub_stamp":"2024-04-25T23:02:53.340423+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:56.618770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":640,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:07.932000+0000","last_change":"2024-04-25T23:03:07.932057+0000","last_active":"2024-04-25T23:03:07.932000+0000","last_peered":"2024-04-25T23:03:07.932000+0000","last_clean":"2024-04-25T23:03:07.932000+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:03:07.932000+0000","last_undegraded":"2024-04-25T23:03:07.932000+0000","last_fullsized":"2024-04-25T23:03:07.932000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'468","last_scrub_stamp":"2024-04-25T23:03:07.931797+0000","last_deep_scrub":"62'468","last_deep_scrub_stamp":"2024-04-25T23:03:07.931797+0000","last_clean_scrub_stamp":"2024-04-25T23:03:07.931797+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:29:24.092499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1041,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179279+0000","last_change":"2024-04-25T23:02:21.173961+0000","last_active":"2024-04-25T23:02:42.179279+0000","last_peered":"2024-04-25T23:02:42.179279+0000","last_clean":"2024-04-25T23:02:42.179279+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:02:42.179279+0000","last_undegraded":"2024-04-25T23:02:42.179279+0000","last_fullsized":"2024-04-25T23:02:42.179279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":699,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:07.364301+0000","last_change":"2024-04-25T23:03:07.364362+0000","last_active":"2024-04-25T23:03:07.364301+0000","last_peered":"2024-04-25T23:03:07.364301+0000","last_clean":"2024-04-25T23:03:07.364301+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:03:07.364301+0000","last_undegraded":"2024-04-25T23:03:07.364301+0000","last_fullsized":"2024-04-25T23:03:07.364301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'462","last_scrub_stamp":"2024-04-25T23:03:07.364098+0000","last_deep_scrub":"62'462","last_deep_scrub_stamp":"2024-04-25T23:03:07.364098+0000","last_clean_scrub_stamp":"2024-04-25T23:03:07.364098+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:13.776454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":660,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:01.935737+0000","last_change":"2024-04-25T23:03:01.935799+0000","last_active":"2024-04-25T23:03:01.935737+0000","last_peered":"2024-04-25T23:03:01.935737+0000","last_clean":"2024-04-25T23:03:01.935737+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:03:01.935737+0000","last_undegraded":"2024-04-25T23:03:01.935737+0000","last_fullsized":"2024-04-25T23:03:01.935737+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'425","last_scrub_stamp":"2024-04-25T23:03:01.935531+0000","last_deep_scrub":"62'425","last_deep_scrub_stamp":"2024-04-25T23:03:01.935531+0000","last_clean_scrub_stamp":"2024-04-25T23:03:01.935531+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:20.857728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"61'547","reported_seq":719,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181598+0000","last_change":"2024-04-25T22:59:05.776798+0000","last_active":"2024-04-25T23:02:42.181598+0000","last_peered":"2024-04-25T23:02:42.181598+0000","last_clean":"2024-04-25T23:02:42.181598+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:02:42.181598+0000","last_undegraded":"2024-04-25T23:02:42.181598+0000","last_fullsized":"2024-04-25T23:02:42.181598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":587,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:04.909667+0000","last_change":"2024-04-25T23:03:04.909727+0000","last_active":"2024-04-25T23:03:04.909667+0000","last_peered":"2024-04-25T23:03:04.909667+0000","last_clean":"2024-04-25T23:03:04.909667+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:03:04.909667+0000","last_undegraded":"2024-04-25T23:03:04.909667+0000","last_fullsized":"2024-04-25T23:03:04.909667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'396","last_scrub_stamp":"2024-04-25T23:03:04.909470+0000","last_deep_scrub":"62'396","last_deep_scrub_stamp":"2024-04-25T23:03:04.909470+0000","last_clean_scrub_stamp":"2024-04-25T23:03:04.909470+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:25.484491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":219,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179872+0000","last_change":"2024-04-25T22:59:05.778308+0000","last_active":"2024-04-25T23:02:42.179872+0000","last_peered":"2024-04-25T23:02:42.179872+0000","last_clean":"2024-04-25T23:02:42.179872+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:02:42.179872+0000","last_undegraded":"2024-04-25T23:02:42.179872+0000","last_fullsized":"2024-04-25T23:02:42.179872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":671,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181768+0000","last_change":"2024-04-25T22:59:06.789121+0000","last_active":"2024-04-25T23:02:42.181768+0000","last_peered":"2024-04-25T23:02:42.181768+0000","last_clean":"2024-04-25T23:02:42.181768+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:02:42.181768+0000","last_undegraded":"2024-04-25T23:02:42.181768+0000","last_fullsized":"2024-04-25T23:02:42.181768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093741+0000","last_change":"2024-04-25T23:02:15.097601+0000","last_active":"2024-04-25T23:02:42.093741+0000","last_peered":"2024-04-25T23:02:42.093741+0000","last_clean":"2024-04-25T23:02:42.093741+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:02:42.093741+0000","last_undegraded":"2024-04-25T23:02:42.093741+0000","last_fullsized":"2024-04-25T23:02:42.093741+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:59.473692+0000","last_change":"2024-04-25T23:02:59.473749+0000","last_active":"2024-04-25T23:02:59.473692+0000","last_peered":"2024-04-25T23:02:59.473692+0000","last_clean":"2024-04-25T23:02:59.473692+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:59.473692+0000","last_undegraded":"2024-04-25T23:02:59.473692+0000","last_fullsized":"2024-04-25T23:02:59.473692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'407","last_scrub_stamp":"2024-04-25T23:02:59.473493+0000","last_deep_scrub":"62'407","last_deep_scrub_stamp":"2024-04-25T23:02:59.473493+0000","last_clean_scrub_stamp":"2024-04-25T23:02:59.473493+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:25.223460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"62'64","reported_seq":244,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179564+0000","last_change":"2024-04-25T23:02:15.189829+0000","last_active":"2024-04-25T23:02:42.179564+0000","last_peered":"2024-04-25T23:02:42.179564+0000","last_clean":"2024-04-25T23:02:42.179564+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:02:42.179564+0000","last_undegraded":"2024-04-25T23:02:42.179564+0000","last_fullsized":"2024-04-25T23:02:42.179564+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"97'154","reported_seq":348,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:55.221159+0000","last_change":"2024-04-25T23:02:55.221333+0000","last_active":"2024-04-25T23:02:55.221159+0000","last_peered":"2024-04-25T23:02:55.221159+0000","last_clean":"2024-04-25T23:02:55.221159+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:55.221159+0000","last_undegraded":"2024-04-25T23:02:55.221159+0000","last_fullsized":"2024-04-25T23:02:55.221159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'154","last_scrub_stamp":"2024-04-25T23:02:55.220933+0000","last_deep_scrub":"97'154","last_deep_scrub_stamp":"2024-04-25T23:02:55.220933+0000","last_clean_scrub_stamp":"2024-04-25T23:02:55.220933+0000","objects_scrubbed":2,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:56.610312+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":636,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:05.946790+0000","last_change":"2024-04-25T23:03:05.946907+0000","last_active":"2024-04-25T23:03:05.946790+0000","last_peered":"2024-04-25T23:03:05.946790+0000","last_clean":"2024-04-25T23:03:05.946790+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:03:05.946790+0000","last_undegraded":"2024-04-25T23:03:05.946790+0000","last_fullsized":"2024-04-25T23:03:05.946790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'429","last_scrub_stamp":"2024-04-25T23:03:05.946544+0000","last_deep_scrub":"62'429","last_deep_scrub_stamp":"2024-04-25T23:03:05.946544+0000","last_clean_scrub_stamp":"2024-04-25T23:03:05.946544+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:50.761561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"61'277","reported_seq":448,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095064+0000","last_change":"2024-04-25T23:02:18.096627+0000","last_active":"2024-04-25T23:02:42.095064+0000","last_peered":"2024-04-25T23:02:42.095064+0000","last_clean":"2024-04-25T23:02:42.095064+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:02:42.095064+0000","last_undegraded":"2024-04-25T23:02:42.095064+0000","last_fullsized":"2024-04-25T23:02:42.095064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:58.909230+0000","last_change":"2024-04-25T23:02:58.909373+0000","last_active":"2024-04-25T23:02:58.909230+0000","last_peered":"2024-04-25T23:02:58.909230+0000","last_clean":"2024-04-25T23:02:58.909230+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:58.909230+0000","last_undegraded":"2024-04-25T23:02:58.909230+0000","last_fullsized":"2024-04-25T23:02:58.909230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'451","last_scrub_stamp":"2024-04-25T23:02:58.908996+0000","last_deep_scrub":"62'451","last_deep_scrub_stamp":"2024-04-25T23:02:58.908996+0000","last_clean_scrub_stamp":"2024-04-25T23:02:58.908996+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:42.962115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"97'488","reported_seq":682,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:53.153476+0000","last_change":"2024-04-25T23:02:53.153545+0000","last_active":"2024-04-25T23:02:53.153476+0000","last_peered":"2024-04-25T23:02:53.153476+0000","last_clean":"2024-04-25T23:02:53.153476+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:53.153476+0000","last_undegraded":"2024-04-25T23:02:53.153476+0000","last_fullsized":"2024-04-25T23:02:53.153476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'488","last_scrub_stamp":"2024-04-25T23:02:53.153265+0000","last_deep_scrub":"97'488","last_deep_scrub_stamp":"2024-04-25T23:02:53.153265+0000","last_clean_scrub_stamp":"2024-04-25T23:02:53.153265+0000","objects_scrubbed":2,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:56.431612+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":625,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:08.363585+0000","last_change":"2024-04-25T23:03:08.363645+0000","last_active":"2024-04-25T23:03:08.363585+0000","last_peered":"2024-04-25T23:03:08.363585+0000","last_clean":"2024-04-25T23:03:08.363585+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:03:08.363585+0000","last_undegraded":"2024-04-25T23:03:08.363585+0000","last_fullsized":"2024-04-25T23:03:08.363585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'411","last_scrub_stamp":"2024-04-25T23:03:08.363383+0000","last_deep_scrub":"62'411","last_deep_scrub_stamp":"2024-04-25T23:03:08.363383+0000","last_clean_scrub_stamp":"2024-04-25T23:03:08.363383+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:32.226189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":242,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181572+0000","last_change":"2024-04-25T22:59:05.775427+0000","last_active":"2024-04-25T23:02:42.181572+0000","last_peered":"2024-04-25T23:02:42.181572+0000","last_clean":"2024-04-25T23:02:42.181572+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:02:42.181572+0000","last_undegraded":"2024-04-25T23:02:42.181572+0000","last_fullsized":"2024-04-25T23:02:42.181572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":691,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:05.430436+0000","last_change":"2024-04-25T23:03:05.430498+0000","last_active":"2024-04-25T23:03:05.430436+0000","last_peered":"2024-04-25T23:03:05.430436+0000","last_clean":"2024-04-25T23:03:05.430436+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:03:05.430436+0000","last_undegraded":"2024-04-25T23:03:05.430436+0000","last_fullsized":"2024-04-25T23:03:05.430436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'459","last_scrub_stamp":"2024-04-25T23:03:05.430242+0000","last_deep_scrub":"62'459","last_deep_scrub_stamp":"2024-04-25T23:03:05.430242+0000","last_clean_scrub_stamp":"2024-04-25T23:03:05.430242+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:01.703276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'137","reported_seq":309,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181201+0000","last_change":"2024-04-25T22:59:05.780229+0000","last_active":"2024-04-25T23:02:42.181201+0000","last_peered":"2024-04-25T23:02:42.181201+0000","last_clean":"2024-04-25T23:02:42.181201+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:02:42.181201+0000","last_undegraded":"2024-04-25T23:02:42.181201+0000","last_fullsized":"2024-04-25T23:02:42.181201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":647,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:01.310208+0000","last_change":"2024-04-25T23:03:01.310275+0000","last_active":"2024-04-25T23:03:01.310208+0000","last_peered":"2024-04-25T23:03:01.310208+0000","last_clean":"2024-04-25T23:03:01.310208+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:03:01.310208+0000","last_undegraded":"2024-04-25T23:03:01.310208+0000","last_fullsized":"2024-04-25T23:03:01.310208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'451","last_scrub_stamp":"2024-04-25T23:03:01.310004+0000","last_deep_scrub":"62'451","last_deep_scrub_stamp":"2024-04-25T23:03:01.310004+0000","last_clean_scrub_stamp":"2024-04-25T23:03:01.310004+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:40.379452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'124","reported_seq":296,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180776+0000","last_change":"2024-04-25T22:59:05.787658+0000","last_active":"2024-04-25T23:02:42.180776+0000","last_peered":"2024-04-25T23:02:42.180776+0000","last_clean":"2024-04-25T23:02:42.180776+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:02:42.180776+0000","last_undegraded":"2024-04-25T23:02:42.180776+0000","last_fullsized":"2024-04-25T23:02:42.180776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":987,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180930+0000","last_change":"2024-04-25T23:02:37.180076+0000","last_active":"2024-04-25T23:02:42.180930+0000","last_peered":"2024-04-25T23:02:42.180930+0000","last_clean":"2024-04-25T23:02:42.180930+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:02:42.180930+0000","last_undegraded":"2024-04-25T23:02:42.180930+0000","last_fullsized":"2024-04-25T23:02:42.180930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093388+0000","last_change":"2024-04-25T23:02:15.097287+0000","last_active":"2024-04-25T23:02:42.093388+0000","last_peered":"2024-04-25T23:02:42.093388+0000","last_clean":"2024-04-25T23:02:42.093388+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:02:42.093388+0000","last_undegraded":"2024-04-25T23:02:42.093388+0000","last_fullsized":"2024-04-25T23:02:42.093388+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":916,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:57.238065+0000","last_change":"2024-04-25T23:02:57.238196+0000","last_active":"2024-04-25T23:02:57.238065+0000","last_peered":"2024-04-25T23:02:57.238065+0000","last_clean":"2024-04-25T23:02:57.238065+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:57.238065+0000","last_undegraded":"2024-04-25T23:02:57.238065+0000","last_fullsized":"2024-04-25T23:02:57.238065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'371","last_scrub_stamp":"2024-04-25T23:02:57.237814+0000","last_deep_scrub":"62'371","last_deep_scrub_stamp":"2024-04-25T23:02:57.237814+0000","last_clean_scrub_stamp":"2024-04-25T23:02:57.237814+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:07.627022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'473","reported_seq":635,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093562+0000","last_change":"2024-04-25T23:02:18.094248+0000","last_active":"2024-04-25T23:02:42.093562+0000","last_peered":"2024-04-25T23:02:42.093562+0000","last_clean":"2024-04-25T23:02:42.093562+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:02:42.093562+0000","last_undegraded":"2024-04-25T23:02:42.093562+0000","last_fullsized":"2024-04-25T23:02:42.093562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":946,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181217+0000","last_change":"2024-04-25T23:02:39.182895+0000","last_active":"2024-04-25T23:02:42.181217+0000","last_peered":"2024-04-25T23:02:42.181217+0000","last_clean":"2024-04-25T23:02:42.181217+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:02:42.181217+0000","last_undegraded":"2024-04-25T23:02:42.181217+0000","last_fullsized":"2024-04-25T23:02:42.181217+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"97'159","reported_seq":398,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.241329+0000","last_change":"2024-04-25T23:02:56.241329+0000","last_active":"2024-04-25T23:02:56.241329+0000","last_peered":"2024-04-25T23:02:56.241329+0000","last_clean":"2024-04-25T23:02:56.241329+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:56.241329+0000","last_undegraded":"2024-04-25T23:02:56.241329+0000","last_fullsized":"2024-04-25T23:02:56.241329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'159","last_scrub_stamp":"2024-04-25T23:02:56.241053+0000","last_deep_scrub":"97'159","last_deep_scrub_stamp":"2024-04-25T23:02:56.241053+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.241053+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.725697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181794+0000","last_change":"2024-04-25T22:59:01.742788+0000","last_active":"2024-04-25T23:02:42.181794+0000","last_peered":"2024-04-25T23:02:42.181794+0000","last_clean":"2024-04-25T23:02:42.181794+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:02:42.181794+0000","last_undegraded":"2024-04-25T23:02:42.181794+0000","last_fullsized":"2024-04-25T23:02:42.181794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"97'627","reported_seq":822,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:06.471891+0000","last_change":"2024-04-25T23:03:06.472056+0000","last_active":"2024-04-25T23:03:06.471891+0000","last_peered":"2024-04-25T23:03:06.471891+0000","last_clean":"2024-04-25T23:03:06.471891+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:03:06.471891+0000","last_undegraded":"2024-04-25T23:03:06.471891+0000","last_fullsized":"2024-04-25T23:03:06.471891+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'627","last_scrub_stamp":"2024-04-25T23:03:06.471666+0000","last_deep_scrub":"97'627","last_deep_scrub_stamp":"2024-04-25T23:03:06.471666+0000","last_clean_scrub_stamp":"2024-04-25T23:03:06.471666+0000","objects_scrubbed":2,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:48.722855+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1057,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181633+0000","last_change":"2024-04-25T23:02:38.186471+0000","last_active":"2024-04-25T23:02:42.181633+0000","last_peered":"2024-04-25T23:02:42.181633+0000","last_clean":"2024-04-25T23:02:42.181633+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:02:42.181633+0000","last_undegraded":"2024-04-25T23:02:42.181633+0000","last_fullsized":"2024-04-25T23:02:42.181633+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":186,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:52.152409+0000","last_change":"2024-04-25T23:02:15.191287+0000","last_active":"2024-04-25T23:02:52.152409+0000","last_peered":"2024-04-25T23:02:52.152409+0000","last_clean":"2024-04-25T23:02:52.152409+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:02:52.152409+0000","last_undegraded":"2024-04-25T23:02:52.152409+0000","last_fullsized":"2024-04-25T23:02:52.152409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"62'127","reported_seq":364,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179825+0000","last_change":"2024-04-25T22:59:05.777327+0000","last_active":"2024-04-25T23:02:42.179825+0000","last_peered":"2024-04-25T23:02:42.179825+0000","last_clean":"2024-04-25T23:02:42.179825+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:02:42.179825+0000","last_undegraded":"2024-04-25T23:02:42.179825+0000","last_fullsized":"2024-04-25T23:02:42.179825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095607+0000","last_change":"2024-04-25T23:02:31.089230+0000","last_active":"2024-04-25T23:02:42.095607+0000","last_peered":"2024-04-25T23:02:42.095607+0000","last_clean":"2024-04-25T23:02:42.095607+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:02:42.095607+0000","last_undegraded":"2024-04-25T23:02:42.095607+0000","last_fullsized":"2024-04-25T23:02:42.095607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":193,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:55.345353+0000","last_change":"2024-04-25T23:02:55.345406+0000","last_active":"2024-04-25T23:02:55.345353+0000","last_peered":"2024-04-25T23:02:55.345353+0000","last_clean":"2024-04-25T23:02:55.345353+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:55.345353+0000","last_undegraded":"2024-04-25T23:02:55.345353+0000","last_fullsized":"2024-04-25T23:02:55.345353+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:02:55.345164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:02:55.345164+0000","last_clean_scrub_stamp":"2024-04-25T23:02:55.345164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:41.939421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'336","reported_seq":498,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093065+0000","last_change":"2024-04-25T23:02:18.096350+0000","last_active":"2024-04-25T23:02:42.093065+0000","last_peered":"2024-04-25T23:02:42.093065+0000","last_clean":"2024-04-25T23:02:42.093065+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:02:42.093065+0000","last_undegraded":"2024-04-25T23:02:42.093065+0000","last_fullsized":"2024-04-25T23:02:42.093065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":889,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181533+0000","last_change":"2024-04-25T23:02:40.176356+0000","last_active":"2024-04-25T23:02:42.181533+0000","last_peered":"2024-04-25T23:02:42.181533+0000","last_clean":"2024-04-25T23:02:42.181533+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:02:42.181533+0000","last_undegraded":"2024-04-25T23:02:42.181533+0000","last_fullsized":"2024-04-25T23:02:42.181533+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180765+0000","last_change":"2024-04-25T22:59:01.742718+0000","last_active":"2024-04-25T23:02:42.180765+0000","last_peered":"2024-04-25T23:02:42.180765+0000","last_clean":"2024-04-25T23:02:42.180765+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:02:42.180765+0000","last_undegraded":"2024-04-25T23:02:42.180765+0000","last_fullsized":"2024-04-25T23:02:42.180765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":244,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181601+0000","last_change":"2024-04-25T22:59:05.776155+0000","last_active":"2024-04-25T23:02:42.181601+0000","last_peered":"2024-04-25T23:02:42.181601+0000","last_clean":"2024-04-25T23:02:42.181601+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:02:42.181601+0000","last_undegraded":"2024-04-25T23:02:42.181601+0000","last_fullsized":"2024-04-25T23:02:42.181601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":934,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181413+0000","last_change":"2024-04-25T23:02:30.173119+0000","last_active":"2024-04-25T23:02:42.181413+0000","last_peered":"2024-04-25T23:02:42.181413+0000","last_clean":"2024-04-25T23:02:42.181413+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:02:42.181413+0000","last_undegraded":"2024-04-25T23:02:42.181413+0000","last_fullsized":"2024-04-25T23:02:42.181413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'279","reported_seq":451,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181503+0000","last_change":"2024-04-25T22:59:05.788544+0000","last_active":"2024-04-25T23:02:42.181503+0000","last_peered":"2024-04-25T23:02:42.181503+0000","last_clean":"2024-04-25T23:02:42.181503+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:02:42.181503+0000","last_undegraded":"2024-04-25T23:02:42.181503+0000","last_fullsized":"2024-04-25T23:02:42.181503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.345997+0000","last_change":"2024-04-25T23:02:56.346048+0000","last_active":"2024-04-25T23:02:56.345997+0000","last_peered":"2024-04-25T23:02:56.345997+0000","last_clean":"2024-04-25T23:02:56.345997+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:56.345997+0000","last_undegraded":"2024-04-25T23:02:56.345997+0000","last_fullsized":"2024-04-25T23:02:56.345997+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:02:56.345813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:02:56.345813+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.345813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:13.796244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":522,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.011628+0000","last_change":"2024-04-25T23:02:56.011694+0000","last_active":"2024-04-25T23:02:56.011628+0000","last_peered":"2024-04-25T23:02:56.011628+0000","last_clean":"2024-04-25T23:02:56.011628+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:56.011628+0000","last_undegraded":"2024-04-25T23:02:56.011628+0000","last_fullsized":"2024-04-25T23:02:56.011628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'349","last_scrub_stamp":"2024-04-25T23:02:56.011405+0000","last_deep_scrub":"62'349","last_deep_scrub_stamp":"2024-04-25T23:02:56.011405+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.011405+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.217890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":236,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:54.383225+0000","last_change":"2024-04-25T23:02:54.383287+0000","last_active":"2024-04-25T23:02:54.383225+0000","last_peered":"2024-04-25T23:02:54.383225+0000","last_clean":"2024-04-25T23:02:54.383225+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:54.383225+0000","last_undegraded":"2024-04-25T23:02:54.383225+0000","last_fullsized":"2024-04-25T23:02:54.383225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'49","last_scrub_stamp":"2024-04-25T23:02:54.382996+0000","last_deep_scrub":"61'49","last_deep_scrub_stamp":"2024-04-25T23:02:54.382996+0000","last_clean_scrub_stamp":"2024-04-25T23:02:54.382996+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:33.765600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095724+0000","last_change":"2024-04-25T23:02:15.100115+0000","last_active":"2024-04-25T23:02:42.095724+0000","last_peered":"2024-04-25T23:02:42.095724+0000","last_clean":"2024-04-25T23:02:42.095724+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:02:42.095724+0000","last_undegraded":"2024-04-25T23:02:42.095724+0000","last_fullsized":"2024-04-25T23:02:42.095724+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:00.710585+0000","last_clean_scrub_stamp":"2024-04-25T22:59:00.710585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":617,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:06.924182+0000","last_change":"2024-04-25T23:03:06.924239+0000","last_active":"2024-04-25T23:03:06.924182+0000","last_peered":"2024-04-25T23:03:06.924182+0000","last_clean":"2024-04-25T23:03:06.924182+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:03:06.924182+0000","last_undegraded":"2024-04-25T23:03:06.924182+0000","last_fullsized":"2024-04-25T23:03:06.924182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'404","last_scrub_stamp":"2024-04-25T23:03:06.923982+0000","last_deep_scrub":"62'404","last_deep_scrub_stamp":"2024-04-25T23:03:06.923982+0000","last_clean_scrub_stamp":"2024-04-25T23:03:06.923982+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:51:22.467532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"97'60","reported_seq":248,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:02.530205+0000","last_change":"2024-04-25T23:03:02.530267+0000","last_active":"2024-04-25T23:03:02.530205+0000","last_peered":"2024-04-25T23:03:02.530205+0000","last_clean":"2024-04-25T23:03:02.530205+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:03:02.530205+0000","last_undegraded":"2024-04-25T23:03:02.530205+0000","last_fullsized":"2024-04-25T23:03:02.530205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'60","last_scrub_stamp":"2024-04-25T23:03:02.529991+0000","last_deep_scrub":"97'60","last_deep_scrub_stamp":"2024-04-25T23:03:02.529991+0000","last_clean_scrub_stamp":"2024-04-25T23:03:02.529991+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:41.599439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:00.463705+0000","last_change":"2024-04-25T23:03:00.463757+0000","last_active":"2024-04-25T23:03:00.463705+0000","last_peered":"2024-04-25T23:03:00.463705+0000","last_clean":"2024-04-25T23:03:00.463705+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:03:00.463705+0000","last_undegraded":"2024-04-25T23:03:00.463705+0000","last_fullsized":"2024-04-25T23:03:00.463705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:03:00.463487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:03:00.463487+0000","last_clean_scrub_stamp":"2024-04-25T23:03:00.463487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:25.818659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":583,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:57.377906+0000","last_change":"2024-04-25T23:02:57.377906+0000","last_active":"2024-04-25T23:02:57.377906+0000","last_peered":"2024-04-25T23:02:57.377906+0000","last_clean":"2024-04-25T23:02:57.377906+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:57.377906+0000","last_undegraded":"2024-04-25T23:02:57.377906+0000","last_fullsized":"2024-04-25T23:02:57.377906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'402","last_scrub_stamp":"2024-04-25T23:02:57.377651+0000","last_deep_scrub":"62'402","last_deep_scrub_stamp":"2024-04-25T23:02:57.377651+0000","last_clean_scrub_stamp":"2024-04-25T23:02:57.377651+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:14.862294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"97'107","reported_seq":287,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:10.486975+0000","last_change":"2024-04-25T23:03:10.487039+0000","last_active":"2024-04-25T23:03:10.486975+0000","last_peered":"2024-04-25T23:03:10.486975+0000","last_clean":"2024-04-25T23:03:10.486975+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:03:10.486975+0000","last_undegraded":"2024-04-25T23:03:10.486975+0000","last_fullsized":"2024-04-25T23:03:10.486975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'107","last_scrub_stamp":"2024-04-25T23:03:10.486784+0000","last_deep_scrub":"97'107","last_deep_scrub_stamp":"2024-04-25T23:03:10.486784+0000","last_clean_scrub_stamp":"2024-04-25T23:03:10.486784+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:51.834214+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":193,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:58.282069+0000","last_change":"2024-04-25T23:02:58.282126+0000","last_active":"2024-04-25T23:02:58.282069+0000","last_peered":"2024-04-25T23:02:58.282069+0000","last_clean":"2024-04-25T23:02:58.282069+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:58.282069+0000","last_undegraded":"2024-04-25T23:02:58.282069+0000","last_fullsized":"2024-04-25T23:02:58.282069+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:02:58.281867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:02:58.281867+0000","last_clean_scrub_stamp":"2024-04-25T23:02:58.281867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:05:21.901047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":655,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:02.907496+0000","last_change":"2024-04-25T23:03:02.907635+0000","last_active":"2024-04-25T23:03:02.907496+0000","last_peered":"2024-04-25T23:03:02.907496+0000","last_clean":"2024-04-25T23:03:02.907496+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:03:02.907496+0000","last_undegraded":"2024-04-25T23:03:02.907496+0000","last_fullsized":"2024-04-25T23:03:02.907496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'408","last_scrub_stamp":"2024-04-25T23:03:02.907262+0000","last_deep_scrub":"62'408","last_deep_scrub_stamp":"2024-04-25T23:03:02.907262+0000","last_clean_scrub_stamp":"2024-04-25T23:03:02.907262+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:23:41.423602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1005,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180283+0000","last_change":"2024-04-25T23:02:28.182817+0000","last_active":"2024-04-25T23:02:42.180283+0000","last_peered":"2024-04-25T23:02:42.180283+0000","last_clean":"2024-04-25T23:02:42.180283+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:02:42.180283+0000","last_undegraded":"2024-04-25T23:02:42.180283+0000","last_fullsized":"2024-04-25T23:02:42.180283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"97'252","reported_seq":452,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:54.214870+0000","last_change":"2024-04-25T23:02:54.214951+0000","last_active":"2024-04-25T23:02:54.214870+0000","last_peered":"2024-04-25T23:02:54.214870+0000","last_clean":"2024-04-25T23:02:54.214870+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:54.214870+0000","last_undegraded":"2024-04-25T23:02:54.214870+0000","last_fullsized":"2024-04-25T23:02:54.214870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'252","last_scrub_stamp":"2024-04-25T23:02:54.214687+0000","last_deep_scrub":"97'252","last_deep_scrub_stamp":"2024-04-25T23:02:54.214687+0000","last_clean_scrub_stamp":"2024-04-25T23:02:54.214687+0000","objects_scrubbed":6,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:40.808944+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":997,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179653+0000","last_change":"2024-04-25T23:02:26.178071+0000","last_active":"2024-04-25T23:02:42.179653+0000","last_peered":"2024-04-25T23:02:42.179653+0000","last_clean":"2024-04-25T23:02:42.179653+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:02:42.179653+0000","last_undegraded":"2024-04-25T23:02:42.179653+0000","last_fullsized":"2024-04-25T23:02:42.179653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"62'98","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095205+0000","last_change":"2024-04-25T23:02:15.150974+0000","last_active":"2024-04-25T23:02:42.095205+0000","last_peered":"2024-04-25T23:02:42.095205+0000","last_clean":"2024-04-25T23:02:42.095205+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:02:42.095205+0000","last_undegraded":"2024-04-25T23:02:42.095205+0000","last_fullsized":"2024-04-25T23:02:42.095205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"61'209","reported_seq":381,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181365+0000","last_change":"2024-04-25T22:59:05.778129+0000","last_active":"2024-04-25T23:02:42.181365+0000","last_peered":"2024-04-25T23:02:42.181365+0000","last_clean":"2024-04-25T23:02:42.181365+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:02:42.181365+0000","last_undegraded":"2024-04-25T23:02:42.181365+0000","last_fullsized":"2024-04-25T23:02:42.181365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":685,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:07.476236+0000","last_change":"2024-04-25T23:03:07.476378+0000","last_active":"2024-04-25T23:03:07.476236+0000","last_peered":"2024-04-25T23:03:07.476236+0000","last_clean":"2024-04-25T23:03:07.476236+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:03:07.476236+0000","last_undegraded":"2024-04-25T23:03:07.476236+0000","last_fullsized":"2024-04-25T23:03:07.476236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'482","last_scrub_stamp":"2024-04-25T23:03:07.475983+0000","last_deep_scrub":"62'482","last_deep_scrub_stamp":"2024-04-25T23:03:07.475983+0000","last_clean_scrub_stamp":"2024-04-25T23:03:07.475983+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:29.109756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":236,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181764+0000","last_change":"2024-04-25T22:59:05.779124+0000","last_active":"2024-04-25T23:02:42.181764+0000","last_peered":"2024-04-25T23:02:42.181764+0000","last_clean":"2024-04-25T23:02:42.181764+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:02:42.181764+0000","last_undegraded":"2024-04-25T23:02:42.181764+0000","last_fullsized":"2024-04-25T23:02:42.181764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1042,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.179510+0000","last_change":"2024-04-25T23:02:33.179274+0000","last_active":"2024-04-25T23:02:42.179510+0000","last_peered":"2024-04-25T23:02:42.179510+0000","last_clean":"2024-04-25T23:02:42.179510+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:02:42.179510+0000","last_undegraded":"2024-04-25T23:02:42.179510+0000","last_fullsized":"2024-04-25T23:02:42.179510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":512,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:00.956884+0000","last_change":"2024-04-25T23:03:00.957016+0000","last_active":"2024-04-25T23:03:00.956884+0000","last_peered":"2024-04-25T23:03:00.956884+0000","last_clean":"2024-04-25T23:03:00.956884+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:03:00.956884+0000","last_undegraded":"2024-04-25T23:03:00.956884+0000","last_fullsized":"2024-04-25T23:03:00.956884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'344","last_scrub_stamp":"2024-04-25T23:03:00.956653+0000","last_deep_scrub":"62'344","last_deep_scrub_stamp":"2024-04-25T23:03:00.956653+0000","last_clean_scrub_stamp":"2024-04-25T23:03:00.956653+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:00:21.663550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"97'571","reported_seq":766,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:04.492404+0000","last_change":"2024-04-25T23:03:04.492471+0000","last_active":"2024-04-25T23:03:04.492404+0000","last_peered":"2024-04-25T23:03:04.492404+0000","last_clean":"2024-04-25T23:03:04.492404+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:03:04.492404+0000","last_undegraded":"2024-04-25T23:03:04.492404+0000","last_fullsized":"2024-04-25T23:03:04.492404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'571","last_scrub_stamp":"2024-04-25T23:03:04.492162+0000","last_deep_scrub":"97'571","last_deep_scrub_stamp":"2024-04-25T23:03:04.492162+0000","last_clean_scrub_stamp":"2024-04-25T23:03:04.492162+0000","objects_scrubbed":2,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:31.037124+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":647,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:03.492724+0000","last_change":"2024-04-25T23:03:03.492724+0000","last_active":"2024-04-25T23:03:03.492724+0000","last_peered":"2024-04-25T23:03:03.492724+0000","last_clean":"2024-04-25T23:03:03.492724+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:03:03.492724+0000","last_undegraded":"2024-04-25T23:03:03.492724+0000","last_fullsized":"2024-04-25T23:03:03.492724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'423","last_scrub_stamp":"2024-04-25T23:03:03.492465+0000","last_deep_scrub":"62'423","last_deep_scrub_stamp":"2024-04-25T23:03:03.492465+0000","last_clean_scrub_stamp":"2024-04-25T23:03:03.492465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:18.974583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'202","reported_seq":374,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180182+0000","last_change":"2024-04-25T22:59:05.779266+0000","last_active":"2024-04-25T23:02:42.180182+0000","last_peered":"2024-04-25T23:02:42.180182+0000","last_clean":"2024-04-25T23:02:42.180182+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:02:42.180182+0000","last_undegraded":"2024-04-25T23:02:42.180182+0000","last_fullsized":"2024-04-25T23:02:42.180182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":591,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.095035+0000","last_change":"2024-04-25T23:02:34.103537+0000","last_active":"2024-04-25T23:02:42.095035+0000","last_peered":"2024-04-25T23:02:42.095035+0000","last_clean":"2024-04-25T23:02:42.095035+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:02:42.095035+0000","last_undegraded":"2024-04-25T23:02:42.095035+0000","last_fullsized":"2024-04-25T23:02:42.095035+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"61'219","reported_seq":381,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.093753+0000","last_change":"2024-04-25T23:02:18.094275+0000","last_active":"2024-04-25T23:02:42.093753+0000","last_peered":"2024-04-25T23:02:42.093753+0000","last_clean":"2024-04-25T23:02:42.093753+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:02:42.093753+0000","last_undegraded":"2024-04-25T23:02:42.093753+0000","last_fullsized":"2024-04-25T23:02:42.093753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":552,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:03.921651+0000","last_change":"2024-04-25T23:03:03.921707+0000","last_active":"2024-04-25T23:03:03.921651+0000","last_peered":"2024-04-25T23:03:03.921651+0000","last_clean":"2024-04-25T23:03:03.921651+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:03:03.921651+0000","last_undegraded":"2024-04-25T23:03:03.921651+0000","last_fullsized":"2024-04-25T23:03:03.921651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'384","last_scrub_stamp":"2024-04-25T23:03:03.921450+0000","last_deep_scrub":"62'384","last_deep_scrub_stamp":"2024-04-25T23:03:03.921450+0000","last_clean_scrub_stamp":"2024-04-25T23:03:03.921450+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:02.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"61'52","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094055+0000","last_change":"2024-04-25T23:02:15.146809+0000","last_active":"2024-04-25T23:02:42.094055+0000","last_peered":"2024-04-25T23:02:42.094055+0000","last_clean":"2024-04-25T23:02:42.094055+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:02:42.094055+0000","last_undegraded":"2024-04-25T23:02:42.094055+0000","last_fullsized":"2024-04-25T23:02:42.094055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":605,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:59.317855+0000","last_change":"2024-04-25T23:02:59.317973+0000","last_active":"2024-04-25T23:02:59.317855+0000","last_peered":"2024-04-25T23:02:59.317855+0000","last_clean":"2024-04-25T23:02:59.317855+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:59.317855+0000","last_undegraded":"2024-04-25T23:02:59.317855+0000","last_fullsized":"2024-04-25T23:02:59.317855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'384","last_scrub_stamp":"2024-04-25T23:02:59.317511+0000","last_deep_scrub":"62'384","last_deep_scrub_stamp":"2024-04-25T23:02:59.317511+0000","last_clean_scrub_stamp":"2024-04-25T23:02:59.317511+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:37.927492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'202","reported_seq":374,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181440+0000","last_change":"2024-04-25T22:59:05.789044+0000","last_active":"2024-04-25T23:02:42.181440+0000","last_peered":"2024-04-25T23:02:42.181440+0000","last_clean":"2024-04-25T23:02:42.181440+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:02:42.181440+0000","last_undegraded":"2024-04-25T23:02:42.181440+0000","last_fullsized":"2024-04-25T23:02:42.181440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":659,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180446+0000","last_change":"2024-04-25T22:59:06.797064+0000","last_active":"2024-04-25T23:02:42.180446+0000","last_peered":"2024-04-25T23:02:42.180446+0000","last_clean":"2024-04-25T23:02:42.180446+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:02:42.180446+0000","last_undegraded":"2024-04-25T23:02:42.180446+0000","last_fullsized":"2024-04-25T23:02:42.180446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'274","reported_seq":445,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.094740+0000","last_change":"2024-04-25T23:02:18.096108+0000","last_active":"2024-04-25T23:02:42.094740+0000","last_peered":"2024-04-25T23:02:42.094740+0000","last_clean":"2024-04-25T23:02:42.094740+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:02:42.094740+0000","last_undegraded":"2024-04-25T23:02:42.094740+0000","last_fullsized":"2024-04-25T23:02:42.094740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":654,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.980962+0000","last_change":"2024-04-25T23:02:56.981027+0000","last_active":"2024-04-25T23:02:56.980962+0000","last_peered":"2024-04-25T23:02:56.980962+0000","last_clean":"2024-04-25T23:02:56.980962+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:56.980962+0000","last_undegraded":"2024-04-25T23:02:56.980962+0000","last_fullsized":"2024-04-25T23:02:56.980962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'454","last_scrub_stamp":"2024-04-25T23:02:56.980762+0000","last_deep_scrub":"62'454","last_deep_scrub_stamp":"2024-04-25T23:02:56.980762+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.980762+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:54.804590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"97'60","reported_seq":253,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:58.440468+0000","last_change":"2024-04-25T23:02:58.440468+0000","last_active":"2024-04-25T23:02:58.440468+0000","last_peered":"2024-04-25T23:02:58.440468+0000","last_clean":"2024-04-25T23:02:58.440468+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:58.440468+0000","last_undegraded":"2024-04-25T23:02:58.440468+0000","last_fullsized":"2024-04-25T23:02:58.440468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'60","last_scrub_stamp":"2024-04-25T23:02:58.440212+0000","last_deep_scrub":"97'60","last_deep_scrub_stamp":"2024-04-25T23:02:58.440212+0000","last_clean_scrub_stamp":"2024-04-25T23:02:58.440212+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:08.829420+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":658,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.180062+0000","last_change":"2024-04-25T22:59:06.809016+0000","last_active":"2024-04-25T23:02:42.180062+0000","last_peered":"2024-04-25T23:02:42.180062+0000","last_clean":"2024-04-25T23:02:42.180062+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:02:42.180062+0000","last_undegraded":"2024-04-25T23:02:42.180062+0000","last_fullsized":"2024-04-25T23:02:42.180062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:05.744631+0000","last_clean_scrub_stamp":"2024-04-25T22:59:05.744631+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'116","reported_seq":288,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:42.181587+0000","last_change":"2024-04-25T22:59:05.779423+0000","last_active":"2024-04-25T23:02:42.181587+0000","last_peered":"2024-04-25T23:02:42.181587+0000","last_clean":"2024-04-25T23:02:42.181587+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:02:42.181587+0000","last_undegraded":"2024-04-25T23:02:42.181587+0000","last_fullsized":"2024-04-25T23:02:42.181587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:59:04.735940+0000","last_clean_scrub_stamp":"2024-04-25T22:59:04.735940+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6483,"ondisk_log_size":6483,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743437,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142124,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229716,"statfs":{"total":96636764160,"available":96491229184,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161236,"kb_used_data":80140,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94210604,"statfs":{"total":96636764160,"available":96471658496,"internally_reserved":0,"allocated":82063360,"data_stored":81566497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179016,"kb_used_data":89600,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192824,"statfs":{"total":96636764160,"available":96453451776,"internally_reserved":0,"allocated":91750400,"data_stored":91229381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:03:13.808 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.808 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.808 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.808 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.808 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.808 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.809 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.809 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.809 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.809 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.809 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.809 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.809 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.810 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.811 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.812 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T22:59:00.710585+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.813 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T22:59:05.744631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.814 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T22:59:04.735940+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=59, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=2, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T23:03:13.815 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T23:03:33.816 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:03:34.141 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:03:34.143 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T23:03:34.157 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-04-25T23:03:32.614120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128569219,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2690,"num_read_kb":1283034,"num_write":29504,"num_write_kb":4504427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7488,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33309,"ondisk_log_size":33309,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":482376,"kb_used_data":253808,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282633144,"statfs":{"total":289910292480,"available":289416339456,"internally_reserved":0,"allocated":259899392,"data_stored":258365132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9195,"internal_metadata":234019861},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004335"},"pg_stats":[{"pgid":"4.3f","version":"62'436","reported_seq":617,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:26.059252+0000","last_change":"2024-04-25T23:03:26.059310+0000","last_active":"2024-04-25T23:03:26.059252+0000","last_peered":"2024-04-25T23:03:26.059252+0000","last_clean":"2024-04-25T23:03:26.059252+0000","last_became_active":"2024-04-25T23:02:40.083927+0000","last_became_peered":"2024-04-25T23:02:40.083927+0000","last_unstale":"2024-04-25T23:03:26.059252+0000","last_undegraded":"2024-04-25T23:03:26.059252+0000","last_fullsized":"2024-04-25T23:03:26.059252+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'436","last_scrub_stamp":"2024-04-25T23:03:26.059053+0000","last_deep_scrub":"62'436","last_deep_scrub_stamp":"2024-04-25T23:03:26.059053+0000","last_clean_scrub_stamp":"2024-04-25T23:03:26.059053+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:14.080336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27225,"num_write":407,"num_write_kb":105123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"62'427","reported_seq":610,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:24.040859+0000","last_change":"2024-04-25T23:03:24.040917+0000","last_active":"2024-04-25T23:03:24.040859+0000","last_peered":"2024-04-25T23:03:24.040859+0000","last_clean":"2024-04-25T23:03:24.040859+0000","last_became_active":"2024-04-25T23:02:37.086488+0000","last_became_peered":"2024-04-25T23:02:37.086488+0000","last_unstale":"2024-04-25T23:03:24.040859+0000","last_undegraded":"2024-04-25T23:03:24.040859+0000","last_fullsized":"2024-04-25T23:03:24.040859+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'427","last_scrub_stamp":"2024-04-25T23:03:24.040672+0000","last_deep_scrub":"62'427","last_deep_scrub_stamp":"2024-04-25T23:03:24.040672+0000","last_clean_scrub_stamp":"2024-04-25T23:03:24.040672+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:59.138137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32955,"num_write":394,"num_write_kb":96124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"62'380","reported_seq":921,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:27.314548+0000","last_change":"2024-04-25T23:03:27.314611+0000","last_active":"2024-04-25T23:03:27.314548+0000","last_peered":"2024-04-25T23:03:27.314548+0000","last_clean":"2024-04-25T23:03:27.314548+0000","last_became_active":"2024-04-25T23:02:35.175563+0000","last_became_peered":"2024-04-25T23:02:35.175563+0000","last_unstale":"2024-04-25T23:03:27.314548+0000","last_undegraded":"2024-04-25T23:03:27.314548+0000","last_fullsized":"2024-04-25T23:03:27.314548+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'380","last_scrub_stamp":"2024-04-25T23:03:27.314343+0000","last_deep_scrub":"62'380","last_deep_scrub_stamp":"2024-04-25T23:03:27.314343+0000","last_clean_scrub_stamp":"2024-04-25T23:03:27.314343+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:33:53.803533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6944,"num_write":356,"num_write_kb":63341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'376","reported_seq":585,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:03.285532+0000","last_change":"2024-04-25T23:03:03.285532+0000","last_active":"2024-04-25T23:03:03.285532+0000","last_peered":"2024-04-25T23:03:03.285532+0000","last_clean":"2024-04-25T23:03:03.285532+0000","last_became_active":"2024-04-25T22:59:06.803733+0000","last_became_peered":"2024-04-25T22:59:06.803733+0000","last_unstale":"2024-04-25T23:03:03.285532+0000","last_undegraded":"2024-04-25T23:03:03.285532+0000","last_fullsized":"2024-04-25T23:03:03.285532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'376","last_scrub_stamp":"2024-04-25T23:03:03.285265+0000","last_deep_scrub":"62'376","last_deep_scrub_stamp":"2024-04-25T23:03:03.285265+0000","last_clean_scrub_stamp":"2024-04-25T23:03:03.285265+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:29.830226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10216,"num_write":342,"num_write_kb":30446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"62'457","reported_seq":661,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:57.938369+0000","last_change":"2024-04-25T23:02:57.938503+0000","last_active":"2024-04-25T23:02:57.938369+0000","last_peered":"2024-04-25T23:02:57.938369+0000","last_clean":"2024-04-25T23:02:57.938369+0000","last_became_active":"2024-04-25T23:02:25.081524+0000","last_became_peered":"2024-04-25T23:02:25.081524+0000","last_unstale":"2024-04-25T23:02:57.938369+0000","last_undegraded":"2024-04-25T23:02:57.938369+0000","last_fullsized":"2024-04-25T23:02:57.938369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'457","last_scrub_stamp":"2024-04-25T23:02:57.938083+0000","last_deep_scrub":"62'457","last_deep_scrub_stamp":"2024-04-25T23:02:57.938083+0000","last_clean_scrub_stamp":"2024-04-25T23:02:57.938083+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:35.315353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29499,"num_write":429,"num_write_kb":73995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"62'369","reported_seq":560,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:06.365851+0000","last_change":"2024-04-25T23:03:06.365913+0000","last_active":"2024-04-25T23:03:06.365851+0000","last_peered":"2024-04-25T23:03:06.365851+0000","last_clean":"2024-04-25T23:03:06.365851+0000","last_became_active":"2024-04-25T22:59:06.798764+0000","last_became_peered":"2024-04-25T22:59:06.798764+0000","last_unstale":"2024-04-25T23:03:06.365851+0000","last_undegraded":"2024-04-25T23:03:06.365851+0000","last_fullsized":"2024-04-25T23:03:06.365851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'369","last_scrub_stamp":"2024-04-25T23:03:06.365652+0000","last_deep_scrub":"62'369","last_deep_scrub_stamp":"2024-04-25T23:03:06.365652+0000","last_clean_scrub_stamp":"2024-04-25T23:03:06.365652+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:08.242544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3388,"num_write":337,"num_write_kb":28589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"62'402","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:10.312232+0000","last_change":"2024-04-25T23:03:10.312392+0000","last_active":"2024-04-25T23:03:10.312232+0000","last_peered":"2024-04-25T23:03:10.312232+0000","last_clean":"2024-04-25T23:03:10.312232+0000","last_became_active":"2024-04-25T22:59:06.797250+0000","last_became_peered":"2024-04-25T22:59:06.797250+0000","last_unstale":"2024-04-25T23:03:10.312232+0000","last_undegraded":"2024-04-25T23:03:10.312232+0000","last_fullsized":"2024-04-25T23:03:10.312232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'402","last_scrub_stamp":"2024-04-25T23:03:10.312005+0000","last_deep_scrub":"62'402","last_deep_scrub_stamp":"2024-04-25T23:03:10.312005+0000","last_clean_scrub_stamp":"2024-04-25T23:03:10.312005+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:38.565569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8867,"num_write":374,"num_write_kb":42491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"62'375","reported_seq":593,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:09.341515+0000","last_change":"2024-04-25T23:03:09.341576+0000","last_active":"2024-04-25T23:03:09.341515+0000","last_peered":"2024-04-25T23:03:09.341515+0000","last_clean":"2024-04-25T23:03:09.341515+0000","last_became_active":"2024-04-25T22:59:06.805845+0000","last_became_peered":"2024-04-25T22:59:06.805845+0000","last_unstale":"2024-04-25T23:03:09.341515+0000","last_undegraded":"2024-04-25T23:03:09.341515+0000","last_fullsized":"2024-04-25T23:03:09.341515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'375","last_scrub_stamp":"2024-04-25T23:03:09.341315+0000","last_deep_scrub":"62'375","last_deep_scrub_stamp":"2024-04-25T23:03:09.341315+0000","last_clean_scrub_stamp":"2024-04-25T23:03:09.341315+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:50:27.205651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":17170,"num_write":334,"num_write_kb":55653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"62'392","reported_seq":945,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:22.443805+0000","last_change":"2024-04-25T23:03:22.443871+0000","last_active":"2024-04-25T23:03:22.443805+0000","last_peered":"2024-04-25T23:03:22.443805+0000","last_clean":"2024-04-25T23:03:22.443805+0000","last_became_active":"2024-04-25T23:02:38.183177+0000","last_became_peered":"2024-04-25T23:02:38.183177+0000","last_unstale":"2024-04-25T23:03:22.443805+0000","last_undegraded":"2024-04-25T23:03:22.443805+0000","last_fullsized":"2024-04-25T23:03:22.443805+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'392","last_scrub_stamp":"2024-04-25T23:03:22.443578+0000","last_deep_scrub":"62'392","last_deep_scrub_stamp":"2024-04-25T23:03:22.443578+0000","last_clean_scrub_stamp":"2024-04-25T23:03:22.443578+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:10.933413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2152,"num_write":360,"num_write_kb":21652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"62'389","reported_seq":550,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:20.001837+0000","last_change":"2024-04-25T23:03:20.001893+0000","last_active":"2024-04-25T23:03:20.001837+0000","last_peered":"2024-04-25T23:03:20.001837+0000","last_clean":"2024-04-25T23:03:20.001837+0000","last_became_active":"2024-04-25T23:02:32.082845+0000","last_became_peered":"2024-04-25T23:02:32.082845+0000","last_unstale":"2024-04-25T23:03:20.001837+0000","last_undegraded":"2024-04-25T23:03:20.001837+0000","last_fullsized":"2024-04-25T23:03:20.001837+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'389","last_scrub_stamp":"2024-04-25T23:03:20.001636+0000","last_deep_scrub":"62'389","last_deep_scrub_stamp":"2024-04-25T23:03:20.001636+0000","last_clean_scrub_stamp":"2024-04-25T23:03:20.001636+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:06.617666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6575,"num_write":348,"num_write_kb":43005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"62'390","reported_seq":607,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:04.323634+0000","last_change":"2024-04-25T23:03:04.323827+0000","last_active":"2024-04-25T23:03:04.323634+0000","last_peered":"2024-04-25T23:03:04.323634+0000","last_clean":"2024-04-25T23:03:04.323634+0000","last_became_active":"2024-04-25T22:59:06.803151+0000","last_became_peered":"2024-04-25T22:59:06.803151+0000","last_unstale":"2024-04-25T23:03:04.323634+0000","last_undegraded":"2024-04-25T23:03:04.323634+0000","last_fullsized":"2024-04-25T23:03:04.323634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'390","last_scrub_stamp":"2024-04-25T23:03:04.323410+0000","last_deep_scrub":"62'390","last_deep_scrub_stamp":"2024-04-25T23:03:04.323410+0000","last_clean_scrub_stamp":"2024-04-25T23:03:04.323410+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:45.039133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17482,"num_write":367,"num_write_kb":79444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'359","reported_seq":533,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:59.926287+0000","last_change":"2024-04-25T23:02:59.926353+0000","last_active":"2024-04-25T23:02:59.926287+0000","last_peered":"2024-04-25T23:02:59.926287+0000","last_clean":"2024-04-25T23:02:59.926287+0000","last_became_active":"2024-04-25T23:02:26.084806+0000","last_became_peered":"2024-04-25T23:02:26.084806+0000","last_unstale":"2024-04-25T23:02:59.926287+0000","last_undegraded":"2024-04-25T23:02:59.926287+0000","last_fullsized":"2024-04-25T23:02:59.926287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'359","last_scrub_stamp":"2024-04-25T23:02:59.926092+0000","last_deep_scrub":"62'359","last_deep_scrub_stamp":"2024-04-25T23:02:59.926092+0000","last_clean_scrub_stamp":"2024-04-25T23:02:59.926092+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:19.043551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9999,"num_write":331,"num_write_kb":46391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"62'366","reported_seq":493,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:27.071359+0000","last_change":"2024-04-25T23:03:27.071529+0000","last_active":"2024-04-25T23:03:27.071359+0000","last_peered":"2024-04-25T23:03:27.071359+0000","last_clean":"2024-04-25T23:03:27.071359+0000","last_became_active":"2024-04-25T23:02:42.096573+0000","last_became_peered":"2024-04-25T23:02:42.096573+0000","last_unstale":"2024-04-25T23:03:27.071359+0000","last_undegraded":"2024-04-25T23:03:27.071359+0000","last_fullsized":"2024-04-25T23:03:27.071359+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'366","last_scrub_stamp":"2024-04-25T23:03:27.071135+0000","last_deep_scrub":"62'366","last_deep_scrub_stamp":"2024-04-25T23:03:27.071135+0000","last_clean_scrub_stamp":"2024-04-25T23:03:27.071135+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:26.959925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":334,"num_write_kb":21724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"62'442","reported_seq":1039,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:25.339530+0000","last_change":"2024-04-25T23:03:25.339591+0000","last_active":"2024-04-25T23:03:25.339530+0000","last_peered":"2024-04-25T23:03:25.339530+0000","last_clean":"2024-04-25T23:03:25.339530+0000","last_became_active":"2024-04-25T23:02:27.176118+0000","last_became_peered":"2024-04-25T23:02:27.176118+0000","last_unstale":"2024-04-25T23:03:25.339530+0000","last_undegraded":"2024-04-25T23:03:25.339530+0000","last_fullsized":"2024-04-25T23:03:25.339530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'442","last_scrub_stamp":"2024-04-25T23:03:25.339328+0000","last_deep_scrub":"62'442","last_deep_scrub_stamp":"2024-04-25T23:03:25.339328+0000","last_clean_scrub_stamp":"2024-04-25T23:03:25.339328+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:57.526652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16976,"num_write":409,"num_write_kb":96109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"62'415","reported_seq":987,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:24.361764+0000","last_change":"2024-04-25T23:03:24.361887+0000","last_active":"2024-04-25T23:03:24.361764+0000","last_peered":"2024-04-25T23:03:24.361764+0000","last_clean":"2024-04-25T23:03:24.361764+0000","last_became_active":"2024-04-25T23:02:24.200710+0000","last_became_peered":"2024-04-25T23:02:24.200710+0000","last_unstale":"2024-04-25T23:03:24.361764+0000","last_undegraded":"2024-04-25T23:03:24.361764+0000","last_fullsized":"2024-04-25T23:03:24.361764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'415","last_scrub_stamp":"2024-04-25T23:03:24.361537+0000","last_deep_scrub":"62'415","last_deep_scrub_stamp":"2024-04-25T23:03:24.361537+0000","last_clean_scrub_stamp":"2024-04-25T23:03:24.361537+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:16.984998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17635,"num_write":375,"num_write_kb":72282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"62'426","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:00.319428+0000","last_change":"2024-04-25T23:03:00.319582+0000","last_active":"2024-04-25T23:03:00.319428+0000","last_peered":"2024-04-25T23:03:00.319428+0000","last_clean":"2024-04-25T23:03:00.319428+0000","last_became_active":"2024-04-25T22:59:06.798467+0000","last_became_peered":"2024-04-25T22:59:06.798467+0000","last_unstale":"2024-04-25T23:03:00.319428+0000","last_undegraded":"2024-04-25T23:03:00.319428+0000","last_fullsized":"2024-04-25T23:03:00.319428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'426","last_scrub_stamp":"2024-04-25T23:03:00.319163+0000","last_deep_scrub":"62'426","last_deep_scrub_stamp":"2024-04-25T23:03:00.319163+0000","last_clean_scrub_stamp":"2024-04-25T23:03:00.319163+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:28.406086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20803,"num_write":389,"num_write_kb":30441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"62'461","reported_seq":1073,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:25.434877+0000","last_change":"2024-04-25T23:03:25.434943+0000","last_active":"2024-04-25T23:03:25.434877+0000","last_peered":"2024-04-25T23:03:25.434877+0000","last_clean":"2024-04-25T23:03:25.434877+0000","last_became_active":"2024-04-25T23:02:41.176566+0000","last_became_peered":"2024-04-25T23:02:41.176566+0000","last_unstale":"2024-04-25T23:03:25.434877+0000","last_undegraded":"2024-04-25T23:03:25.434877+0000","last_fullsized":"2024-04-25T23:03:25.434877+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'461","last_scrub_stamp":"2024-04-25T23:03:25.434679+0000","last_deep_scrub":"62'461","last_deep_scrub_stamp":"2024-04-25T23:03:25.434679+0000","last_clean_scrub_stamp":"2024-04-25T23:03:25.434679+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:18.058140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28233,"num_write":427,"num_write_kb":125505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"62'416","reported_seq":608,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:21.013092+0000","last_change":"2024-04-25T23:03:21.013150+0000","last_active":"2024-04-25T23:03:21.013092+0000","last_peered":"2024-04-25T23:03:21.013092+0000","last_clean":"2024-04-25T23:03:21.013092+0000","last_became_active":"2024-04-25T23:02:34.090351+0000","last_became_peered":"2024-04-25T23:02:34.090351+0000","last_unstale":"2024-04-25T23:03:21.013092+0000","last_undegraded":"2024-04-25T23:03:21.013092+0000","last_fullsized":"2024-04-25T23:03:21.013092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'416","last_scrub_stamp":"2024-04-25T23:03:21.012901+0000","last_deep_scrub":"62'416","last_deep_scrub_stamp":"2024-04-25T23:03:21.012901+0000","last_clean_scrub_stamp":"2024-04-25T23:03:21.012901+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:35.603831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28831,"num_write":382,"num_write_kb":75494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"62'458","reported_seq":1116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:08.494921+0000","last_change":"2024-04-25T23:03:08.495079+0000","last_active":"2024-04-25T23:03:08.494921+0000","last_peered":"2024-04-25T23:03:08.494921+0000","last_clean":"2024-04-25T23:03:08.494921+0000","last_became_active":"2024-04-25T23:02:19.198785+0000","last_became_peered":"2024-04-25T23:02:19.198785+0000","last_unstale":"2024-04-25T23:03:08.494921+0000","last_undegraded":"2024-04-25T23:03:08.494921+0000","last_fullsized":"2024-04-25T23:03:08.494921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'458","last_scrub_stamp":"2024-04-25T23:03:08.494601+0000","last_deep_scrub":"62'458","last_deep_scrub_stamp":"2024-04-25T23:03:08.494601+0000","last_clean_scrub_stamp":"2024-04-25T23:03:08.494601+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:20:56.965750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49436,"num_write":418,"num_write_kb":104542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'424","reported_seq":609,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:05.371453+0000","last_change":"2024-04-25T23:03:05.371622+0000","last_active":"2024-04-25T23:03:05.371453+0000","last_peered":"2024-04-25T23:03:05.371453+0000","last_clean":"2024-04-25T23:03:05.371453+0000","last_became_active":"2024-04-25T22:59:06.805484+0000","last_became_peered":"2024-04-25T22:59:06.805484+0000","last_unstale":"2024-04-25T23:03:05.371453+0000","last_undegraded":"2024-04-25T23:03:05.371453+0000","last_fullsized":"2024-04-25T23:03:05.371453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'424","last_scrub_stamp":"2024-04-25T23:03:05.371199+0000","last_deep_scrub":"62'424","last_deep_scrub_stamp":"2024-04-25T23:03:05.371199+0000","last_clean_scrub_stamp":"2024-04-25T23:03:05.371199+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:47.622388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4346,"num_write":393,"num_write_kb":67253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"62'421","reported_seq":652,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:02.327170+0000","last_change":"2024-04-25T23:03:02.327229+0000","last_active":"2024-04-25T23:03:02.327170+0000","last_peered":"2024-04-25T23:03:02.327170+0000","last_clean":"2024-04-25T23:03:02.327170+0000","last_became_active":"2024-04-25T22:59:06.802807+0000","last_became_peered":"2024-04-25T22:59:06.802807+0000","last_unstale":"2024-04-25T23:03:02.327170+0000","last_undegraded":"2024-04-25T23:03:02.327170+0000","last_fullsized":"2024-04-25T23:03:02.327170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'421","last_scrub_stamp":"2024-04-25T23:03:02.326960+0000","last_deep_scrub":"62'421","last_deep_scrub_stamp":"2024-04-25T23:03:02.326960+0000","last_clean_scrub_stamp":"2024-04-25T23:03:02.326960+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:31.845124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":18981,"num_write":396,"num_write_kb":47627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"62'463","reported_seq":677,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:54.987658+0000","last_change":"2024-04-25T23:02:54.987725+0000","last_active":"2024-04-25T23:02:54.987658+0000","last_peered":"2024-04-25T23:02:54.987658+0000","last_clean":"2024-04-25T23:02:54.987658+0000","last_became_active":"2024-04-25T23:02:32.084933+0000","last_became_peered":"2024-04-25T23:02:32.084933+0000","last_unstale":"2024-04-25T23:02:54.987658+0000","last_undegraded":"2024-04-25T23:02:54.987658+0000","last_fullsized":"2024-04-25T23:02:54.987658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'463","last_scrub_stamp":"2024-04-25T23:02:54.987464+0000","last_deep_scrub":"62'463","last_deep_scrub_stamp":"2024-04-25T23:02:54.987464+0000","last_clean_scrub_stamp":"2024-04-25T23:02:54.987464+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:04.687394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44474,"num_write":433,"num_write_kb":113047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"62'397","reported_seq":590,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:09.487880+0000","last_change":"2024-04-25T23:03:09.487943+0000","last_active":"2024-04-25T23:03:09.487880+0000","last_peered":"2024-04-25T23:03:09.487880+0000","last_clean":"2024-04-25T23:03:09.487880+0000","last_became_active":"2024-04-25T22:59:06.789672+0000","last_became_peered":"2024-04-25T22:59:06.789672+0000","last_unstale":"2024-04-25T23:03:09.487880+0000","last_undegraded":"2024-04-25T23:03:09.487880+0000","last_fullsized":"2024-04-25T23:03:09.487880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'397","last_scrub_stamp":"2024-04-25T23:03:09.487673+0000","last_deep_scrub":"62'397","last_deep_scrub_stamp":"2024-04-25T23:03:09.487673+0000","last_clean_scrub_stamp":"2024-04-25T23:03:09.487673+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:59.348201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":2248,"num_write":363,"num_write_kb":42937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"62'464","reported_seq":654,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:22.994702+0000","last_change":"2024-04-25T23:03:22.994767+0000","last_active":"2024-04-25T23:03:22.994702+0000","last_peered":"2024-04-25T23:03:22.994702+0000","last_clean":"2024-04-25T23:03:22.994702+0000","last_became_active":"2024-04-25T23:02:36.083587+0000","last_became_peered":"2024-04-25T23:02:36.083587+0000","last_unstale":"2024-04-25T23:03:22.994702+0000","last_undegraded":"2024-04-25T23:03:22.994702+0000","last_fullsized":"2024-04-25T23:03:22.994702+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'464","last_scrub_stamp":"2024-04-25T23:03:22.994508+0000","last_deep_scrub":"62'464","last_deep_scrub_stamp":"2024-04-25T23:03:22.994508+0000","last_clean_scrub_stamp":"2024-04-25T23:03:22.994508+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:51.630737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":29700,"num_write":440,"num_write_kb":104789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"62'430","reported_seq":634,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:53.959504+0000","last_change":"2024-04-25T23:02:53.959567+0000","last_active":"2024-04-25T23:02:53.959504+0000","last_peered":"2024-04-25T23:02:53.959504+0000","last_clean":"2024-04-25T23:02:53.959504+0000","last_became_active":"2024-04-25T23:02:33.087689+0000","last_became_peered":"2024-04-25T23:02:33.087689+0000","last_unstale":"2024-04-25T23:02:53.959504+0000","last_undegraded":"2024-04-25T23:02:53.959504+0000","last_fullsized":"2024-04-25T23:02:53.959504+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'430","last_scrub_stamp":"2024-04-25T23:02:53.959281+0000","last_deep_scrub":"62'430","last_deep_scrub_stamp":"2024-04-25T23:02:53.959281+0000","last_clean_scrub_stamp":"2024-04-25T23:02:53.959281+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:03.330188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39725,"num_write":417,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"62'464","reported_seq":672,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:01.513616+0000","last_change":"2024-04-25T23:03:01.513616+0000","last_active":"2024-04-25T23:03:01.513616+0000","last_peered":"2024-04-25T23:03:01.513616+0000","last_clean":"2024-04-25T23:03:01.513616+0000","last_became_active":"2024-04-25T22:59:06.794865+0000","last_became_peered":"2024-04-25T22:59:06.794865+0000","last_unstale":"2024-04-25T23:03:01.513616+0000","last_undegraded":"2024-04-25T23:03:01.513616+0000","last_fullsized":"2024-04-25T23:03:01.513616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'464","last_scrub_stamp":"2024-04-25T23:03:01.513370+0000","last_deep_scrub":"62'464","last_deep_scrub_stamp":"2024-04-25T23:03:01.513370+0000","last_clean_scrub_stamp":"2024-04-25T23:03:01.513370+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.457089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14167,"num_write":424,"num_write_kb":55024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"62'399","reported_seq":962,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:28.318789+0000","last_change":"2024-04-25T23:03:28.318789+0000","last_active":"2024-04-25T23:03:28.318789+0000","last_peered":"2024-04-25T23:03:28.318789+0000","last_clean":"2024-04-25T23:03:28.318789+0000","last_became_active":"2024-04-25T23:02:36.177055+0000","last_became_peered":"2024-04-25T23:02:36.177055+0000","last_unstale":"2024-04-25T23:03:28.318789+0000","last_undegraded":"2024-04-25T23:03:28.318789+0000","last_fullsized":"2024-04-25T23:03:28.318789+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'399","last_scrub_stamp":"2024-04-25T23:03:28.318522+0000","last_deep_scrub":"62'399","last_deep_scrub_stamp":"2024-04-25T23:03:28.318522+0000","last_clean_scrub_stamp":"2024-04-25T23:03:28.318522+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:44.544522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17501,"num_write":367,"num_write_kb":67196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"62'405","reported_seq":580,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:25.088484+0000","last_change":"2024-04-25T23:03:25.088558+0000","last_active":"2024-04-25T23:03:25.088484+0000","last_peered":"2024-04-25T23:03:25.088484+0000","last_clean":"2024-04-25T23:03:25.088484+0000","last_became_active":"2024-04-25T23:02:39.093992+0000","last_became_peered":"2024-04-25T23:02:39.093992+0000","last_unstale":"2024-04-25T23:03:25.088484+0000","last_undegraded":"2024-04-25T23:03:25.088484+0000","last_fullsized":"2024-04-25T23:03:25.088484+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'405","last_scrub_stamp":"2024-04-25T23:03:25.088258+0000","last_deep_scrub":"62'405","last_deep_scrub_stamp":"2024-04-25T23:03:25.088258+0000","last_clean_scrub_stamp":"2024-04-25T23:03:25.088258+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:13.178010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":23473,"num_write":376,"num_write_kb":92267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"62'390","reported_seq":959,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:53.340706+0000","last_change":"2024-04-25T23:02:53.340706+0000","last_active":"2024-04-25T23:02:53.340706+0000","last_peered":"2024-04-25T23:02:53.340706+0000","last_clean":"2024-04-25T23:02:53.340706+0000","last_became_active":"2024-04-25T23:02:23.195891+0000","last_became_peered":"2024-04-25T23:02:23.195891+0000","last_unstale":"2024-04-25T23:02:53.340706+0000","last_undegraded":"2024-04-25T23:02:53.340706+0000","last_fullsized":"2024-04-25T23:02:53.340706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'390","last_scrub_stamp":"2024-04-25T23:02:53.340423+0000","last_deep_scrub":"62'390","last_deep_scrub_stamp":"2024-04-25T23:02:53.340423+0000","last_clean_scrub_stamp":"2024-04-25T23:02:53.340423+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:56.618770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19253,"num_write":363,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"62'468","reported_seq":640,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:07.932000+0000","last_change":"2024-04-25T23:03:07.932057+0000","last_active":"2024-04-25T23:03:07.932000+0000","last_peered":"2024-04-25T23:03:07.932000+0000","last_clean":"2024-04-25T23:03:07.932000+0000","last_became_active":"2024-04-25T23:02:30.078930+0000","last_became_peered":"2024-04-25T23:02:30.078930+0000","last_unstale":"2024-04-25T23:03:07.932000+0000","last_undegraded":"2024-04-25T23:03:07.932000+0000","last_fullsized":"2024-04-25T23:03:07.932000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'468","last_scrub_stamp":"2024-04-25T23:03:07.931797+0000","last_deep_scrub":"62'468","last_deep_scrub_stamp":"2024-04-25T23:03:07.931797+0000","last_clean_scrub_stamp":"2024-04-25T23:03:07.931797+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:29:24.092499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":16460,"num_write":428,"num_write_kb":79451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"62'434","reported_seq":1050,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:18.481826+0000","last_change":"2024-04-25T23:03:18.481826+0000","last_active":"2024-04-25T23:03:18.481826+0000","last_peered":"2024-04-25T23:03:18.481826+0000","last_clean":"2024-04-25T23:03:18.481826+0000","last_became_active":"2024-04-25T23:02:21.171170+0000","last_became_peered":"2024-04-25T23:02:21.171170+0000","last_unstale":"2024-04-25T23:03:18.481826+0000","last_undegraded":"2024-04-25T23:03:18.481826+0000","last_fullsized":"2024-04-25T23:03:18.481826+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'434","last_scrub_stamp":"2024-04-25T23:03:18.481454+0000","last_deep_scrub":"62'434","last_deep_scrub_stamp":"2024-04-25T23:03:18.481454+0000","last_clean_scrub_stamp":"2024-04-25T23:03:18.481454+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:41.072893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22500,"num_write":404,"num_write_kb":63543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"62'462","reported_seq":700,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:07.364362+0000","last_change":"2024-04-25T23:03:07.364362+0000","last_active":"2024-04-25T23:03:07.364362+0000","last_peered":"2024-04-25T23:03:07.364362+0000","last_clean":"2024-04-25T23:03:07.364362+0000","last_became_active":"2024-04-25T22:59:06.803173+0000","last_became_peered":"2024-04-25T22:59:06.803173+0000","last_unstale":"2024-04-25T23:03:07.364362+0000","last_undegraded":"2024-04-25T23:03:07.364362+0000","last_fullsized":"2024-04-25T23:03:07.364362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'462","last_scrub_stamp":"2024-04-25T23:03:07.364098+0000","last_deep_scrub":"62'462","last_deep_scrub_stamp":"2024-04-25T23:03:07.364098+0000","last_clean_scrub_stamp":"2024-04-25T23:03:07.364098+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:13.776454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":39854,"num_write":435,"num_write_kb":105892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'425","reported_seq":660,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:01.935737+0000","last_change":"2024-04-25T23:03:01.935799+0000","last_active":"2024-04-25T23:03:01.935737+0000","last_peered":"2024-04-25T23:03:01.935737+0000","last_clean":"2024-04-25T23:03:01.935737+0000","last_became_active":"2024-04-25T23:02:27.085430+0000","last_became_peered":"2024-04-25T23:02:27.085430+0000","last_unstale":"2024-04-25T23:03:01.935737+0000","last_undegraded":"2024-04-25T23:03:01.935737+0000","last_fullsized":"2024-04-25T23:03:01.935737+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'425","last_scrub_stamp":"2024-04-25T23:03:01.935531+0000","last_deep_scrub":"62'425","last_deep_scrub_stamp":"2024-04-25T23:03:01.935531+0000","last_clean_scrub_stamp":"2024-04-25T23:03:01.935531+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:20.857728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":34084,"num_write":388,"num_write_kb":125282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"97'551","reported_seq":731,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:19.325969+0000","last_change":"2024-04-25T23:03:19.326071+0000","last_active":"2024-04-25T23:03:19.325969+0000","last_peered":"2024-04-25T23:03:19.325969+0000","last_clean":"2024-04-25T23:03:19.325969+0000","last_became_active":"2024-04-25T22:59:05.775722+0000","last_became_peered":"2024-04-25T22:59:05.775722+0000","last_unstale":"2024-04-25T23:03:19.325969+0000","last_undegraded":"2024-04-25T23:03:19.325969+0000","last_fullsized":"2024-04-25T23:03:19.325969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'551","last_scrub_stamp":"2024-04-25T23:03:19.325796+0000","last_deep_scrub":"97'551","last_deep_scrub_stamp":"2024-04-25T23:03:19.325796+0000","last_clean_scrub_stamp":"2024-04-25T23:03:19.325796+0000","objects_scrubbed":4,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:31.431960+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"62'396","reported_seq":587,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:04.909667+0000","last_change":"2024-04-25T23:03:04.909727+0000","last_active":"2024-04-25T23:03:04.909667+0000","last_peered":"2024-04-25T23:03:04.909667+0000","last_clean":"2024-04-25T23:03:04.909667+0000","last_became_active":"2024-04-25T23:02:20.075967+0000","last_became_peered":"2024-04-25T23:02:20.075967+0000","last_unstale":"2024-04-25T23:03:04.909667+0000","last_undegraded":"2024-04-25T23:03:04.909667+0000","last_fullsized":"2024-04-25T23:03:04.909667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'396","last_scrub_stamp":"2024-04-25T23:03:04.909470+0000","last_deep_scrub":"62'396","last_deep_scrub_stamp":"2024-04-25T23:03:04.909470+0000","last_clean_scrub_stamp":"2024-04-25T23:03:04.909470+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:25.484491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11256,"num_write":360,"num_write_kb":67789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"61'47","reported_seq":227,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:12.508882+0000","last_change":"2024-04-25T23:03:12.508947+0000","last_active":"2024-04-25T23:03:12.508882+0000","last_peered":"2024-04-25T23:03:12.508882+0000","last_clean":"2024-04-25T23:03:12.508882+0000","last_became_active":"2024-04-25T22:59:05.776605+0000","last_became_peered":"2024-04-25T22:59:05.776605+0000","last_unstale":"2024-04-25T23:03:12.508882+0000","last_undegraded":"2024-04-25T23:03:12.508882+0000","last_fullsized":"2024-04-25T23:03:12.508882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'47","last_scrub_stamp":"2024-04-25T23:03:12.508676+0000","last_deep_scrub":"61'47","last_deep_scrub_stamp":"2024-04-25T23:03:12.508676+0000","last_clean_scrub_stamp":"2024-04-25T23:03:12.508676+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:21.236746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"62'436","reported_seq":679,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:17.530873+0000","last_change":"2024-04-25T23:03:17.530938+0000","last_active":"2024-04-25T23:03:17.530873+0000","last_peered":"2024-04-25T23:03:17.530873+0000","last_clean":"2024-04-25T23:03:17.530873+0000","last_became_active":"2024-04-25T22:59:06.784594+0000","last_became_peered":"2024-04-25T22:59:06.784594+0000","last_unstale":"2024-04-25T23:03:17.530873+0000","last_undegraded":"2024-04-25T23:03:17.530873+0000","last_fullsized":"2024-04-25T23:03:17.530873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'436","last_scrub_stamp":"2024-04-25T23:03:17.530673+0000","last_deep_scrub":"62'436","last_deep_scrub_stamp":"2024-04-25T23:03:17.530673+0000","last_clean_scrub_stamp":"2024-04-25T23:03:17.530673+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:38:22.821711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":28844,"num_write":407,"num_write_kb":63661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'66","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:11.867861+0000","last_change":"2024-04-25T23:03:11.867924+0000","last_active":"2024-04-25T23:03:11.867861+0000","last_peered":"2024-04-25T23:03:11.867861+0000","last_clean":"2024-04-25T23:03:11.867861+0000","last_became_active":"2024-04-25T23:02:15.096267+0000","last_became_peered":"2024-04-25T23:02:15.096267+0000","last_unstale":"2024-04-25T23:03:11.867861+0000","last_undegraded":"2024-04-25T23:03:11.867861+0000","last_fullsized":"2024-04-25T23:03:11.867861+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'66","last_scrub_stamp":"2024-04-25T23:03:11.867665+0000","last_deep_scrub":"61'66","last_deep_scrub_stamp":"2024-04-25T23:03:11.867665+0000","last_clean_scrub_stamp":"2024-04-25T23:03:11.867665+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:52.681776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"62'407","reported_seq":638,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:59.473692+0000","last_change":"2024-04-25T23:02:59.473749+0000","last_active":"2024-04-25T23:02:59.473692+0000","last_peered":"2024-04-25T23:02:59.473692+0000","last_clean":"2024-04-25T23:02:59.473692+0000","last_became_active":"2024-04-25T22:59:06.795859+0000","last_became_peered":"2024-04-25T22:59:06.795859+0000","last_unstale":"2024-04-25T23:02:59.473692+0000","last_undegraded":"2024-04-25T23:02:59.473692+0000","last_fullsized":"2024-04-25T23:02:59.473692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'407","last_scrub_stamp":"2024-04-25T23:02:59.473493+0000","last_deep_scrub":"62'407","last_deep_scrub_stamp":"2024-04-25T23:02:59.473493+0000","last_clean_scrub_stamp":"2024-04-25T23:02:59.473493+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:25.223460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27300,"num_write":377,"num_write_kb":80066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"97'68","reported_seq":256,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:13.305167+0000","last_change":"2024-04-25T23:03:13.305242+0000","last_active":"2024-04-25T23:03:13.305167+0000","last_peered":"2024-04-25T23:03:13.305167+0000","last_clean":"2024-04-25T23:03:13.305167+0000","last_became_active":"2024-04-25T23:02:15.188851+0000","last_became_peered":"2024-04-25T23:02:15.188851+0000","last_unstale":"2024-04-25T23:03:13.305167+0000","last_undegraded":"2024-04-25T23:03:13.305167+0000","last_fullsized":"2024-04-25T23:03:13.305167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'68","last_scrub_stamp":"2024-04-25T23:03:13.304983+0000","last_deep_scrub":"97'68","last_deep_scrub_stamp":"2024-04-25T23:03:13.304983+0000","last_clean_scrub_stamp":"2024-04-25T23:03:13.304983+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:28:21.810607+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"97'154","reported_seq":348,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:55.221159+0000","last_change":"2024-04-25T23:02:55.221333+0000","last_active":"2024-04-25T23:02:55.221159+0000","last_peered":"2024-04-25T23:02:55.221159+0000","last_clean":"2024-04-25T23:02:55.221159+0000","last_became_active":"2024-04-25T23:02:18.186497+0000","last_became_peered":"2024-04-25T23:02:18.186497+0000","last_unstale":"2024-04-25T23:02:55.221159+0000","last_undegraded":"2024-04-25T23:02:55.221159+0000","last_fullsized":"2024-04-25T23:02:55.221159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'154","last_scrub_stamp":"2024-04-25T23:02:55.220933+0000","last_deep_scrub":"97'154","last_deep_scrub_stamp":"2024-04-25T23:02:55.220933+0000","last_clean_scrub_stamp":"2024-04-25T23:02:55.220933+0000","objects_scrubbed":2,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:56.610312+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"62'429","reported_seq":636,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:05.946790+0000","last_change":"2024-04-25T23:03:05.946907+0000","last_active":"2024-04-25T23:03:05.946790+0000","last_peered":"2024-04-25T23:03:05.946790+0000","last_clean":"2024-04-25T23:03:05.946790+0000","last_became_active":"2024-04-25T23:02:29.090340+0000","last_became_peered":"2024-04-25T23:02:29.090340+0000","last_unstale":"2024-04-25T23:03:05.946790+0000","last_undegraded":"2024-04-25T23:03:05.946790+0000","last_fullsized":"2024-04-25T23:03:05.946790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'429","last_scrub_stamp":"2024-04-25T23:03:05.946544+0000","last_deep_scrub":"62'429","last_deep_scrub_stamp":"2024-04-25T23:03:05.946544+0000","last_clean_scrub_stamp":"2024-04-25T23:03:05.946544+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:50.761561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37904,"num_write":397,"num_write_kb":63229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"97'279","reported_seq":458,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:09.000765+0000","last_change":"2024-04-25T23:03:09.000834+0000","last_active":"2024-04-25T23:03:09.000765+0000","last_peered":"2024-04-25T23:03:09.000765+0000","last_clean":"2024-04-25T23:03:09.000765+0000","last_became_active":"2024-04-25T23:02:18.095607+0000","last_became_peered":"2024-04-25T23:02:18.095607+0000","last_unstale":"2024-04-25T23:03:09.000765+0000","last_undegraded":"2024-04-25T23:03:09.000765+0000","last_fullsized":"2024-04-25T23:03:09.000765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'279","last_scrub_stamp":"2024-04-25T23:03:09.000570+0000","last_deep_scrub":"97'279","last_deep_scrub_stamp":"2024-04-25T23:03:09.000570+0000","last_clean_scrub_stamp":"2024-04-25T23:03:09.000570+0000","objects_scrubbed":2,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:36.331966+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"62'451","reported_seq":668,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:58.909230+0000","last_change":"2024-04-25T23:02:58.909373+0000","last_active":"2024-04-25T23:02:58.909230+0000","last_peered":"2024-04-25T23:02:58.909230+0000","last_clean":"2024-04-25T23:02:58.909230+0000","last_became_active":"2024-04-25T23:02:22.084439+0000","last_became_peered":"2024-04-25T23:02:22.084439+0000","last_unstale":"2024-04-25T23:02:58.909230+0000","last_undegraded":"2024-04-25T23:02:58.909230+0000","last_fullsized":"2024-04-25T23:02:58.909230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'451","last_scrub_stamp":"2024-04-25T23:02:58.908996+0000","last_deep_scrub":"62'451","last_deep_scrub_stamp":"2024-04-25T23:02:58.908996+0000","last_clean_scrub_stamp":"2024-04-25T23:02:58.908996+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:42.962115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24928,"num_write":431,"num_write_kb":48042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"97'488","reported_seq":682,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:53.153476+0000","last_change":"2024-04-25T23:02:53.153545+0000","last_active":"2024-04-25T23:02:53.153476+0000","last_peered":"2024-04-25T23:02:53.153476+0000","last_clean":"2024-04-25T23:02:53.153476+0000","last_became_active":"2024-04-25T23:02:18.188141+0000","last_became_peered":"2024-04-25T23:02:18.188141+0000","last_unstale":"2024-04-25T23:02:53.153476+0000","last_undegraded":"2024-04-25T23:02:53.153476+0000","last_fullsized":"2024-04-25T23:02:53.153476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'488","last_scrub_stamp":"2024-04-25T23:02:53.153265+0000","last_deep_scrub":"97'488","last_deep_scrub_stamp":"2024-04-25T23:02:53.153265+0000","last_clean_scrub_stamp":"2024-04-25T23:02:53.153265+0000","objects_scrubbed":2,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:56.431612+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"62'411","reported_seq":626,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:08.363645+0000","last_change":"2024-04-25T23:03:08.363645+0000","last_active":"2024-04-25T23:03:08.363645+0000","last_peered":"2024-04-25T23:03:08.363645+0000","last_clean":"2024-04-25T23:03:08.363645+0000","last_became_active":"2024-04-25T22:59:06.795482+0000","last_became_peered":"2024-04-25T22:59:06.795482+0000","last_unstale":"2024-04-25T23:03:08.363645+0000","last_undegraded":"2024-04-25T23:03:08.363645+0000","last_fullsized":"2024-04-25T23:03:08.363645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'411","last_scrub_stamp":"2024-04-25T23:03:08.363383+0000","last_deep_scrub":"62'411","last_deep_scrub_stamp":"2024-04-25T23:03:08.363383+0000","last_clean_scrub_stamp":"2024-04-25T23:03:08.363383+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:32.226189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17609,"num_write":377,"num_write_kb":38356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'70","reported_seq":250,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:17.325201+0000","last_change":"2024-04-25T23:03:17.325267+0000","last_active":"2024-04-25T23:03:17.325201+0000","last_peered":"2024-04-25T23:03:17.325201+0000","last_clean":"2024-04-25T23:03:17.325201+0000","last_became_active":"2024-04-25T22:59:05.773900+0000","last_became_peered":"2024-04-25T22:59:05.773900+0000","last_unstale":"2024-04-25T23:03:17.325201+0000","last_undegraded":"2024-04-25T23:03:17.325201+0000","last_fullsized":"2024-04-25T23:03:17.325201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'70","last_scrub_stamp":"2024-04-25T23:03:17.325000+0000","last_deep_scrub":"61'70","last_deep_scrub_stamp":"2024-04-25T23:03:17.325000+0000","last_clean_scrub_stamp":"2024-04-25T23:03:17.325000+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:39.916438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"62'459","reported_seq":691,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:05.430436+0000","last_change":"2024-04-25T23:03:05.430498+0000","last_active":"2024-04-25T23:03:05.430436+0000","last_peered":"2024-04-25T23:03:05.430436+0000","last_clean":"2024-04-25T23:03:05.430436+0000","last_became_active":"2024-04-25T22:59:06.794301+0000","last_became_peered":"2024-04-25T22:59:06.794301+0000","last_unstale":"2024-04-25T23:03:05.430436+0000","last_undegraded":"2024-04-25T23:03:05.430436+0000","last_fullsized":"2024-04-25T23:03:05.430436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'459","last_scrub_stamp":"2024-04-25T23:03:05.430242+0000","last_deep_scrub":"62'459","last_deep_scrub_stamp":"2024-04-25T23:03:05.430242+0000","last_clean_scrub_stamp":"2024-04-25T23:03:05.430242+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:01.703276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":32354,"num_write":423,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"97'140","reported_seq":320,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:16.592342+0000","last_change":"2024-04-25T23:03:16.592425+0000","last_active":"2024-04-25T23:03:16.592342+0000","last_peered":"2024-04-25T23:03:16.592342+0000","last_clean":"2024-04-25T23:03:16.592342+0000","last_became_active":"2024-04-25T22:59:05.779564+0000","last_became_peered":"2024-04-25T22:59:05.779564+0000","last_unstale":"2024-04-25T23:03:16.592342+0000","last_undegraded":"2024-04-25T23:03:16.592342+0000","last_fullsized":"2024-04-25T23:03:16.592342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'140","last_scrub_stamp":"2024-04-25T23:03:16.592141+0000","last_deep_scrub":"97'140","last_deep_scrub_stamp":"2024-04-25T23:03:16.592141+0000","last_clean_scrub_stamp":"2024-04-25T23:03:16.592141+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:06.328931+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"62'451","reported_seq":647,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:01.310208+0000","last_change":"2024-04-25T23:03:01.310275+0000","last_active":"2024-04-25T23:03:01.310208+0000","last_peered":"2024-04-25T23:03:01.310208+0000","last_clean":"2024-04-25T23:03:01.310208+0000","last_became_active":"2024-04-25T22:59:06.802627+0000","last_became_peered":"2024-04-25T22:59:06.802627+0000","last_unstale":"2024-04-25T23:03:01.310208+0000","last_undegraded":"2024-04-25T23:03:01.310208+0000","last_fullsized":"2024-04-25T23:03:01.310208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'451","last_scrub_stamp":"2024-04-25T23:03:01.310004+0000","last_deep_scrub":"62'451","last_deep_scrub_stamp":"2024-04-25T23:03:01.310004+0000","last_clean_scrub_stamp":"2024-04-25T23:03:01.310004+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:40.379452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6054,"num_write":426,"num_write_kb":64255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"97'125","reported_seq":306,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:21.301234+0000","last_change":"2024-04-25T23:03:21.301234+0000","last_active":"2024-04-25T23:03:21.301234+0000","last_peered":"2024-04-25T23:03:21.301234+0000","last_clean":"2024-04-25T23:03:21.301234+0000","last_became_active":"2024-04-25T22:59:05.786309+0000","last_became_peered":"2024-04-25T22:59:05.786309+0000","last_unstale":"2024-04-25T23:03:21.301234+0000","last_undegraded":"2024-04-25T23:03:21.301234+0000","last_fullsized":"2024-04-25T23:03:21.301234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'125","last_scrub_stamp":"2024-04-25T23:03:21.300968+0000","last_deep_scrub":"97'125","last_deep_scrub_stamp":"2024-04-25T23:03:21.300968+0000","last_clean_scrub_stamp":"2024-04-25T23:03:21.300968+0000","objects_scrubbed":1,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:09.790804+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"62'422","reported_seq":995,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:29.286628+0000","last_change":"2024-04-25T23:03:29.286687+0000","last_active":"2024-04-25T23:03:29.286628+0000","last_peered":"2024-04-25T23:03:29.286628+0000","last_clean":"2024-04-25T23:03:29.286628+0000","last_became_active":"2024-04-25T23:02:37.177145+0000","last_became_peered":"2024-04-25T23:02:37.177145+0000","last_unstale":"2024-04-25T23:03:29.286628+0000","last_undegraded":"2024-04-25T23:03:29.286628+0000","last_fullsized":"2024-04-25T23:03:29.286628+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'422","last_scrub_stamp":"2024-04-25T23:03:29.286434+0000","last_deep_scrub":"62'422","last_deep_scrub_stamp":"2024-04-25T23:03:29.286434+0000","last_clean_scrub_stamp":"2024-04-25T23:03:29.286434+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:49.090395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9610,"num_write":391,"num_write_kb":55498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'60","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:12.896966+0000","last_change":"2024-04-25T23:03:12.897035+0000","last_active":"2024-04-25T23:03:12.896966+0000","last_peered":"2024-04-25T23:03:12.896966+0000","last_clean":"2024-04-25T23:03:12.896966+0000","last_became_active":"2024-04-25T23:02:15.094540+0000","last_became_peered":"2024-04-25T23:02:15.094540+0000","last_unstale":"2024-04-25T23:03:12.896966+0000","last_undegraded":"2024-04-25T23:03:12.896966+0000","last_fullsized":"2024-04-25T23:03:12.896966+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'60","last_scrub_stamp":"2024-04-25T23:03:12.896770+0000","last_deep_scrub":"61'60","last_deep_scrub_stamp":"2024-04-25T23:03:12.896770+0000","last_clean_scrub_stamp":"2024-04-25T23:03:12.896770+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:10.595134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"62'371","reported_seq":916,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:57.238065+0000","last_change":"2024-04-25T23:02:57.238196+0000","last_active":"2024-04-25T23:02:57.238065+0000","last_peered":"2024-04-25T23:02:57.238065+0000","last_clean":"2024-04-25T23:02:57.238065+0000","last_became_active":"2024-04-25T23:02:21.173397+0000","last_became_peered":"2024-04-25T23:02:21.173397+0000","last_unstale":"2024-04-25T23:02:57.238065+0000","last_undegraded":"2024-04-25T23:02:57.238065+0000","last_fullsized":"2024-04-25T23:02:57.238065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'371","last_scrub_stamp":"2024-04-25T23:02:57.237814+0000","last_deep_scrub":"62'371","last_deep_scrub_stamp":"2024-04-25T23:02:57.237814+0000","last_clean_scrub_stamp":"2024-04-25T23:02:57.237814+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:07.627022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22939,"num_write":342,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"97'474","reported_seq":644,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:18.013113+0000","last_change":"2024-04-25T23:03:18.013179+0000","last_active":"2024-04-25T23:03:18.013113+0000","last_peered":"2024-04-25T23:03:18.013113+0000","last_clean":"2024-04-25T23:03:18.013113+0000","last_became_active":"2024-04-25T23:02:18.093315+0000","last_became_peered":"2024-04-25T23:02:18.093315+0000","last_unstale":"2024-04-25T23:03:18.013113+0000","last_undegraded":"2024-04-25T23:03:18.013113+0000","last_fullsized":"2024-04-25T23:03:18.013113+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'474","last_scrub_stamp":"2024-04-25T23:03:18.012919+0000","last_deep_scrub":"97'474","last_deep_scrub_stamp":"2024-04-25T23:03:18.012919+0000","last_clean_scrub_stamp":"2024-04-25T23:03:18.012919+0000","objects_scrubbed":1,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:22.458276+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'397","reported_seq":954,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:23.409440+0000","last_change":"2024-04-25T23:03:23.409505+0000","last_active":"2024-04-25T23:03:23.409440+0000","last_peered":"2024-04-25T23:03:23.409440+0000","last_clean":"2024-04-25T23:03:23.409440+0000","last_became_active":"2024-04-25T23:02:39.180238+0000","last_became_peered":"2024-04-25T23:02:39.180238+0000","last_unstale":"2024-04-25T23:03:23.409440+0000","last_undegraded":"2024-04-25T23:03:23.409440+0000","last_fullsized":"2024-04-25T23:03:23.409440+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'397","last_scrub_stamp":"2024-04-25T23:03:23.409235+0000","last_deep_scrub":"62'397","last_deep_scrub_stamp":"2024-04-25T23:03:23.409235+0000","last_clean_scrub_stamp":"2024-04-25T23:03:23.409235+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:05.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":5508,"num_write":367,"num_write_kb":38351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"97'159","reported_seq":398,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.241329+0000","last_change":"2024-04-25T23:02:56.241329+0000","last_active":"2024-04-25T23:02:56.241329+0000","last_peered":"2024-04-25T23:02:56.241329+0000","last_clean":"2024-04-25T23:02:56.241329+0000","last_became_active":"2024-04-25T23:02:15.189468+0000","last_became_peered":"2024-04-25T23:02:15.189468+0000","last_unstale":"2024-04-25T23:02:56.241329+0000","last_undegraded":"2024-04-25T23:02:56.241329+0000","last_fullsized":"2024-04-25T23:02:56.241329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'159","last_scrub_stamp":"2024-04-25T23:02:56.241053+0000","last_deep_scrub":"97'159","last_deep_scrub_stamp":"2024-04-25T23:02:56.241053+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.241053+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.725697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:16.307887+0000","last_change":"2024-04-25T23:03:16.307942+0000","last_active":"2024-04-25T23:03:16.307887+0000","last_peered":"2024-04-25T23:03:16.307887+0000","last_clean":"2024-04-25T23:03:16.307887+0000","last_became_active":"2024-04-25T22:59:01.742116+0000","last_became_peered":"2024-04-25T22:59:01.742116+0000","last_unstale":"2024-04-25T23:03:16.307887+0000","last_undegraded":"2024-04-25T23:03:16.307887+0000","last_fullsized":"2024-04-25T23:03:16.307887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:03:16.307692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:03:16.307692+0000","last_clean_scrub_stamp":"2024-04-25T23:03:16.307692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:38:21.598730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"97'627","reported_seq":823,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:06.472056+0000","last_change":"2024-04-25T23:03:06.472056+0000","last_active":"2024-04-25T23:03:06.472056+0000","last_peered":"2024-04-25T23:03:06.472056+0000","last_clean":"2024-04-25T23:03:06.472056+0000","last_became_active":"2024-04-25T23:02:18.180724+0000","last_became_peered":"2024-04-25T23:02:18.180724+0000","last_unstale":"2024-04-25T23:03:06.472056+0000","last_undegraded":"2024-04-25T23:03:06.472056+0000","last_fullsized":"2024-04-25T23:03:06.472056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'627","last_scrub_stamp":"2024-04-25T23:03:06.471666+0000","last_deep_scrub":"97'627","last_deep_scrub_stamp":"2024-04-25T23:03:06.471666+0000","last_clean_scrub_stamp":"2024-04-25T23:03:06.471666+0000","objects_scrubbed":2,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:55:48.722855+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"62'454","reported_seq":1066,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:30.308217+0000","last_change":"2024-04-25T23:03:30.308274+0000","last_active":"2024-04-25T23:03:30.308217+0000","last_peered":"2024-04-25T23:03:30.308217+0000","last_clean":"2024-04-25T23:03:30.308217+0000","last_became_active":"2024-04-25T23:02:38.183485+0000","last_became_peered":"2024-04-25T23:02:38.183485+0000","last_unstale":"2024-04-25T23:03:30.308217+0000","last_undegraded":"2024-04-25T23:03:30.308217+0000","last_fullsized":"2024-04-25T23:03:30.308217+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'454","last_scrub_stamp":"2024-04-25T23:03:30.308023+0000","last_deep_scrub":"62'454","last_deep_scrub_stamp":"2024-04-25T23:03:30.308023+0000","last_clean_scrub_stamp":"2024-04-25T23:03:30.308023+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:19.418769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":35009,"num_write":418,"num_write_kb":112365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":194,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:23.338623+0000","last_change":"2024-04-25T23:03:23.338724+0000","last_active":"2024-04-25T23:03:23.338623+0000","last_peered":"2024-04-25T23:03:23.338623+0000","last_clean":"2024-04-25T23:03:23.338623+0000","last_became_active":"2024-04-25T23:02:15.190507+0000","last_became_peered":"2024-04-25T23:02:15.190507+0000","last_unstale":"2024-04-25T23:03:23.338623+0000","last_undegraded":"2024-04-25T23:03:23.338623+0000","last_fullsized":"2024-04-25T23:03:23.338623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:03:23.338398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:03:23.338398+0000","last_clean_scrub_stamp":"2024-04-25T23:03:23.338398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:23:47.067133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"97'128","reported_seq":374,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:11.503708+0000","last_change":"2024-04-25T23:03:11.503708+0000","last_active":"2024-04-25T23:03:11.503708+0000","last_peered":"2024-04-25T23:03:11.503708+0000","last_clean":"2024-04-25T23:03:11.503708+0000","last_became_active":"2024-04-25T22:59:05.776400+0000","last_became_peered":"2024-04-25T22:59:05.776400+0000","last_unstale":"2024-04-25T23:03:11.503708+0000","last_undegraded":"2024-04-25T23:03:11.503708+0000","last_fullsized":"2024-04-25T23:03:11.503708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'128","last_scrub_stamp":"2024-04-25T23:03:11.503155+0000","last_deep_scrub":"97'128","last_deep_scrub_stamp":"2024-04-25T23:03:11.503155+0000","last_clean_scrub_stamp":"2024-04-25T23:03:11.503155+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:39.756720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":65,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"62'435","reported_seq":607,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:09.935073+0000","last_change":"2024-04-25T23:03:09.935140+0000","last_active":"2024-04-25T23:03:09.935073+0000","last_peered":"2024-04-25T23:03:09.935073+0000","last_clean":"2024-04-25T23:03:09.935073+0000","last_became_active":"2024-04-25T23:02:31.081724+0000","last_became_peered":"2024-04-25T23:02:31.081724+0000","last_unstale":"2024-04-25T23:03:09.935073+0000","last_undegraded":"2024-04-25T23:03:09.935073+0000","last_fullsized":"2024-04-25T23:03:09.935073+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'435","last_scrub_stamp":"2024-04-25T23:03:09.934871+0000","last_deep_scrub":"62'435","last_deep_scrub_stamp":"2024-04-25T23:03:09.934871+0000","last_clean_scrub_stamp":"2024-04-25T23:03:09.934871+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:41:22.069264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17403,"num_write":393,"num_write_kb":38176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":194,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:55.345406+0000","last_change":"2024-04-25T23:02:55.345406+0000","last_active":"2024-04-25T23:02:55.345406+0000","last_peered":"2024-04-25T23:02:55.345406+0000","last_clean":"2024-04-25T23:02:55.345406+0000","last_became_active":"2024-04-25T23:02:15.189716+0000","last_became_peered":"2024-04-25T23:02:15.189716+0000","last_unstale":"2024-04-25T23:02:55.345406+0000","last_undegraded":"2024-04-25T23:02:55.345406+0000","last_fullsized":"2024-04-25T23:02:55.345406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:02:55.345164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:02:55.345164+0000","last_clean_scrub_stamp":"2024-04-25T23:02:55.345164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:41.939421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"97'338","reported_seq":508,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:10.921493+0000","last_change":"2024-04-25T23:03:10.921567+0000","last_active":"2024-04-25T23:03:10.921493+0000","last_peered":"2024-04-25T23:03:10.921493+0000","last_clean":"2024-04-25T23:03:10.921493+0000","last_became_active":"2024-04-25T23:02:18.095375+0000","last_became_peered":"2024-04-25T23:02:18.095375+0000","last_unstale":"2024-04-25T23:03:10.921493+0000","last_undegraded":"2024-04-25T23:03:10.921493+0000","last_fullsized":"2024-04-25T23:03:10.921493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'338","last_scrub_stamp":"2024-04-25T23:03:10.921296+0000","last_deep_scrub":"97'338","last_deep_scrub_stamp":"2024-04-25T23:03:10.921296+0000","last_clean_scrub_stamp":"2024-04-25T23:03:10.921296+0000","objects_scrubbed":2,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:07.682267+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":8314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"62'358","reported_seq":898,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:24.457624+0000","last_change":"2024-04-25T23:03:24.457624+0000","last_active":"2024-04-25T23:03:24.457624+0000","last_peered":"2024-04-25T23:03:24.457624+0000","last_clean":"2024-04-25T23:03:24.457624+0000","last_became_active":"2024-04-25T23:02:40.173342+0000","last_became_peered":"2024-04-25T23:02:40.173342+0000","last_unstale":"2024-04-25T23:03:24.457624+0000","last_undegraded":"2024-04-25T23:03:24.457624+0000","last_fullsized":"2024-04-25T23:03:24.457624+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'358","last_scrub_stamp":"2024-04-25T23:03:24.457364+0000","last_deep_scrub":"62'358","last_deep_scrub_stamp":"2024-04-25T23:03:24.457364+0000","last_clean_scrub_stamp":"2024-04-25T23:03:24.457364+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:23:48.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23298,"num_write":337,"num_write_kb":51237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:15.310387+0000","last_change":"2024-04-25T23:03:15.310387+0000","last_active":"2024-04-25T23:03:15.310387+0000","last_peered":"2024-04-25T23:03:15.310387+0000","last_clean":"2024-04-25T23:03:15.310387+0000","last_became_active":"2024-04-25T22:59:01.742138+0000","last_became_peered":"2024-04-25T22:59:01.742138+0000","last_unstale":"2024-04-25T23:03:15.310387+0000","last_undegraded":"2024-04-25T23:03:15.310387+0000","last_fullsized":"2024-04-25T23:03:15.310387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:03:15.310143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:03:15.310143+0000","last_clean_scrub_stamp":"2024-04-25T23:03:15.310143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:05.046932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'72","reported_seq":253,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:18.303430+0000","last_change":"2024-04-25T23:03:18.303492+0000","last_active":"2024-04-25T23:03:18.303430+0000","last_peered":"2024-04-25T23:03:18.303430+0000","last_clean":"2024-04-25T23:03:18.303430+0000","last_became_active":"2024-04-25T22:59:05.773747+0000","last_became_peered":"2024-04-25T22:59:05.773747+0000","last_unstale":"2024-04-25T23:03:18.303430+0000","last_undegraded":"2024-04-25T23:03:18.303430+0000","last_fullsized":"2024-04-25T23:03:18.303430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'72","last_scrub_stamp":"2024-04-25T23:03:18.303215+0000","last_deep_scrub":"61'72","last_deep_scrub_stamp":"2024-04-25T23:03:18.303215+0000","last_clean_scrub_stamp":"2024-04-25T23:03:18.303215+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:16.445009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"62'395","reported_seq":943,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:20.438121+0000","last_change":"2024-04-25T23:03:20.438121+0000","last_active":"2024-04-25T23:03:20.438121+0000","last_peered":"2024-04-25T23:03:20.438121+0000","last_clean":"2024-04-25T23:03:20.438121+0000","last_became_active":"2024-04-25T23:02:30.168726+0000","last_became_peered":"2024-04-25T23:02:30.168726+0000","last_unstale":"2024-04-25T23:03:20.438121+0000","last_undegraded":"2024-04-25T23:03:20.438121+0000","last_fullsized":"2024-04-25T23:03:20.438121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'395","last_scrub_stamp":"2024-04-25T23:03:20.437855+0000","last_deep_scrub":"62'395","last_deep_scrub_stamp":"2024-04-25T23:03:20.437855+0000","last_clean_scrub_stamp":"2024-04-25T23:03:20.437855+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:32.544019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10895,"num_write":352,"num_write_kb":42710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"97'280","reported_seq":461,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:22.343540+0000","last_change":"2024-04-25T23:03:22.343607+0000","last_active":"2024-04-25T23:03:22.343540+0000","last_peered":"2024-04-25T23:03:22.343540+0000","last_clean":"2024-04-25T23:03:22.343540+0000","last_became_active":"2024-04-25T22:59:05.786541+0000","last_became_peered":"2024-04-25T22:59:05.786541+0000","last_unstale":"2024-04-25T23:03:22.343540+0000","last_undegraded":"2024-04-25T23:03:22.343540+0000","last_fullsized":"2024-04-25T23:03:22.343540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'280","last_scrub_stamp":"2024-04-25T23:03:22.343350+0000","last_deep_scrub":"97'280","last_deep_scrub_stamp":"2024-04-25T23:03:22.343350+0000","last_clean_scrub_stamp":"2024-04-25T23:03:22.343350+0000","objects_scrubbed":1,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:04.724635+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":4199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":194,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.346048+0000","last_change":"2024-04-25T23:02:56.346048+0000","last_active":"2024-04-25T23:02:56.346048+0000","last_peered":"2024-04-25T23:02:56.346048+0000","last_clean":"2024-04-25T23:02:56.346048+0000","last_became_active":"2024-04-25T23:02:15.188483+0000","last_became_peered":"2024-04-25T23:02:15.188483+0000","last_unstale":"2024-04-25T23:02:56.346048+0000","last_undegraded":"2024-04-25T23:02:56.346048+0000","last_fullsized":"2024-04-25T23:02:56.346048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:02:56.345813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:02:56.345813+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.345813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:13.796244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'349","reported_seq":522,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.011628+0000","last_change":"2024-04-25T23:02:56.011694+0000","last_active":"2024-04-25T23:02:56.011628+0000","last_peered":"2024-04-25T23:02:56.011628+0000","last_clean":"2024-04-25T23:02:56.011628+0000","last_became_active":"2024-04-25T23:02:25.081286+0000","last_became_peered":"2024-04-25T23:02:25.081286+0000","last_unstale":"2024-04-25T23:02:56.011628+0000","last_undegraded":"2024-04-25T23:02:56.011628+0000","last_fullsized":"2024-04-25T23:02:56.011628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'349","last_scrub_stamp":"2024-04-25T23:02:56.011405+0000","last_deep_scrub":"62'349","last_deep_scrub_stamp":"2024-04-25T23:02:56.011405+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.011405+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.217890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":315,"num_write_kb":25502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"61'49","reported_seq":237,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:54.383287+0000","last_change":"2024-04-25T23:02:54.383287+0000","last_active":"2024-04-25T23:02:54.383287+0000","last_peered":"2024-04-25T23:02:54.383287+0000","last_clean":"2024-04-25T23:02:54.383287+0000","last_became_active":"2024-04-25T23:02:15.189554+0000","last_became_peered":"2024-04-25T23:02:15.189554+0000","last_unstale":"2024-04-25T23:02:54.383287+0000","last_undegraded":"2024-04-25T23:02:54.383287+0000","last_fullsized":"2024-04-25T23:02:54.383287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'49","last_scrub_stamp":"2024-04-25T23:02:54.382996+0000","last_deep_scrub":"61'49","last_deep_scrub_stamp":"2024-04-25T23:02:54.382996+0000","last_clean_scrub_stamp":"2024-04-25T23:02:54.382996+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:33.765600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:13.926136+0000","last_change":"2024-04-25T23:03:13.926189+0000","last_active":"2024-04-25T23:03:13.926136+0000","last_peered":"2024-04-25T23:03:13.926136+0000","last_clean":"2024-04-25T23:03:13.926136+0000","last_became_active":"2024-04-25T23:02:15.099317+0000","last_became_peered":"2024-04-25T23:02:15.099317+0000","last_unstale":"2024-04-25T23:03:13.926136+0000","last_undegraded":"2024-04-25T23:03:13.926136+0000","last_fullsized":"2024-04-25T23:03:13.926136+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:03:13.925934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:03:13.925934+0000","last_clean_scrub_stamp":"2024-04-25T23:03:13.925934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:15:32.331195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"62'404","reported_seq":617,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:06.924182+0000","last_change":"2024-04-25T23:03:06.924239+0000","last_active":"2024-04-25T23:03:06.924182+0000","last_peered":"2024-04-25T23:03:06.924182+0000","last_clean":"2024-04-25T23:03:06.924182+0000","last_became_active":"2024-04-25T23:02:19.107642+0000","last_became_peered":"2024-04-25T23:02:19.107642+0000","last_unstale":"2024-04-25T23:03:06.924182+0000","last_undegraded":"2024-04-25T23:03:06.924182+0000","last_fullsized":"2024-04-25T23:03:06.924182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'404","last_scrub_stamp":"2024-04-25T23:03:06.923982+0000","last_deep_scrub":"62'404","last_deep_scrub_stamp":"2024-04-25T23:03:06.923982+0000","last_clean_scrub_stamp":"2024-04-25T23:03:06.923982+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:51:22.467532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21684,"num_write":370,"num_write_kb":62977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"97'60","reported_seq":249,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:02.530267+0000","last_change":"2024-04-25T23:03:02.530267+0000","last_active":"2024-04-25T23:03:02.530267+0000","last_peered":"2024-04-25T23:03:02.530267+0000","last_clean":"2024-04-25T23:03:02.530267+0000","last_became_active":"2024-04-25T23:02:15.194624+0000","last_became_peered":"2024-04-25T23:02:15.194624+0000","last_unstale":"2024-04-25T23:03:02.530267+0000","last_undegraded":"2024-04-25T23:03:02.530267+0000","last_fullsized":"2024-04-25T23:03:02.530267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'60","last_scrub_stamp":"2024-04-25T23:03:02.529991+0000","last_deep_scrub":"97'60","last_deep_scrub_stamp":"2024-04-25T23:03:02.529991+0000","last_clean_scrub_stamp":"2024-04-25T23:03:02.529991+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:41.599439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:00.463757+0000","last_change":"2024-04-25T23:03:00.463757+0000","last_active":"2024-04-25T23:03:00.463757+0000","last_peered":"2024-04-25T23:03:00.463757+0000","last_clean":"2024-04-25T23:03:00.463757+0000","last_became_active":"2024-04-25T23:02:15.190328+0000","last_became_peered":"2024-04-25T23:02:15.190328+0000","last_unstale":"2024-04-25T23:03:00.463757+0000","last_undegraded":"2024-04-25T23:03:00.463757+0000","last_fullsized":"2024-04-25T23:03:00.463757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:03:00.463487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:03:00.463487+0000","last_clean_scrub_stamp":"2024-04-25T23:03:00.463487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:25.818659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"62'402","reported_seq":583,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:57.377906+0000","last_change":"2024-04-25T23:02:57.377906+0000","last_active":"2024-04-25T23:02:57.377906+0000","last_peered":"2024-04-25T23:02:57.377906+0000","last_clean":"2024-04-25T23:02:57.377906+0000","last_became_active":"2024-04-25T22:59:06.809587+0000","last_became_peered":"2024-04-25T22:59:06.809587+0000","last_unstale":"2024-04-25T23:02:57.377906+0000","last_undegraded":"2024-04-25T23:02:57.377906+0000","last_fullsized":"2024-04-25T23:02:57.377906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'402","last_scrub_stamp":"2024-04-25T23:02:57.377651+0000","last_deep_scrub":"62'402","last_deep_scrub_stamp":"2024-04-25T23:02:57.377651+0000","last_clean_scrub_stamp":"2024-04-25T23:02:57.377651+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:14.862294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":611,"num_write":364,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"97'107","reported_seq":288,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:10.487039+0000","last_change":"2024-04-25T23:03:10.487039+0000","last_active":"2024-04-25T23:03:10.487039+0000","last_peered":"2024-04-25T23:03:10.487039+0000","last_clean":"2024-04-25T23:03:10.487039+0000","last_became_active":"2024-04-25T22:59:05.776489+0000","last_became_peered":"2024-04-25T22:59:05.776489+0000","last_unstale":"2024-04-25T23:03:10.487039+0000","last_undegraded":"2024-04-25T23:03:10.487039+0000","last_fullsized":"2024-04-25T23:03:10.487039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'107","last_scrub_stamp":"2024-04-25T23:03:10.486784+0000","last_deep_scrub":"97'107","last_deep_scrub_stamp":"2024-04-25T23:03:10.486784+0000","last_clean_scrub_stamp":"2024-04-25T23:03:10.486784+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:51.834214+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":194,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:58.282126+0000","last_change":"2024-04-25T23:02:58.282126+0000","last_active":"2024-04-25T23:02:58.282126+0000","last_peered":"2024-04-25T23:02:58.282126+0000","last_clean":"2024-04-25T23:02:58.282126+0000","last_became_active":"2024-04-25T23:02:15.192217+0000","last_became_peered":"2024-04-25T23:02:15.192217+0000","last_unstale":"2024-04-25T23:02:58.282126+0000","last_undegraded":"2024-04-25T23:02:58.282126+0000","last_fullsized":"2024-04-25T23:02:58.282126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:02:58.281867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:02:58.281867+0000","last_clean_scrub_stamp":"2024-04-25T23:02:58.281867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:05:21.901047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"62'408","reported_seq":655,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:02.907496+0000","last_change":"2024-04-25T23:03:02.907635+0000","last_active":"2024-04-25T23:03:02.907496+0000","last_peered":"2024-04-25T23:03:02.907496+0000","last_clean":"2024-04-25T23:03:02.907496+0000","last_became_active":"2024-04-25T23:02:20.079762+0000","last_became_peered":"2024-04-25T23:02:20.079762+0000","last_unstale":"2024-04-25T23:03:02.907496+0000","last_undegraded":"2024-04-25T23:03:02.907496+0000","last_fullsized":"2024-04-25T23:03:02.907496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'408","last_scrub_stamp":"2024-04-25T23:03:02.907262+0000","last_deep_scrub":"62'408","last_deep_scrub_stamp":"2024-04-25T23:03:02.907262+0000","last_clean_scrub_stamp":"2024-04-25T23:03:02.907262+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:23:41.423602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39741,"num_write":375,"num_write_kb":88320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"62'418","reported_seq":1013,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:26.313777+0000","last_change":"2024-04-25T23:03:26.313840+0000","last_active":"2024-04-25T23:03:26.313777+0000","last_peered":"2024-04-25T23:03:26.313777+0000","last_clean":"2024-04-25T23:03:26.313777+0000","last_became_active":"2024-04-25T23:02:28.179605+0000","last_became_peered":"2024-04-25T23:02:28.179605+0000","last_unstale":"2024-04-25T23:03:26.313777+0000","last_undegraded":"2024-04-25T23:03:26.313777+0000","last_fullsized":"2024-04-25T23:03:26.313777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'418","last_scrub_stamp":"2024-04-25T23:03:26.313579+0000","last_deep_scrub":"62'418","last_deep_scrub_stamp":"2024-04-25T23:03:26.313579+0000","last_clean_scrub_stamp":"2024-04-25T23:03:26.313579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:46:32.584144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24466,"num_write":380,"num_write_kb":65301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"97'252","reported_seq":452,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:54.214870+0000","last_change":"2024-04-25T23:02:54.214951+0000","last_active":"2024-04-25T23:02:54.214870+0000","last_peered":"2024-04-25T23:02:54.214870+0000","last_clean":"2024-04-25T23:02:54.214870+0000","last_became_active":"2024-04-25T23:02:18.186437+0000","last_became_peered":"2024-04-25T23:02:18.186437+0000","last_unstale":"2024-04-25T23:02:54.214870+0000","last_undegraded":"2024-04-25T23:02:54.214870+0000","last_fullsized":"2024-04-25T23:02:54.214870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'252","last_scrub_stamp":"2024-04-25T23:02:54.214687+0000","last_deep_scrub":"97'252","last_deep_scrub_stamp":"2024-04-25T23:02:54.214687+0000","last_clean_scrub_stamp":"2024-04-25T23:02:54.214687+0000","objects_scrubbed":6,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:40.808944+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9072334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9067540,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"62'430","reported_seq":1005,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:19.456489+0000","last_change":"2024-04-25T23:03:19.456554+0000","last_active":"2024-04-25T23:03:19.456489+0000","last_peered":"2024-04-25T23:03:19.456489+0000","last_clean":"2024-04-25T23:03:19.456489+0000","last_became_active":"2024-04-25T23:02:26.173542+0000","last_became_peered":"2024-04-25T23:02:26.173542+0000","last_unstale":"2024-04-25T23:03:19.456489+0000","last_undegraded":"2024-04-25T23:03:19.456489+0000","last_fullsized":"2024-04-25T23:03:19.456489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'430","last_scrub_stamp":"2024-04-25T23:03:19.456295+0000","last_deep_scrub":"62'430","last_deep_scrub_stamp":"2024-04-25T23:03:19.456295+0000","last_clean_scrub_stamp":"2024-04-25T23:03:19.456295+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:17.598089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12581,"num_write":398,"num_write_kb":99831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"97'100","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:15.943882+0000","last_change":"2024-04-25T23:03:15.943954+0000","last_active":"2024-04-25T23:03:15.943882+0000","last_peered":"2024-04-25T23:03:15.943882+0000","last_clean":"2024-04-25T23:03:15.943882+0000","last_became_active":"2024-04-25T23:02:15.098659+0000","last_became_peered":"2024-04-25T23:02:15.098659+0000","last_unstale":"2024-04-25T23:03:15.943882+0000","last_undegraded":"2024-04-25T23:03:15.943882+0000","last_fullsized":"2024-04-25T23:03:15.943882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'100","last_scrub_stamp":"2024-04-25T23:03:15.943693+0000","last_deep_scrub":"97'100","last_deep_scrub_stamp":"2024-04-25T23:03:15.943693+0000","last_clean_scrub_stamp":"2024-04-25T23:03:15.943693+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:44.343293+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"97'210","reported_seq":390,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:20.277181+0000","last_change":"2024-04-25T23:03:20.277248+0000","last_active":"2024-04-25T23:03:20.277181+0000","last_peered":"2024-04-25T23:03:20.277181+0000","last_clean":"2024-04-25T23:03:20.277181+0000","last_became_active":"2024-04-25T22:59:05.775614+0000","last_became_peered":"2024-04-25T22:59:05.775614+0000","last_unstale":"2024-04-25T23:03:20.277181+0000","last_undegraded":"2024-04-25T23:03:20.277181+0000","last_fullsized":"2024-04-25T23:03:20.277181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'210","last_scrub_stamp":"2024-04-25T23:03:20.276964+0000","last_deep_scrub":"97'210","last_deep_scrub_stamp":"2024-04-25T23:03:20.276964+0000","last_clean_scrub_stamp":"2024-04-25T23:03:20.276964+0000","objects_scrubbed":1,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:10.168667+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"62'482","reported_seq":685,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:07.476236+0000","last_change":"2024-04-25T23:03:07.476378+0000","last_active":"2024-04-25T23:03:07.476236+0000","last_peered":"2024-04-25T23:03:07.476236+0000","last_clean":"2024-04-25T23:03:07.476236+0000","last_became_active":"2024-04-25T22:59:06.789179+0000","last_became_peered":"2024-04-25T22:59:06.789179+0000","last_unstale":"2024-04-25T23:03:07.476236+0000","last_undegraded":"2024-04-25T23:03:07.476236+0000","last_fullsized":"2024-04-25T23:03:07.476236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'482","last_scrub_stamp":"2024-04-25T23:03:07.475983+0000","last_deep_scrub":"62'482","last_deep_scrub_stamp":"2024-04-25T23:03:07.475983+0000","last_clean_scrub_stamp":"2024-04-25T23:03:07.475983+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:29.109756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12949,"num_write":449,"num_write_kb":113429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'64","reported_seq":244,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:13.499623+0000","last_change":"2024-04-25T23:03:13.499683+0000","last_active":"2024-04-25T23:03:13.499623+0000","last_peered":"2024-04-25T23:03:13.499623+0000","last_clean":"2024-04-25T23:03:13.499623+0000","last_became_active":"2024-04-25T22:59:05.778423+0000","last_became_peered":"2024-04-25T22:59:05.778423+0000","last_unstale":"2024-04-25T23:03:13.499623+0000","last_undegraded":"2024-04-25T23:03:13.499623+0000","last_fullsized":"2024-04-25T23:03:13.499623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'64","last_scrub_stamp":"2024-04-25T23:03:13.499388+0000","last_deep_scrub":"61'64","last_deep_scrub_stamp":"2024-04-25T23:03:13.499388+0000","last_clean_scrub_stamp":"2024-04-25T23:03:13.499388+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:40.061293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"62'437","reported_seq":1050,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:21.401515+0000","last_change":"2024-04-25T23:03:21.401572+0000","last_active":"2024-04-25T23:03:21.401515+0000","last_peered":"2024-04-25T23:03:21.401515+0000","last_clean":"2024-04-25T23:03:21.401515+0000","last_became_active":"2024-04-25T23:02:33.175535+0000","last_became_peered":"2024-04-25T23:02:33.175535+0000","last_unstale":"2024-04-25T23:03:21.401515+0000","last_undegraded":"2024-04-25T23:03:21.401515+0000","last_fullsized":"2024-04-25T23:03:21.401515+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'437","last_scrub_stamp":"2024-04-25T23:03:21.401311+0000","last_deep_scrub":"62'437","last_deep_scrub_stamp":"2024-04-25T23:03:21.401311+0000","last_clean_scrub_stamp":"2024-04-25T23:03:21.401311+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:11.293013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":6721,"num_write":411,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"62'344","reported_seq":512,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:00.956884+0000","last_change":"2024-04-25T23:03:00.957016+0000","last_active":"2024-04-25T23:03:00.956884+0000","last_peered":"2024-04-25T23:03:00.956884+0000","last_clean":"2024-04-25T23:03:00.956884+0000","last_became_active":"2024-04-25T23:02:22.084542+0000","last_became_peered":"2024-04-25T23:02:22.084542+0000","last_unstale":"2024-04-25T23:03:00.956884+0000","last_undegraded":"2024-04-25T23:03:00.956884+0000","last_fullsized":"2024-04-25T23:03:00.956884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'344","last_scrub_stamp":"2024-04-25T23:03:00.956653+0000","last_deep_scrub":"62'344","last_deep_scrub_stamp":"2024-04-25T23:03:00.956653+0000","last_clean_scrub_stamp":"2024-04-25T23:03:00.956653+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:00:21.663550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4626,"num_write":319,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"97'571","reported_seq":766,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:04.492404+0000","last_change":"2024-04-25T23:03:04.492471+0000","last_active":"2024-04-25T23:03:04.492404+0000","last_peered":"2024-04-25T23:03:04.492404+0000","last_clean":"2024-04-25T23:03:04.492404+0000","last_became_active":"2024-04-25T23:02:18.180561+0000","last_became_peered":"2024-04-25T23:02:18.180561+0000","last_unstale":"2024-04-25T23:03:04.492404+0000","last_undegraded":"2024-04-25T23:03:04.492404+0000","last_fullsized":"2024-04-25T23:03:04.492404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'571","last_scrub_stamp":"2024-04-25T23:03:04.492162+0000","last_deep_scrub":"97'571","last_deep_scrub_stamp":"2024-04-25T23:03:04.492162+0000","last_clean_scrub_stamp":"2024-04-25T23:03:04.492162+0000","objects_scrubbed":2,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:31.037124+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"62'423","reported_seq":647,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:03.492724+0000","last_change":"2024-04-25T23:03:03.492724+0000","last_active":"2024-04-25T23:03:03.492724+0000","last_peered":"2024-04-25T23:03:03.492724+0000","last_clean":"2024-04-25T23:03:03.492724+0000","last_became_active":"2024-04-25T22:59:06.794809+0000","last_became_peered":"2024-04-25T22:59:06.794809+0000","last_unstale":"2024-04-25T23:03:03.492724+0000","last_undegraded":"2024-04-25T23:03:03.492724+0000","last_fullsized":"2024-04-25T23:03:03.492724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'423","last_scrub_stamp":"2024-04-25T23:03:03.492465+0000","last_deep_scrub":"62'423","last_deep_scrub_stamp":"2024-04-25T23:03:03.492465+0000","last_clean_scrub_stamp":"2024-04-25T23:03:03.492465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:18.974583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24677,"num_write":395,"num_write_kb":89280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"97'203","reported_seq":383,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:14.524210+0000","last_change":"2024-04-25T23:03:14.524272+0000","last_active":"2024-04-25T23:03:14.524210+0000","last_peered":"2024-04-25T23:03:14.524210+0000","last_clean":"2024-04-25T23:03:14.524210+0000","last_became_active":"2024-04-25T22:59:05.778260+0000","last_became_peered":"2024-04-25T22:59:05.778260+0000","last_unstale":"2024-04-25T23:03:14.524210+0000","last_undegraded":"2024-04-25T23:03:14.524210+0000","last_fullsized":"2024-04-25T23:03:14.524210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'203","last_scrub_stamp":"2024-04-25T23:03:14.524008+0000","last_deep_scrub":"97'203","last_deep_scrub_stamp":"2024-04-25T23:03:14.524008+0000","last_clean_scrub_stamp":"2024-04-25T23:03:14.524008+0000","objects_scrubbed":1,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:28:23.029632+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"62'397","reported_seq":599,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:22.013134+0000","last_change":"2024-04-25T23:03:22.013257+0000","last_active":"2024-04-25T23:03:22.013134+0000","last_peered":"2024-04-25T23:03:22.013134+0000","last_clean":"2024-04-25T23:03:22.013134+0000","last_became_active":"2024-04-25T23:02:34.094640+0000","last_became_peered":"2024-04-25T23:02:34.094640+0000","last_unstale":"2024-04-25T23:03:22.013134+0000","last_undegraded":"2024-04-25T23:03:22.013134+0000","last_fullsized":"2024-04-25T23:03:22.013134+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'397","last_scrub_stamp":"2024-04-25T23:03:22.012843+0000","last_deep_scrub":"62'397","last_deep_scrub_stamp":"2024-04-25T23:03:22.012843+0000","last_clean_scrub_stamp":"2024-04-25T23:03:22.012843+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:25.493827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32625,"num_write":352,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"97'222","reported_seq":392,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:17.009839+0000","last_change":"2024-04-25T23:03:17.009911+0000","last_active":"2024-04-25T23:03:17.009839+0000","last_peered":"2024-04-25T23:03:17.009839+0000","last_clean":"2024-04-25T23:03:17.009839+0000","last_became_active":"2024-04-25T23:02:18.093417+0000","last_became_peered":"2024-04-25T23:02:18.093417+0000","last_unstale":"2024-04-25T23:03:17.009839+0000","last_undegraded":"2024-04-25T23:03:17.009839+0000","last_fullsized":"2024-04-25T23:03:17.009839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'222","last_scrub_stamp":"2024-04-25T23:03:17.009649+0000","last_deep_scrub":"97'222","last_deep_scrub_stamp":"2024-04-25T23:03:17.009649+0000","last_clean_scrub_stamp":"2024-04-25T23:03:17.009649+0000","objects_scrubbed":3,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:05.224909+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":12368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"62'384","reported_seq":552,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:03.921651+0000","last_change":"2024-04-25T23:03:03.921707+0000","last_active":"2024-04-25T23:03:03.921651+0000","last_peered":"2024-04-25T23:03:03.921651+0000","last_clean":"2024-04-25T23:03:03.921651+0000","last_became_active":"2024-04-25T23:02:29.088813+0000","last_became_peered":"2024-04-25T23:02:29.088813+0000","last_unstale":"2024-04-25T23:03:03.921651+0000","last_undegraded":"2024-04-25T23:03:03.921651+0000","last_fullsized":"2024-04-25T23:03:03.921651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'384","last_scrub_stamp":"2024-04-25T23:03:03.921450+0000","last_deep_scrub":"62'384","last_deep_scrub_stamp":"2024-04-25T23:03:03.921450+0000","last_clean_scrub_stamp":"2024-04-25T23:03:03.921450+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:02.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6751,"num_write":355,"num_write_kb":59101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"97'53","reported_seq":93,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:14.925518+0000","last_change":"2024-04-25T23:03:14.925584+0000","last_active":"2024-04-25T23:03:14.925518+0000","last_peered":"2024-04-25T23:03:14.925518+0000","last_clean":"2024-04-25T23:03:14.925518+0000","last_became_active":"2024-04-25T23:02:15.094572+0000","last_became_peered":"2024-04-25T23:02:15.094572+0000","last_unstale":"2024-04-25T23:03:14.925518+0000","last_undegraded":"2024-04-25T23:03:14.925518+0000","last_fullsized":"2024-04-25T23:03:14.925518+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'53","last_scrub_stamp":"2024-04-25T23:03:14.925324+0000","last_deep_scrub":"97'53","last_deep_scrub_stamp":"2024-04-25T23:03:14.925324+0000","last_clean_scrub_stamp":"2024-04-25T23:03:14.925324+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:53.800277+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"62'384","reported_seq":605,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:59.317855+0000","last_change":"2024-04-25T23:02:59.317973+0000","last_active":"2024-04-25T23:02:59.317855+0000","last_peered":"2024-04-25T23:02:59.317855+0000","last_clean":"2024-04-25T23:02:59.317855+0000","last_became_active":"2024-04-25T22:59:06.803682+0000","last_became_peered":"2024-04-25T22:59:06.803682+0000","last_unstale":"2024-04-25T23:02:59.317855+0000","last_undegraded":"2024-04-25T23:02:59.317855+0000","last_fullsized":"2024-04-25T23:02:59.317855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'384","last_scrub_stamp":"2024-04-25T23:02:59.317511+0000","last_deep_scrub":"62'384","last_deep_scrub_stamp":"2024-04-25T23:02:59.317511+0000","last_clean_scrub_stamp":"2024-04-25T23:02:59.317511+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:37.927492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21901,"num_write":359,"num_write_kb":71192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"97'204","reported_seq":384,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:14.332009+0000","last_change":"2024-04-25T23:03:14.332074+0000","last_active":"2024-04-25T23:03:14.332009+0000","last_peered":"2024-04-25T23:03:14.332009+0000","last_clean":"2024-04-25T23:03:14.332009+0000","last_became_active":"2024-04-25T22:59:05.787625+0000","last_became_peered":"2024-04-25T22:59:05.787625+0000","last_unstale":"2024-04-25T23:03:14.332009+0000","last_undegraded":"2024-04-25T23:03:14.332009+0000","last_fullsized":"2024-04-25T23:03:14.332009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'204","last_scrub_stamp":"2024-04-25T23:03:14.331827+0000","last_deep_scrub":"97'204","last_deep_scrub_stamp":"2024-04-25T23:03:14.331827+0000","last_clean_scrub_stamp":"2024-04-25T23:03:14.331827+0000","objects_scrubbed":2,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:15.491709+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"62'408","reported_seq":667,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:12.306544+0000","last_change":"2024-04-25T23:03:12.306601+0000","last_active":"2024-04-25T23:03:12.306544+0000","last_peered":"2024-04-25T23:03:12.306544+0000","last_clean":"2024-04-25T23:03:12.306544+0000","last_became_active":"2024-04-25T22:59:06.795279+0000","last_became_peered":"2024-04-25T22:59:06.795279+0000","last_unstale":"2024-04-25T23:03:12.306544+0000","last_undegraded":"2024-04-25T23:03:12.306544+0000","last_fullsized":"2024-04-25T23:03:12.306544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'408","last_scrub_stamp":"2024-04-25T23:03:12.306340+0000","last_deep_scrub":"62'408","last_deep_scrub_stamp":"2024-04-25T23:03:12.306340+0000","last_clean_scrub_stamp":"2024-04-25T23:03:12.306340+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:38.868244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":45299,"num_write":379,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"97'278","reported_seq":457,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:19.040823+0000","last_change":"2024-04-25T23:03:19.040899+0000","last_active":"2024-04-25T23:03:19.040823+0000","last_peered":"2024-04-25T23:03:19.040823+0000","last_clean":"2024-04-25T23:03:19.040823+0000","last_became_active":"2024-04-25T23:02:18.095458+0000","last_became_peered":"2024-04-25T23:02:18.095458+0000","last_unstale":"2024-04-25T23:03:19.040823+0000","last_undegraded":"2024-04-25T23:03:19.040823+0000","last_fullsized":"2024-04-25T23:03:19.040823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'278","last_scrub_stamp":"2024-04-25T23:03:19.040626+0000","last_deep_scrub":"97'278","last_deep_scrub_stamp":"2024-04-25T23:03:19.040626+0000","last_clean_scrub_stamp":"2024-04-25T23:03:19.040626+0000","objects_scrubbed":4,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:28.521167+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"62'454","reported_seq":654,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:56.980962+0000","last_change":"2024-04-25T23:02:56.981027+0000","last_active":"2024-04-25T23:02:56.980962+0000","last_peered":"2024-04-25T23:02:56.980962+0000","last_clean":"2024-04-25T23:02:56.980962+0000","last_became_active":"2024-04-25T23:02:24.110113+0000","last_became_peered":"2024-04-25T23:02:24.110113+0000","last_unstale":"2024-04-25T23:02:56.980962+0000","last_undegraded":"2024-04-25T23:02:56.980962+0000","last_fullsized":"2024-04-25T23:02:56.980962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'454","last_scrub_stamp":"2024-04-25T23:02:56.980762+0000","last_deep_scrub":"62'454","last_deep_scrub_stamp":"2024-04-25T23:02:56.980762+0000","last_clean_scrub_stamp":"2024-04-25T23:02:56.980762+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:54.804590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19397,"num_write":421,"num_write_kb":121809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"97'60","reported_seq":253,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:02:58.440468+0000","last_change":"2024-04-25T23:02:58.440468+0000","last_active":"2024-04-25T23:02:58.440468+0000","last_peered":"2024-04-25T23:02:58.440468+0000","last_clean":"2024-04-25T23:02:58.440468+0000","last_became_active":"2024-04-25T23:02:15.191963+0000","last_became_peered":"2024-04-25T23:02:15.191963+0000","last_unstale":"2024-04-25T23:02:58.440468+0000","last_undegraded":"2024-04-25T23:02:58.440468+0000","last_fullsized":"2024-04-25T23:02:58.440468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'60","last_scrub_stamp":"2024-04-25T23:02:58.440212+0000","last_deep_scrub":"97'60","last_deep_scrub_stamp":"2024-04-25T23:02:58.440212+0000","last_clean_scrub_stamp":"2024-04-25T23:02:58.440212+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:08.829420+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'453","reported_seq":666,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:11.303674+0000","last_change":"2024-04-25T23:03:11.303740+0000","last_active":"2024-04-25T23:03:11.303674+0000","last_peered":"2024-04-25T23:03:11.303674+0000","last_clean":"2024-04-25T23:03:11.303674+0000","last_became_active":"2024-04-25T22:59:06.807058+0000","last_became_peered":"2024-04-25T22:59:06.807058+0000","last_unstale":"2024-04-25T23:03:11.303674+0000","last_undegraded":"2024-04-25T23:03:11.303674+0000","last_fullsized":"2024-04-25T23:03:11.303674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'453","last_scrub_stamp":"2024-04-25T23:03:11.303468+0000","last_deep_scrub":"62'453","last_deep_scrub_stamp":"2024-04-25T23:03:11.303468+0000","last_clean_scrub_stamp":"2024-04-25T23:03:11.303468+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:20.031538+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18968,"num_write":424,"num_write_kb":95427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"97'119","reported_seq":300,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T23:03:15.550740+0000","last_change":"2024-04-25T23:03:15.550740+0000","last_active":"2024-04-25T23:03:15.550740+0000","last_peered":"2024-04-25T23:03:15.550740+0000","last_clean":"2024-04-25T23:03:15.550740+0000","last_became_active":"2024-04-25T22:59:05.778675+0000","last_became_peered":"2024-04-25T22:59:05.778675+0000","last_unstale":"2024-04-25T23:03:15.550740+0000","last_undegraded":"2024-04-25T23:03:15.550740+0000","last_fullsized":"2024-04-25T23:03:15.550740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'119","last_scrub_stamp":"2024-04-25T23:03:15.550459+0000","last_deep_scrub":"97'119","last_deep_scrub_stamp":"2024-04-25T23:03:15.550459+0000","last_clean_scrub_stamp":"2024-04-25T23:03:15.550459+0000","objects_scrubbed":3,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:16.710341+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":1281444,"num_write":24604,"num_write_kb":4372422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7465,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26631,"ondisk_log_size":26631,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127978851,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1472,"num_write":4697,"num_write_kb":128545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":84565102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":256020480,"data_stored":255957702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},"log_size":6519,"ondisk_log_size":6519,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":69,"seq":296352743441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142124,"kb_used_data":84068,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94229716,"statfs":{"total":96636764160,"available":96491229184,"internally_reserved":0,"allocated":86085632,"data_stored":85569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6005,"internal_metadata":59435147},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161236,"kb_used_data":80140,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94210604,"statfs":{"total":96636764160,"available":96471658496,"internally_reserved":0,"allocated":82063360,"data_stored":81566497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179016,"kb_used_data":89600,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94192824,"statfs":{"total":96636764160,"available":96453451776,"internally_reserved":0,"allocated":91750400,"data_stored":91229381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90259456,"data_stored":90230115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81166336,"data_stored":81157599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":84594688,"data_stored":84569988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4410,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:03:34.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T23:03:34.525 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T23:03:34.525 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T23:03:34.836 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:03:34.837 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:59:06.119108+0000","modified":"2024-04-25T22:59:09.146644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/857639461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":857639461},{"type":"v1","addr":"172.21.15.43:6803","nonce":857639461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-04-25T23:03:34.837 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T23:03:34.855 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T23:03:35.167 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:03:35.167 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:59:06.119108+0000","modified":"2024-04-25T22:59:09.146644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/857639461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":857639461},{"type":"v1","addr":"172.21.15.43:6803","nonce":857639461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-04-25T23:03:35.167 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T23:03:35.185 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:03:35.472 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T23:03:35.473 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":97,"fsid":"8d6ec37a-06d7-4d24-9516-19a660848874","created":"2024-04-25T22:58:45.412350+0000","modified":"2024-04-25T23:02:42.171953+0000","last_up_change":"2024-04-25T23:02:14.651926+0000","last_in_change":"2024-04-25T22:58:46.328330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:58:56.581519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:59:00.664462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:59:04.692579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:59:05.120185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3af34823-d803-4ca7-8300-4935c4b3ba2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6801","nonce":2867603478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6803","nonce":2867603478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6807","nonce":2867603478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2867603478},{"type":"v1","addr":"172.21.15.99:6805","nonce":2867603478}]},"public_addr":"172.21.15.99:6801/2867603478","cluster_addr":"172.21.15.99:6803/2867603478","heartbeat_back_addr":"172.21.15.99:6807/2867603478","heartbeat_front_addr":"172.21.15.99:6805/2867603478","state":["exists","up"]},{"osd":1,"uuid":"13349ae7-4074-4fe6-8cc5-f6e9a003ba23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6801","nonce":66914404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6803","nonce":66914404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6807","nonce":66914404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":66914404},{"type":"v1","addr":"172.21.15.165:6805","nonce":66914404}]},"public_addr":"172.21.15.165:6801/66914404","cluster_addr":"172.21.15.165:6803/66914404","heartbeat_back_addr":"172.21.15.165:6807/66914404","heartbeat_front_addr":"172.21.15.165:6805/66914404","state":["exists","up"]},{"osd":2,"uuid":"86c4b994-d0fe-4635-ae55-e8a4902029d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":21,"up_from":69,"up_thru":96,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6801","nonce":805033024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6803","nonce":805033024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6807","nonce":805033024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":805033024},{"type":"v1","addr":"172.21.15.172:6805","nonce":805033024}]},"public_addr":"172.21.15.172:6801/805033024","cluster_addr":"172.21.15.172:6803/805033024","heartbeat_back_addr":"172.21.15.172:6807/805033024","heartbeat_front_addr":"172.21.15.172:6805/805033024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.751434+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.708543+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:58:51.809063+0000","dead_epoch":21}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:03:35.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T23:03:35.829 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T23:03:35.851 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T23:03:35.874 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-04-25T23:03:36.851 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T23:03:37.840 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-04-25T23:03:37.863 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T23:03:38.852 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-04-25T23:03:38.875 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T23:03:38.875 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T23:03:38.875 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:38.886 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T23:03:38.886 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T23:03:38.886 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T23:03:38.886 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:38.949 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T23:03:38.950 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T23:03:38.950 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:39.037 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T23:03:39.038 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T23:03:39.038 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:39.096 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T23:03:39.097 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T23:03:39.097 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T23:03:39.097 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:39.127 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T23:03:39.127 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T23:03:39.127 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:39.199 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T23:03:39.200 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T23:03:39.200 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T23:03:39.200 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:39.260 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T23:03:39.260 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T23:03:39.260 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:39.323 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T23:03:39.323 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T23:03:39.323 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:03:39.387 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T23:03:39.387 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T23:03:39.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-25T23:03:39.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-04-25T23:03:39.449 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T23:03:39.621 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T23:03:39.622 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T23:03:39.780 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T23:03:39.780 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T23:03:39.980 INFO:tasks.ceph:Archiving mon data... 2024-04-25T23:03:39.981 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/data/mon.a.tgz 2024-04-25T23:03:39.982 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-25T23:03:39.987 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.hq9rV5PZxY 2024-04-25T23:03:39.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hq9rV5PZxY 2024-04-25T23:03:40.127 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.hq9rV5PZxY 2024-04-25T23:03:40.192 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.hq9rV5PZxY is 394KB 2024-04-25T23:03:40.253 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.hq9rV5PZxY 2024-04-25T23:03:40.259 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/data/mon.b.tgz 2024-04-25T23:03:40.259 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-25T23:03:40.308 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.pLV2RLdgLq 2024-04-25T23:03:40.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.pLV2RLdgLq 2024-04-25T23:03:40.481 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.pLV2RLdgLq 2024-04-25T23:03:40.544 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.pLV2RLdgLq is 548KB 2024-04-25T23:03:40.606 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.pLV2RLdgLq 2024-04-25T23:03:40.612 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/data/mon.c.tgz 2024-04-25T23:03:40.612 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-25T23:03:40.660 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.Kqz1ZdV6h4 2024-04-25T23:03:40.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Kqz1ZdV6h4 2024-04-25T23:03:40.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.Kqz1ZdV6h4 2024-04-25T23:03:40.900 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.Kqz1ZdV6h4 is 548KB 2024-04-25T23:03:40.962 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.Kqz1ZdV6h4 2024-04-25T23:03:40.967 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T23:03:40.967 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T23:03:41.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T23:03:41.016 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T23:03:41.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T23:03:41.330 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T23:03:41.335 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T23:03:41.341 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T23:03:41.364 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T23:03:41.364 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T23:03:41.366 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi043/crash 2024-04-25T23:03:41.367 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T23:03:41.385 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi099/crash 2024-04-25T23:03:41.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T23:03:41.399 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi165/crash 2024-04-25T23:03:41.402 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T23:03:41.415 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi172/crash 2024-04-25T23:03:41.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T23:03:41.449 INFO:tasks.ceph:Compressing logs... 2024-04-25T23:03:41.449 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T23:03:41.452 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T23:03:41.454 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T23:03:41.459 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T23:03:41.473 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22123.log 2024-04-25T23:03:41.474 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23834.log 2024-04-25T23:03:41.475 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23805.log 2024-04-25T23:03:41.475 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22123.log.gz 2024-04-25T23:03:41.475 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23834.log.gz 2024-04-25T23:03:41.475 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27207.log 2024-04-25T23:03:41.476 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23665.log 2024-04-25T23:03:41.476 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23805.log.gz 2024-04-25T23:03:41.477 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21196.log 2024-04-25T23:03:41.477 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27207.log.gz 2024-04-25T23:03:41.477 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23665.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.23665.log.gz 2024-04-25T23:03:41.477 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.25577.log 2024-04-25T23:03:41.477 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22565.log 2024-04-25T23:03:41.477 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21196.log.gz 2024-04-25T23:03:41.479 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21222.log 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25577.log.gz 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22565.log.gz 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24420.log 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26607.log 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21222.log.gz 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24420.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24420.log.gz 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25744.log 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26607.log.gz 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21577.log 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25744.log.gz 2024-04-25T23:03:41.480 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26929.log 2024-04-25T23:03:41.483 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21897.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21577.log.gz 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25718.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26929.log.gz 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22279.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21897.log.gz 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25828.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25718.log.gz 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27259.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22279.log.gz 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23889.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25828.log.gz 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27259.log.gz 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20885.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20743.log 2024-04-25T23:03:41.484 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23889.log.gz 2024-04-25T23:03:41.485 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.20885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26399.log 2024-04-25T23:03:41.485 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20885.log.gz 2024-04-25T23:03:41.485 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.20743.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.20743.log.gz -5 2024-04-25T23:03:41.485 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.27363.log 2024-04-25T23:03:41.485 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.26399.log: /var/log/ceph/ceph-client.admin.22938.log 2024-04-25T23:03:41.490 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26399.log.gz 2024-04-25T23:03:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21967.log 2024-04-25T23:03:41.490 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27363.log.gz 2024-04-25T23:03:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22938.log.gz 2024-04-25T23:03:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24112.log 2024-04-25T23:03:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27856.log 2024-04-25T23:03:41.490 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21967.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23914.log 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24112.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27441.log 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27856.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26125.log 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23914.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21020.log 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27441.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26125.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22647.log 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26428.log 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21020.log.gz 2024-04-25T23:03:41.491 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22647.log.gz 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26768.log 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24336.log 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26428.log.gz 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22383.log 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26768.log.gz 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27337.log 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24336.log.gz 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23183.log 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22383.log.gz 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22149.log 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27337.log.gz 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23694.log 2024-04-25T23:03:41.492 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23183.log.gz 2024-04-25T23:03:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22253.log 2024-04-25T23:03:41.502 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22149.log.gz 2024-04-25T23:03:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25944.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23694.log.gz 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21738.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22253.log.gz 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26234.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25944.log.gz 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24054.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21738.log.gz 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21818.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26234.log.gz 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21276.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24054.log.gz 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24831.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21818.log.gz 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20940.log 2024-04-25T23:03:41.503 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21276.log.gz 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24252.log 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24831.log.gz 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.20940.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23284.log 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20940.log.gz 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22305.log 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24252.log.gz 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21740.log 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23284.log.gz 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27752.log 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22305.log.gz 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23999.log 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21740.log.gz 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27389.log 2024-04-25T23:03:41.504 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27752.log.gz 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22201.log 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23999.log.gz 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25889.log 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27389.log.gz 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27702.log 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22201.log.gz 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24171.log 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25889.log.gz 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26772.log 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27702.log.gz 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26469.log 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24171.log.gz 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.26772.log: -- /var/log/ceph/ceph-client.admin.23774.log 2024-04-25T23:03:41.505 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26772.log.gz 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26469.log.gz 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23128.log 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21499.log 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23774.log.gz 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25832.log 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23128.log.gz 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24857.log 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21499.log.gz 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25832.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25832.log.gz 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22487.log 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24857.log.gz 2024-04-25T23:03:41.506 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23212.log 2024-04-25T23:03:41.507 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20550.log 2024-04-25T23:03:41.507 INFO:teuthology.orchestra.run.smithi043.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.22487.log.gz 2024-04-25T23:03:41.523 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21682.log 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21634.log 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.21682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.741.log 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21682.log.gz 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.21634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21658.log 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21634.log.gz 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.741.log.gz 2024-04-25T23:03:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.21658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21658.log.gz 2024-04-25T23:03:41.548 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22872.log 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23212.log.gz 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.20550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21248.log 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20550.log.gz 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.22872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24614.log 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr: 33.7% -- replaced with /var/log/ceph/ceph-client.0.22872.log.gz 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21447.log 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21248.log.gz 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26131.log 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24614.log.gz 2024-04-25T23:03:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24305.log 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21447.log.gz 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23343.log 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26131.log.gz 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24559.log 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24305.log.gz 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23236.log 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23343.log.gz 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25393.log 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24559.log.gz 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24641.log 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23236.log.gz 2024-04-25T23:03:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21896.log 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25393.log.gz 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26208.log 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24641.log.gz 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26633.log 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21896.log.gz 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23948.log 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26208.log.gz 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26773.log 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26633.log.gz 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25167.log 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23948.log.gz 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26737.log 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26773.log.gz 2024-04-25T23:03:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25167.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20348.log 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25167.log.gz 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27285.log 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26737.log.gz 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.tmp-client.admin.20348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24945.log 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20348.log.gz 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27830.log 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27285.log.gz 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21365.log 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24945.log.gz 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25314.log 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27830.log.gz 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26843.log 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21365.log.gz 2024-04-25T23:03:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26046.log 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25314.log.gz 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24768.log 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26843.log.gz 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22071.log 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26046.log.gz 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23610.log 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24768.log.gz 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21811.log 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22071.log.gz 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5/var/log/ceph/ceph-client.admin.23610.log: --verbose -- /var/log/ceph/ceph-client.admin.25602.log 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23610.log.gz 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27519.log 0.0% 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21811.log.gz 2024-04-25T23:03:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25798.log 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25602.log.gz 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5/var/log/ceph/ceph-client.admin.27519.log: --verbose -- /var/log/ceph/ceph-client.admin.27597.log 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27519.log.gz 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26293.log 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25798.log.gz 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26921.log 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27597.log.gz 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27571.log 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26293.log.gz 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22045.log 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26921.log.gz 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21092.log 2024-04-25T23:03:41.570 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27571.log.gz 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27778.log 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22045.log.gz 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23580.log 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21092.log.gz 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24802.log 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27778.log.gz 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22591.log 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23580.log.gz 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26851.log 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24802.log.gz 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22591.log.gz 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25490.log 2024-04-25T23:03:41.571 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26101.log 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26851.log.gz 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25490.log.gz 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27311.log 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22539.log 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26101.log.gz 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27623.log 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27311.log.gz 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23394.log 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22539.log.gz 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22907.log 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27623.log.gz 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22409.log 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23394.log.gz 2024-04-25T23:03:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20766.log 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22907.log.gz 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21551.log 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22409.log.gz 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27804.log 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.20766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20766.log.gz 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24028.log 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21551.log.gz 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21655.log 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27804.log.gz 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.24028.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24281.log 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24028.log.gz 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26685.log 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21655.log.gz 2024-04-25T23:03:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26581.log 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24281.log.gz 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24499.log 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26685.log.gz 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27493.log 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26581.log.gz 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20965.log 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24499.log.gz 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24475.log 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27493.log.gz 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.20965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26373.log 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20965.log.gz 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27155.log 2024-04-25T23:03:41.574 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24475.log.gz 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27927.log 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26373.log.gz 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26073.log 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27155.log.gz 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21339.log 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27927.log.gz 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25420.log 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26073.log.gz 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21339.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21339.log.gz 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25548.log 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25420.log.gz 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24142.log 2024-04-25T23:03:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.25548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25548.log.gz 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23157.log 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21144.log 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24142.log.gz 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23157.log.gz 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27129.log 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26555.log 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21144.log.gz 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27129.log.gz 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24197.log 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26555.log.gz 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22681.log 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24197.log.gz 2024-04-25T23:03:41.576 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25272.log 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26523.log 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22681.log.gz 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23450.log 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25272.log.gz 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24941.log 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26523.log.gz 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21066.log 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23450.log: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23450.log.gz 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22693.log 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24941.log.gz 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25913.log 2024-04-25T23:03:41.577 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21066.log.gz 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22693.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.22683.log -- replaced with /var/log/ceph/ceph-client.admin.22693.log.gz 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25913.log.gz 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27103.log 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23944.log 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22683.log.gz 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27103.log.gz 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23526.log 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24365.log 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23944.log.gz 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23526.log.gz 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27545.log 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21681.log 2024-04-25T23:03:41.578 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24365.log.gz 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27545.log.gz 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21473.log 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27233.log 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21681.log.gz 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21473.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21473.log.gz -5 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23860.log 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27233.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 0.0% 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27233.log.gz 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23860.log.gz 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23420.log 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23500.log 2024-04-25T23:03:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23420.log.gz 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23016.log 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23260.log 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23500.log: /var/log/ceph/ceph-client.admin.23016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23500.log.gz 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23016.log.gz 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27726.log 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21118.log 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23260.log.gz 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21975.log 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27726.log.gz 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27649.log 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21118.log.gz 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21975.log.gz 2024-04-25T23:03:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24585.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25025.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27649.log.gz 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24585.log.gz 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22227.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26925.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25025.log.gz 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25689.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22227.log.gz 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24743.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26925.log.gz 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25689.log.gz 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26999.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24886.log 2024-04-25T23:03:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24743.log: /var/log/ceph/ceph-client.admin.26999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24743.log.gz 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26999.log.gz 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27181.log 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22617.log 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24886.log.gz 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27181.log.gz 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23446.log 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26659.log 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22617.log.gz 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23446.log.gz 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26260.log 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21889.log 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26659.log: /var/log/ceph/ceph-client.admin.26260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26659.log.gz 2024-04-25T23:03:41.582 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26260.log.gz 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20991.log 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25135.log 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21889.log.gz 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.20991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25519.log 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20991.log.gz 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25135.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25135.log.gz 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25519.log.gz 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23555.log 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25970.log 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.23555.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23555.log.gz 2024-04-25T23:03:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26495.log 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25970.log.gz 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26182.log 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24911.log 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26495.log.gz 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26182.log.gz 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25996.log 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26289.log 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24911.log.gz/var/log/ceph/ceph-client.admin.25996.log: 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23639.log 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25996.log.gz 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26289.log.gz 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27051.log 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T23:03:41.584 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27025.log 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23639.log.gz 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23072.log 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27051.log.gz 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25773.log 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27025.log.gz 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23072.log.gz 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22461.log 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24530.log 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25773.log: /var/log/ceph/ceph-client.admin.22461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25773.log.gz 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23749.log 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22461.log.gz 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24530.log.gz 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25051.log 2024-04-25T23:03:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21421.log 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23749.log: 0.0%/var/log/ceph/ceph-client.admin.25051.log: -- replaced with /var/log/ceph/ceph-client.admin.23749.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23043.log 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25051.log.gz 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24391.log 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21421.log.gz 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24996.log 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23043.log.gz 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24391.log.gz 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25634.log 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21707.log 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24996.log: /var/log/ceph/ceph-client.admin.25634.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21391.log 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25634.log.gz 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24996.log.gz 2024-04-25T23:03:41.586 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25105.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21707.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21974.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21391.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23339.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25105.log: /var/log/ceph/ceph-client.admin.21974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25105.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21629.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21974.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24226.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23339.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23720.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21629.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24226.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26711.log 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23720.log.gz 2024-04-25T23:03:41.587 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22175.log 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27901.log 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26711.log.gz 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24083.log 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22175.log.gz 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26344.log 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27901.log: /var/log/ceph/ceph-client.admin.24083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27901.log.gz 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24083.log.gz 2024-04-25T23:03:41.588 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22987.log 2024-04-25T23:03:41.589 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T23:03:41.596 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21170.log 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26344.log.gz 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22987.log.gz 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21741.log 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24446.log 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21170.log: /var/log/ceph/ceph-client.admin.21741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21304.log 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21170.log.gz 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21741.log.gz 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.24446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24446.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26850.log 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.21304.log: /var/log/ceph/ceph-client.admin.21819.log 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21304.log.gz 2024-04-25T23:03:41.597 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27077.log 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26850.log.gz 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21819.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.21819.log.gz --verbose 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr: -- /var/log/ceph/ceph-client.admin.27467.log 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22097.log 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27077.log.gz 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27467.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.27467.log.gz -- 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr: /var/log/ceph/ceph-client.admin.23097.log 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27675.log 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22097.log.gz 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22357.log 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23097.log.gz 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22331.log 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27675.log.gz 2024-04-25T23:03:41.598 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22357.log.gz 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21603.log 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25638.log 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22331.log.gz 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25216.log 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21603.log.gz 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26000.log 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25638.log.gz 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25216.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21525.log 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25216.log.gz 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26000.log.gz 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23309.log 2024-04-25T23:03:41.599 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.21525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22435.log 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21525.log.gz 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.23309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25080.log 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23309.log.gz 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.22435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27415.log 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22435.log.gz 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.25080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25080.log.gz 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27415.log.gz 2024-04-25T23:03:41.600 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T23:03:41.666 INFO:teuthology.orchestra.run.smithi043.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T23:03:41.672 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T23:03:41.771 INFO:teuthology.orchestra.run.smithi043.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T23:03:41.772 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-25T23:03:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m0.318s 2024-04-25T23:03:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m0.762s 2024-04-25T23:03:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m0.117s 2024-04-25T23:03:42.341 INFO:teuthology.orchestra.run.smithi172.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T23:03:42.343 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T23:03:42.343 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m0.839s 2024-04-25T23:03:42.343 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m0.784s 2024-04-25T23:03:42.343 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.051s 2024-04-25T23:03:46.473 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T23:03:46.475 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-04-25T23:03:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m5.019s 2024-04-25T23:03:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m4.800s 2024-04-25T23:03:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.148s 2024-04-25T23:03:46.675 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T23:03:46.677 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T23:03:46.677 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m5.216s 2024-04-25T23:03:46.677 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m4.908s 2024-04-25T23:03:46.677 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m0.225s 2024-04-25T23:03:46.678 INFO:tasks.ceph:Archiving logs... 2024-04-25T23:03:46.678 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi043/log 2024-04-25T23:03:46.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T23:03:46.974 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi099/log 2024-04-25T23:03:46.975 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T23:03:47.633 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi165/log 2024-04-25T23:03:47.634 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T23:03:48.320 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi172/log 2024-04-25T23:03:48.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T23:03:48.441 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T23:03:48.450 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T23:03:48.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T23:03:48.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T23:03:48.456 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T23:03:48.459 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T23:03:48.561 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T23:03:48.571 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T23:03:48.571 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T23:03:48.573 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T23:03:48.576 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T23:03:48.578 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T23:03:48.584 INFO:teuthology.orchestra.run.smithi043.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T23:03:48.584 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================== 2024-04-25T23:03:48.584 INFO:teuthology.orchestra.run.smithi043.stdout:+hv01.front.sepi 67.205.162.81 3 u 9 64 377 0.070 -1.305 0.609 2024-04-25T23:03:48.584 INFO:teuthology.orchestra.run.smithi043.stdout:*hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.088 +0.615 0.745 2024-04-25T23:03:48.584 INFO:teuthology.orchestra.run.smithi043.stdout:+hv03.front.sepi 74.6.168.72 3 u - 64 377 0.075 +0.692 0.887 2024-04-25T23:03:48.584 INFO:teuthology.orchestra.run.smithi043.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:03:48.587 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T23:03:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-04-25T23:03:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:+hv01.front.sepi 67.205.162.81 3 u 10 64 377 0.078 -4.254 2.074 2024-04-25T23:03:48.588 INFO:teuthology.orchestra.run.smithi099.stdout:*hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.081 +0.016 1.003 2024-04-25T23:03:48.588 INFO:teuthology.orchestra.run.smithi099.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.079 -0.480 1.294 2024-04-25T23:03:48.588 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:03:48.589 INFO:teuthology.orchestra.run.smithi165.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T23:03:48.589 INFO:teuthology.orchestra.run.smithi165.stdout:============================================================================== 2024-04-25T23:03:48.589 INFO:teuthology.orchestra.run.smithi165.stdout:*hv01.front.sepi 67.205.162.81 3 u 10 64 377 0.071 -0.960 1.102 2024-04-25T23:03:48.589 INFO:teuthology.orchestra.run.smithi165.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.099 +0.555 0.557 2024-04-25T23:03:48.589 INFO:teuthology.orchestra.run.smithi165.stdout:+hv03.front.sepi 74.6.168.72 3 u 61 64 177 0.124 -0.948 0.548 2024-04-25T23:03:48.589 INFO:teuthology.orchestra.run.smithi165.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:03:48.606 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T23:03:48.606 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-04-25T23:03:48.606 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi 67.205.162.81 3 u 43 64 3 0.109 +87.632 1.045 2024-04-25T23:03:48.606 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi 63.231.80.2 3 u 40 64 3 0.120 +89.741 1.016 2024-04-25T23:03:48.607 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi 74.6.168.72 3 u 43 64 3 0.163 +88.651 1.079 2024-04-25T23:03:48.607 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:03:48.607 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T23:03:48.616 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T23:03:48.617 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T23:03:48.629 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T23:03:48.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T23:03:48.646 INFO:teuthology.task.internal:Duration was 910.029791 seconds 2024-04-25T23:03:48.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T23:03:48.656 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T23:03:48.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T23:03:48.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T23:03:48.661 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T23:03:48.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T23:03:48.705 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T23:03:48.705 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T23:03:48.705 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T23:03:48.748 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-04-25T23:03:48.748 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T23:03:48.758 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T23:03:48.758 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T23:03:48.768 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T23:03:48.768 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T23:03:48.778 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T23:03:48.779 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T23:03:48.792 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T23:03:48.802 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T23:03:48.811 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T23:03:48.876 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T23:03:48.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T23:03:48.878 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T23:03:48.880 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T23:03:48.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T23:03:48.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T23:03:49.004 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T23:03:49.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T23:03:49.017 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T23:03:49.031 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T23:03:49.044 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T23:03:49.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T23:03:49.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.074 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.080 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-04-25T23:03:49.083 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-04-25T23:03:49.091 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.101 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-04-25T23:03:49.121 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-04-25T23:03:49.170 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:03:49.177 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:03:49.217 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:03:49.222 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T23:03:49.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:03:49.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T23:03:49.238 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T23:03:49.239 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi043 2024-04-25T23:03:49.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T23:03:49.261 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi099 2024-04-25T23:03:49.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T23:03:49.281 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi165 2024-04-25T23:03:49.281 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T23:03:49.302 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674072/remote/smithi172 2024-04-25T23:03:49.303 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T23:03:49.322 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T23:03:49.322 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T23:03:49.325 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T23:03:49.327 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T23:03:49.344 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T23:03:49.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T23:03:49.379 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T23:03:49.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T23:03:49.390 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T23:03:49.390 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T23:03:49.393 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T23:03:49.395 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T23:03:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 23:03 /home/ubuntu/cephtest 2024-04-25T23:03:49.398 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T23:03:49.398 INFO:teuthology.orchestra.run.smithi099.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 23:03 /home/ubuntu/cephtest 2024-04-25T23:03:49.400 INFO:teuthology.orchestra.run.smithi165.stdout: 658752 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 23:03 /home/ubuntu/cephtest 2024-04-25T23:03:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 23:03 /home/ubuntu/cephtest 2024-04-25T23:03:49.416 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T23:03:49.427 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T23:03:49.452 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 910.029791355133 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T23:03:49.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T23:03:49.535 INFO:teuthology.run:pass